2024-09-12T17:59:40.819 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:59:40.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:59:40.929 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} email: bhubbard@redhat.com first_in_suite: false job_id: '7901167' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 46406987da2067f022005d68ecbb989daaabb837 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 46406987da2067f022005d68ecbb989daaabb837 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_bhubbard@teuthology priority: 150 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 245 sha1: 46406987da2067f022005d68ecbb989daaabb837 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKvMl2iCcrmCdHm6eJtj9klE7xUn5XhSF6KGuf/plZaAY3vvsR3m6PRXdlQt3V3mZlsy2QJs3QEUs2yWM5vnqQ= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMAYTS+BzX404MLlmwbbaVpJJz0oxnl4e/JIvXmUkOG6vLHbHiL6J9L9E6GwgZ8qS4cgt0uLFGLwDt/teMC1ubQ= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOOQzf3KwXm3m8b30wdyPHPoB13NXVbCIMddA/eANpVH366YxUANt4YjdfKWOQ7atoBtLJEFo3xLThWtjM0hPxk= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBV4xga5KUT2U/N54v0O0z6YVYJQZ4OQkLr/jQ7BC1ncd2Byrx8VE3nnBgJygzaRDK+pZugy/JZopgiyMECsVZk= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_02:37:30 tube: smithi user: bhubbard verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:59:40.930 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-12T17:59:40.931 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-12T17:59:40.931 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:59:40.932 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:59:41.023 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '46406987da2067f022005d68ecbb989daaabb837' 2024-09-12T17:59:41.023 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:59:41.024 INFO:teuthology.packaging:ref: None 2024-09-12T17:59:41.024 INFO:teuthology.packaging:tag: None 2024-09-12T17:59:41.024 INFO:teuthology.packaging:branch: main 2024-09-12T17:59:41.024 INFO:teuthology.packaging:sha1: 46406987da2067f022005d68ecbb989daaabb837 2024-09-12T17:59:41.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-12T17:59:41.242 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4881-ge5d6b434-1jammy 2024-09-12T17:59:41.244 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:59:41.256 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:59:41.256 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:59:41.276 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:59:41.289 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:59:41.300 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:59:41.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:53:56.788523', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDfzzSkj6E9mB3U/hftzXt+GLDrRDFAkRF/Zp78crHnV'} 2024-09-12T17:59:41.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:53:56.789619', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKiKRYlalpbW+vP4eVynZXTOYGFFBLlSUNvCirjyj0L3'} 2024-09-12T17:59:41.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:53:56.784990', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKMJaVlbrFKehNYgjVO6Z6lS84AlOuh9mVH916BlbYCa'} 2024-09-12T17:59:41.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:53:56.786975', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH+hlZKip5NkH5OB62PYLV2m57FBbkiu7qpHF0ebkbEs'} 2024-09-12T17:59:41.375 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:59:41.381 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T17:59:41.381 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['osd.0'] 2024-09-12T17:59:41.381 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['osd.1'] 2024-09-12T17:59:41.381 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['osd.2'] 2024-09-12T17:59:41.381 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:59:41.475 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f267b096e60>, signals=[15]) 2024-09-12T17:59:41.475 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:59:41.482 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:59:41.482 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T17:59:41.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:41.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T17:59:41.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:41.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T17:59:41.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:41.727 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T17:59:41.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:41.807 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:59:41.814 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-12T17:59:41.820 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-12T17:59:41.820 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2024-09-12T17:59:41.866 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2024-09-12T17:59:41.867 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:59:41.867 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:59:41.867 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:59:41.867 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:59:41.867 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:59:41.867 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-12T17:59:41.889 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-09-12T17:59:41.895 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-09-12T17:59:41.895 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-09-12T17:59:41.941 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:59:41.941 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Ubuntu" 2024-09-12T17:59:41.941 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="22.04" 2024-09-12T17:59:41.941 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:59:41.941 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_CODENAME=jammy 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:ID=ubuntu 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE=debian 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:59:41.942 INFO:teuthology.orchestra.run.smithi129.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:59:41.942 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-09-12T17:59:41.964 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-12T17:59:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-12T17:59:41.970 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-12T17:59:42.018 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:59:42.018 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-09-12T17:59:42.018 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:59:42.019 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:59:42.019 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-12T17:59:42.039 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-12T17:59:42.044 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-12T17:59:42.045 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-12T17:59:42.090 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:59:42.090 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2024-09-12T17:59:42.091 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="22.04" 2024-09-12T17:59:42.091 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:59:42.091 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=jammy 2024-09-12T17:59:42.091 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2024-09-12T17:59:42.091 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2024-09-12T17:59:42.091 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:59:42.092 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:59:42.092 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:59:42.092 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:59:42.092 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:59:42.092 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-12T17:59:42.113 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:59:42.126 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:59:42.145 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:59:42.145 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:59:42.148 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:59:42.150 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:59:42.153 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:59:42.159 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:59:42.166 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:59:42.166 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:59:42.195 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:59:42.197 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:59:42.200 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:59:42.287 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:59:42.377 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:59:42.393 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:59:42.393 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:59:42.393 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:59:42.394 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:59:42.394 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:59:42.395 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:59:42.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:59:42.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:59:42.401 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-12T17:59:42.401 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-09-12T17:59:42.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:59:42.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:59:42.403 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-12T17:59:42.403 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T17:59:42.445 INFO:teuthology.orchestra.run.smithi129.stdout:5.15.0-56-generic 2024-09-12T17:59:42.445 INFO:teuthology.task.kernel:Running kernel on smithi129: 5.15.0-56-generic 2024-09-12T17:59:42.445 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get clean 2024-09-12T17:59:42.447 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-09-12T17:59:42.447 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-09-12T17:59:42.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-12T17:59:42.450 INFO:teuthology.orchestra.run.smithi176.stdout:5.15.0-56-generic 2024-09-12T17:59:42.451 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.15.0-56-generic 2024-09-12T17:59:42.451 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get clean 2024-09-12T17:59:42.452 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-56-generic 2024-09-12T17:59:42.452 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.15.0-56-generic 2024-09-12T17:59:42.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-09-12T17:59:42.572 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-12T17:59:42.582 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get update 2024-09-12T17:59:42.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-12T17:59:42.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-09-12T17:59:42.731 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:59:42.736 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:42.746 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:59:42.764 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:42.764 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:59:42.764 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:59:42.815 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:59:42.822 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:59:42.848 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:42.849 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:59:42.849 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:42.850 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:59:42.919 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:59:42.930 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:59:42.962 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:59:42.971 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:59:42.991 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:59:43.039 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:59:43.062 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:59:43.065 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:59:43.065 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:59:43.065 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:59:43.068 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:59:43.068 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:59:43.074 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:59:43.077 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:59:43.084 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:59:43.085 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:59:43.088 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:59:43.088 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:59:43.091 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:59:43.091 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:59:43.095 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:59:43.101 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:59:43.102 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:59:43.103 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:59:43.103 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:59:43.104 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:59:43.104 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:59:43.106 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:59:43.106 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:59:43.107 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:59:43.107 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:59:43.113 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:59:43.120 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:59:43.122 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:59:43.124 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:59:43.124 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:59:43.125 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:59:43.125 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:59:43.128 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:59:43.128 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:59:43.129 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:59:43.132 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:59:43.137 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:59:43.143 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:59:43.144 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:59:43.145 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:59:43.145 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:59:43.145 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:59:43.146 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:59:43.147 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:59:43.147 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:59:43.147 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:59:43.163 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:59:43.164 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:59:43.164 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:59:43.169 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:59:43.169 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:59:43.169 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:59:43.178 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:59:43.178 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:59:43.179 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:59:43.180 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:59:43.180 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:59:43.180 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:59:43.216 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:59:43.220 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:59:43.220 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:59:43.227 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:59:43.237 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:59:43.239 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:59:43.240 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:59:43.240 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:59:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:59:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:59:43.266 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:59:43.267 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:59:43.268 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:59:43.270 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:59:43.273 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:59:43.283 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:59:43.283 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:59:43.284 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:59:43.284 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:59:43.285 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:59:43.287 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:59:43.293 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:59:43.412 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:59:43.426 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:59:43.562 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:59:43.605 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:59:43.712 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:59:43.729 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:59:43.733 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:59:43.737 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:59:43.738 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:59:43.739 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:59:43.741 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:59:43.745 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:59:43.746 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:59:43.748 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:59:43.762 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:59:43.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:59:43.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:59:43.778 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:59:43.779 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:59:43.792 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:59:43.793 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:59:43.795 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:59:43.835 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:59:43.846 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:59:43.846 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:59:43.862 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:59:43.863 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:59:43.874 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:59:43.874 INFO:teuthology.orchestra.run.smithi129.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:59:43.888 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:59:43.890 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:59:43.890 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:59:43.894 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:59:43.895 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:59:43.895 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:59:43.895 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:59:43.896 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:59:43.896 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:59:43.897 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:59:43.897 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:59:43.908 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:59:43.913 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:59:43.916 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:59:43.919 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:59:43.924 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:59:43.927 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:59:43.928 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:59:43.928 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:59:43.928 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:59:43.929 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:59:43.929 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:59:43.929 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:59:43.975 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:59:43.978 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:59:44.001 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:59:44.001 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:59:44.002 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:59:44.003 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:59:44.003 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:59:44.009 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:59:44.009 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:59:44.021 INFO:teuthology.orchestra.run.smithi129.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:59:44.021 INFO:teuthology.orchestra.run.smithi129.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:59:44.021 INFO:teuthology.orchestra.run.smithi129.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:59:44.022 INFO:teuthology.orchestra.run.smithi129.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:59:44.023 INFO:teuthology.orchestra.run.smithi129.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:59:44.072 INFO:teuthology.orchestra.run.smithi129.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:59:44.090 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:59:44.091 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:59:49.359 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 15.8 MB in 2s (7,384 kB/s) 2024-09-12T17:59:49.445 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 15.8 MB in 2s (7,590 kB/s) 2024-09-12T17:59:49.994 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 15.8 MB in 2s (7,149 kB/s) 2024-09-12T17:59:50.165 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 15.8 MB in 3s (5,818 kB/s) 2024-09-12T17:59:50.892 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T17:59:50.911 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:59:50.950 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T17:59:50.968 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:59:50.975 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T17:59:51.023 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T17:59:51.184 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-09-12T17:59:51.184 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-09-12T17:59:51.208 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-09-12T17:59:51.208 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-09-12T17:59:51.366 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:51.366 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:51.366 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:51.367 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:51.367 INFO:teuthology.orchestra.run.smithi129.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:59:51.367 INFO:teuthology.orchestra.run.smithi129.stdout: python2.7-minimal 2024-09-12T17:59:51.367 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:51.369 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2024-09-12T17:59:51.369 INFO:teuthology.orchestra.run.smithi129.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:51.369 INFO:teuthology.orchestra.run.smithi129.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:59:51.369 INFO:teuthology.orchestra.run.smithi129.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:51.370 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2024-09-12T17:59:51.370 INFO:teuthology.orchestra.run.smithi129.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:59:51.371 INFO:teuthology.orchestra.run.smithi129.stdout:Recommended packages: 2024-09-12T17:59:51.371 INFO:teuthology.orchestra.run.smithi129.stdout: thermald 2024-09-12T17:59:51.376 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:51.376 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:51.376 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:51.377 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:51.377 INFO:teuthology.orchestra.run.smithi176.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:59:51.377 INFO:teuthology.orchestra.run.smithi176.stdout: python2.7-minimal 2024-09-12T17:59:51.377 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:51.378 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-09-12T17:59:51.378 INFO:teuthology.orchestra.run.smithi176.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:51.378 INFO:teuthology.orchestra.run.smithi176.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:59:51.378 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:51.380 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-09-12T17:59:51.380 INFO:teuthology.orchestra.run.smithi176.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:59:51.380 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2024-09-12T17:59:51.380 INFO:teuthology.orchestra.run.smithi176.stdout: thermald 2024-09-12T17:59:51.410 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2024-09-12T17:59:51.410 INFO:teuthology.orchestra.run.smithi129.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:51.410 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:59:51.411 INFO:teuthology.orchestra.run.smithi129.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:51.412 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be upgraded: 2024-09-12T17:59:51.412 INFO:teuthology.orchestra.run.smithi129.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:59:51.436 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T17:59:51.444 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-09-12T17:59:51.444 INFO:teuthology.orchestra.run.smithi176.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:51.444 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:59:51.444 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:51.446 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-09-12T17:59:51.446 INFO:teuthology.orchestra.run.smithi176.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:59:51.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:59:51.463 INFO:teuthology.orchestra.run.smithi129.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:59:51.463 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 113 MB of archives. 2024-09-12T17:59:51.463 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:59:51.463 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:59:51.499 INFO:teuthology.orchestra.run.smithi176.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:59:51.499 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 113 MB of archives. 2024-09-12T17:59:51.499 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:59:51.499 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:59:51.519 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T17:59:51.640 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T17:59:51.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:59:51.710 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T17:59:51.715 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T17:59:51.716 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T17:59:51.838 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:59:51.889 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:51.889 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:51.889 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:51.890 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:51.890 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:59:51.890 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2024-09-12T17:59:51.890 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:51.891 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-12T17:59:51.891 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:51.891 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:59:51.891 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:51.893 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-12T17:59:51.893 INFO:teuthology.orchestra.run.smithi062.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:59:51.893 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-09-12T17:59:51.893 INFO:teuthology.orchestra.run.smithi062.stdout: thermald 2024-09-12T17:59:51.894 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T17:59:51.894 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T17:59:51.927 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:59:51.939 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:59:51.945 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-12T17:59:51.945 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:51.945 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:59:51.945 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:51.947 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2024-09-12T17:59:51.947 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:59:52.052 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:59:52.060 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:52.060 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:52.060 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:52.061 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:52.061 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:59:52.061 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-09-12T17:59:52.061 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:52.062 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-12T17:59:52.063 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:52.063 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:59:52.063 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:52.064 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-12T17:59:52.064 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:59:52.064 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-12T17:59:52.065 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-09-12T17:59:52.111 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-12T17:59:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:59:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:59:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:59:52.113 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-09-12T17:59:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:59:52.141 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:59:52.141 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 113 MB of archives. 2024-09-12T17:59:52.141 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:59:52.141 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:59:52.172 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:59:52.172 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-09-12T17:59:52.172 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:59:52.172 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:59:52.656 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:59:52.761 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:59:52.813 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:59:52.814 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:59:52.814 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:59:52.958 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:59:52.958 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:59:52.958 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:59:53.055 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:59:53.082 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:59:53.116 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:59:53.181 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:59:53.516 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 113 MB in 2s (66.8 MB/s) 2024-09-12T17:59:53.591 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:59:53.591 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:59:53.591 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:59:53.628 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:59:53.647 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 113 MB in 2s (65.6 MB/s) 2024-09-12T17:59:53.836 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:59:53.851 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:59:53.976 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:59:54.172 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:59:54.215 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:59:54.599 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 2s (54.1 MB/s) 2024-09-12T17:59:54.770 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:59:55.805 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:59:55.809 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:55.829 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:59:55.834 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:55.964 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:56.162 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:59:56.162 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:59:56.162 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:59:56.519 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:59:56.604 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:59:56.809 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:59:56.813 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:56.900 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:57.036 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-12T17:59:57.201 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:59:58.067 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:59:58.088 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:58.176 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:58.190 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:59:58.211 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:58.298 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:58.670 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:59:58.690 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:58.728 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:58.868 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:59:58.888 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:59.092 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:59.178 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:59:59.183 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:59.249 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:59.418 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:59:59.439 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:59:59.530 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:59:59.996 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:00:00.017 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:00.054 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:01.718 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:00:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:01.835 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:02.312 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:00:02.333 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:02.370 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:05.564 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:05.874 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:06.074 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:06.075 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:06.194 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:06.203 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:06.464 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:00:06.487 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:00:06.522 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:06.544 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:06.546 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:06.673 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:06.673 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:06.977 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:00:07.000 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:00:07.015 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:07.042 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:07.160 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:07.421 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:00:07.444 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:00:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:08.457 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:08.558 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:08.850 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:08.978 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:09.281 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:00:09.304 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:00:09.348 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:12.516 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:00:12.552 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:12.590 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:13.025 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:00:13.055 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:00:13.062 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:13.092 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:13.099 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:13.130 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:15.024 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:00:15.061 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:00:15.105 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:15.334 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:15.484 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:15.707 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:15.817 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:15.867 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:15.988 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:16.125 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:16.139 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:00:16.246 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:16.268 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:16.381 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:00:16.446 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:16.509 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:16.594 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:16.943 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:17.056 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:17.183 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:00:17.345 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:17.587 INFO:teuthology.orchestra.run.smithi176.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:17.587 INFO:teuthology.orchestra.run.smithi176.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:17.587 INFO:teuthology.orchestra.run.smithi176.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:17.588 INFO:teuthology.orchestra.run.smithi176.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:17.744 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:17.789 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:00:17.809 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:17.809 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:17.809 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:17.809 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:17.918 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:00:17.978 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:18.706 INFO:teuthology.orchestra.run.smithi129.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:18.706 INFO:teuthology.orchestra.run.smithi129.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:18.706 INFO:teuthology.orchestra.run.smithi129.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:18.706 INFO:teuthology.orchestra.run.smithi129.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:19.097 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:19.144 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:00:19.257 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:19.383 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:00:19.454 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:19.512 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:19.512 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:20.506 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:20.856 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:00:20.864 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:20.864 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:20.864 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:20.865 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:20.982 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:00:21.030 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:21.108 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:21.164 INFO:teuthology.orchestra.run.smithi176.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:00:21.164 INFO:teuthology.orchestra.run.smithi176.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:21.173 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:00:21.298 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:00:21.433 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:21.510 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:00:21.510 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:21.875 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:00:21.975 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:00:22.093 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:22.145 INFO:teuthology.orchestra.run.smithi129.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:00:22.145 INFO:teuthology.orchestra.run.smithi129.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:22.498 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:23.950 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:00:24.076 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:00:24.985 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:00:25.076 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:00:25.076 INFO:teuthology.orchestra.run.smithi062.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:35.399 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:00:35.400 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:00:35.408 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:35.425 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-09-12T18:00:35.619 INFO:teuthology.orchestra.run.smithi176.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:00:35.619 INFO:teuthology.orchestra.run.smithi176.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:00:35.646 INFO:teuthology.orchestra.run.smithi176.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:35.662 INFO:teuthology.orchestra.run.smithi176.stdout:Generating grub configuration file ... 2024-09-12T18:00:35.695 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:35.717 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:35.963 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:35.985 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:35.999 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:36.005 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:36.074 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:36.080 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:36.088 INFO:teuthology.orchestra.run.smithi129.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:00:36.088 INFO:teuthology.orchestra.run.smithi129.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:00:36.113 INFO:teuthology.orchestra.run.smithi129.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:36.145 INFO:teuthology.orchestra.run.smithi129.stdout:Generating grub configuration file ... 2024-09-12T18:00:36.242 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:36.242 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:36.242 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:36.296 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-09-12T18:00:36.329 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:36.333 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:36.400 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:36.405 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:36.465 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:36.482 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:36.580 INFO:teuthology.orchestra.run.smithi176.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:36.581 INFO:teuthology.orchestra.run.smithi176.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:36.581 INFO:teuthology.orchestra.run.smithi176.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:36.626 INFO:teuthology.orchestra.run.smithi176.stdout:done 2024-09-12T18:00:36.742 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-12T18:00:37.070 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:37.070 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:37.070 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:37.071 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:37.087 INFO:teuthology.orchestra.run.smithi129.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:37.087 INFO:teuthology.orchestra.run.smithi129.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:37.087 INFO:teuthology.orchestra.run.smithi129.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:37.096 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-12T18:00:37.096 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:37.096 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:37.096 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-12T18:00:37.097 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:00:37.097 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:00:37.097 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:00:37.097 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T18:00:37.097 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:00:37.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-12T18:00:37.119 INFO:teuthology.orchestra.run.smithi129.stdout:done 2024-09-12T18:00:37.130 DEBUG:teuthology.orchestra.run.smithi176:> dpkg -s linux-image-generic 2024-09-12T18:00:37.147 INFO:teuthology.orchestra.run.smithi176.stdout:Package: linux-image-generic 2024-09-12T18:00:37.147 INFO:teuthology.orchestra.run.smithi176.stdout:Status: install ok installed 2024-09-12T18:00:37.147 INFO:teuthology.orchestra.run.smithi176.stdout:Priority: optional 2024-09-12T18:00:37.147 INFO:teuthology.orchestra.run.smithi176.stdout:Section: kernel 2024-09-12T18:00:37.147 INFO:teuthology.orchestra.run.smithi176.stdout:Installed-Size: 21 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: amd64 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Source: linux-meta 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Recommends: thermald 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: available. 2024-09-12T18:00:37.148 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:00:37.149 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:00:37.149 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:00:37.149 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T18:00:37.149 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:00:37.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get clean 2024-09-12T18:00:37.235 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-12T18:00:37.325 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-09-12T18:00:37.349 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:00:37.360 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:00:37.377 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:00:37.472 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:00:37.570 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:00:37.570 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:00:37.610 DEBUG:teuthology.orchestra.run.smithi129:> dpkg -s linux-image-generic 2024-09-12T18:00:37.631 INFO:teuthology.orchestra.run.smithi129.stdout:Package: linux-image-generic 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Status: install ok installed 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Priority: optional 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Section: kernel 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Installed-Size: 21 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: amd64 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Source: linux-meta 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:37.632 INFO:teuthology.orchestra.run.smithi129.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:37.633 INFO:teuthology.orchestra.run.smithi129.stdout:Recommends: thermald 2024-09-12T18:00:37.633 INFO:teuthology.orchestra.run.smithi129.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:37.633 INFO:teuthology.orchestra.run.smithi129.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:37.633 INFO:teuthology.orchestra.run.smithi129.stdout: available. 2024-09-12T18:00:37.633 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:00:37.633 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:00:37.633 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:00:37.633 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T18:00:37.633 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:00:37.633 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get clean 2024-09-12T18:00:37.641 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:00:37.722 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:00:37.772 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get update 2024-09-12T18:00:37.881 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:00:37.891 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:00:37.908 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:00:38.004 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:00:38.696 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T18:00:38.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:00:38.768 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T18:00:38.953 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T18:00:38.953 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T18:00:39.026 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T18:00:39.046 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:00:39.098 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T18:00:39.119 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:00:39.119 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:00:39.119 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:00:39.119 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:00:39.119 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:00:39.120 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:00:39.120 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:00:39.120 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:00:39.160 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:00:39.161 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-12T18:00:39.189 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:00:39.189 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:00:39.199 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-12T18:00:39.217 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:39.218 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:39.218 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:39.218 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-12T18:00:39.218 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:39.218 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:39.218 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-12T18:00:39.218 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-12T18:00:39.224 INFO:teuthology.orchestra.run.smithi062.stdout:Generating grub configuration file ... 2024-09-12T18:00:39.265 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.C74nAd2ZBq 2024-09-12T18:00:39.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.C74nAd2ZBq 2024-09-12T18:00:39.291 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-09-12T18:00:39.292 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-09-12T18:00:39.311 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T18:00:39.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.C74nAd2ZBq 2024-09-12T18:00:39.331 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:00:39.384 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T18:00:39.453 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.C74nAd2ZBq is 10KB 2024-09-12T18:00:39.465 INFO:teuthology.orchestra.run.smithi176.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:00:39.465 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:00:39.465 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:00:39.466 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:00:39.466 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:00:39.467 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:00:39.467 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:00:39.467 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:00:39.467 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.C74nAd2ZBq 2024-09-12T18:00:39.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:39.484 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:39.504 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:39.507 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:00:39.509 DEBUG:teuthology.orchestra.run.smithi176:> dpkg -s linux-image-generic 2024-09-12T18:00:39.526 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:00:39.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:00:39.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:39.569 INFO:teuthology.orchestra.run.smithi176.stdout:Package: linux-image-generic 2024-09-12T18:00:39.569 INFO:teuthology.orchestra.run.smithi176.stdout:Status: install ok installed 2024-09-12T18:00:39.569 INFO:teuthology.orchestra.run.smithi176.stdout:Priority: optional 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Section: kernel 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Installed-Size: 21 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: amd64 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Source: linux-meta 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Recommends: thermald 2024-09-12T18:00:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:39.571 INFO:teuthology.orchestra.run.smithi176.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:39.571 INFO:teuthology.orchestra.run.smithi176.stdout: available. 2024-09-12T18:00:39.571 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-12T18:00:39.582 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-09-12T18:00:39.585 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-09-12T18:00:39.595 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:00:39.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-09-12T18:00:39.614 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.XAXyShxoVX 2024-09-12T18:00:39.614 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XAXyShxoVX 2024-09-12T18:00:39.670 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.XAXyShxoVX 2024-09-12T18:00:39.748 INFO:teuthology.orchestra.run.smithi129.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:00:39.748 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:00:39.748 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:00:39.749 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:00:39.749 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:00:39.749 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:00:39.749 INFO:teuthology.orchestra.run.smithi129.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:00:39.750 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:00:39.789 INFO:teuthology.orchestra.run.smithi129.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:00:39.791 DEBUG:teuthology.orchestra.run.smithi129:> dpkg -s linux-image-generic 2024-09-12T18:00:39.791 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.XAXyShxoVX is 10KB 2024-09-12T18:00:39.795 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:39.800 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:39.805 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.XAXyShxoVX 2024-09-12T18:00:39.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:39.843 INFO:teuthology.orchestra.run.smithi129.stdout:Package: linux-image-generic 2024-09-12T18:00:39.843 INFO:teuthology.orchestra.run.smithi129.stdout:Status: install ok installed 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Priority: optional 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Section: kernel 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Installed-Size: 21 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: amd64 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Source: linux-meta 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:39.844 INFO:teuthology.orchestra.run.smithi129.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:39.845 INFO:teuthology.orchestra.run.smithi129.stdout:Recommends: thermald 2024-09-12T18:00:39.845 INFO:teuthology.orchestra.run.smithi129.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:39.845 INFO:teuthology.orchestra.run.smithi129.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:39.845 INFO:teuthology.orchestra.run.smithi129.stdout: available. 2024-09-12T18:00:39.845 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-09-12T18:00:39.865 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:00:39.865 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:00:39.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:39.868 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:39.874 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:39.891 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.l334M5kaPi 2024-09-12T18:00:39.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub/grub.cfg /tmp/tmp.l334M5kaPi 2024-09-12T18:00:39.947 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.l334M5kaPi 2024-09-12T18:00:39.953 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:00:39.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo update-grub 2024-09-12T18:00:40.017 INFO:teuthology.orchestra.run.smithi062.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:40.018 INFO:teuthology.orchestra.run.smithi062.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:40.018 INFO:teuthology.orchestra.run.smithi062.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:40.057 INFO:teuthology.orchestra.run.smithi062.stdout:done 2024-09-12T18:00:40.075 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.l334M5kaPi is 10KB 2024-09-12T18:00:40.087 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.l334M5kaPi 2024-09-12T18:00:40.093 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:40.148 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:00:40.148 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:00:40.148 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:40.232 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:00:40.232 DEBUG:teuthology.orchestra.run.smithi129:> sudo update-grub 2024-09-12T18:00:40.539 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-09-12T18:00:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:40.561 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:40.561 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-09-12T18:00:40.561 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:00:40.561 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:00:40.561 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:00:40.561 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T18:00:40.561 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:00:40.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-09-12T18:00:40.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-12T18:00:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:00:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-09-12T18:00:40.996 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:00:40.996 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:00:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:41.052 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:41.067 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:00:41.148 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:00:41.297 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:41.325 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:00:41.326 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:41.330 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-12T18:00:41.344 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:41.349 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-09-12T18:00:41.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-09-12T18:00:41.516 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:41.522 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:41.610 INFO:teuthology.orchestra.run.smithi129.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:00:41.611 INFO:teuthology.orchestra.run.smithi129.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:41.615 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-09-12T18:00:41.760 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:41.766 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:41.806 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:41.808 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:41.811 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:41.813 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:41.953 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:41.953 INFO:teuthology.orchestra.run.smithi176.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:41.954 INFO:teuthology.orchestra.run.smithi176.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:41.965 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-12T18:00:41.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-12T18:00:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:42.082 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:42.123 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:42.128 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:42.270 INFO:teuthology.orchestra.run.smithi129.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:42.270 INFO:teuthology.orchestra.run.smithi129.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:42.287 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-09-12T18:00:42.289 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-09-12T18:00:42.470 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T18:00:42.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:00:42.543 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T18:00:42.734 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T18:00:42.734 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T18:00:42.912 INFO:teuthology.orchestra.run.smithi062.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:00:42.912 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:00:42.912 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:00:42.912 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:00:42.912 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:00:42.913 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:00:42.913 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:00:42.913 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:00:42.952 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:00:42.954 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-09-12T18:00:43.012 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-09-12T18:00:43.012 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-09-12T18:00:43.012 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-09-12T18:00:43.012 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-09-12T18:00:43.012 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.119.119 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:00:43.013 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-09-12T18:00:43.014 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T18:00:43.057 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.2EOZT4Aj4O 2024-09-12T18:00:43.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2EOZT4Aj4O 2024-09-12T18:00:43.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.2EOZT4Aj4O 2024-09-12T18:00:43.232 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.2EOZT4Aj4O is 10KB 2024-09-12T18:00:43.244 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.2EOZT4Aj4O 2024-09-12T18:00:43.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:43.306 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:00:43.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:00:43.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:00:43.371 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:00:43.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo update-grub 2024-09-12T18:00:44.620 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:00:44.621 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:00:44.623 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-09-12T18:00:44.814 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:00:44.820 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:00:45.063 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:00:45.068 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:00:45.111 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:00:45.117 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:00:45.275 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:00:45.275 INFO:teuthology.orchestra.run.smithi062.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:00:45.275 INFO:teuthology.orchestra.run.smithi062.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:00:45.305 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-09-12T18:00:45.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-09-12T18:01:11.522 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T18:01:11.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:01:11.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:01:11.981 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T18:01:11.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T18:01:11.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:01:12.291 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T18:01:12.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:01:12.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:01:15.318 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T18:01:15.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T18:01:15.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:01:46.045 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-12T18:01:46.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-12T18:01:46.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-12T18:01:55.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:01:55.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:01:55.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T18:01:55.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:01:55.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:01:55.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:13.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-12T18:02:13.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-12T18:02:14.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-12T18:02:15.322 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T18:02:24.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T18:02:24.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:24.931 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T18:02:25.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:02:25.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:25.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T18:02:25.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T18:02:25.745 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T18:02:25.793 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-119-generic 2024-09-12T18:02:25.793 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:02:25.793 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:02:25.794 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:02:25.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T18:02:25.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:26.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:02:26.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:26.209 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-12T18:02:26.413 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-12T18:02:26.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-12T18:02:26.794 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T18:02:26.794 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:02:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-09-12T18:02:27.019 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:27.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T18:02:27.486 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-119-generic"... 2024-09-12T18:02:27.486 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-12T18:02:27.534 INFO:teuthology.orchestra.run.smithi176.stdout:5.15.0-119-generic 2024-09-12T18:02:27.535 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:02:27.535 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:02:27.535 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:02:28.536 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T18:02:28.536 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:02:28.721 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2024-09-12T18:02:28.744 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:41.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:02:41.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:41.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:02:41.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:02:41.570 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-12T18:02:41.798 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-12T18:02:42.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:02:42.162 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-119-generic"... 2024-09-12T18:02:42.162 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-09-12T18:02:42.207 INFO:teuthology.orchestra.run.smithi129.stdout:5.15.0-119-generic 2024-09-12T18:02:42.208 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:02:42.208 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:02:42.208 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:02:42.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:02:42.381 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-119-generic"... 2024-09-12T18:02:42.381 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-12T18:02:42.426 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-119-generic 2024-09-12T18:02:42.426 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:02:42.427 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:02:42.427 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:02:43.209 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T18:02:43.209 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:02:43.280 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-09-12T18:02:43.321 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:43.428 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T18:02:43.428 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:02:43.497 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-09-12T18:02:43.528 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:43.528 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T18:02:43.536 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T18:02:43.537 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:02:43.539 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:02:43.541 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:02:43.544 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:02:43.550 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T18:02:43.556 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T18:02:43.565 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T18:02:43.566 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:02:43.586 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:02:43.589 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:02:43.592 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:02:43.702 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T18:02:43.708 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T18:02:43.709 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:02:43.711 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:02:43.713 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:02:43.716 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:02:43.730 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.732 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.735 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.738 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.739 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.740 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.743 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.747 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:02:43.749 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T18:02:43.756 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T18:02:43.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:02:43.786 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:02:43.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:02:43.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:02:43.816 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T18:02:43.825 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T18:02:43.825 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:02:43.842 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:02:43.845 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:02:43.848 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:02:43.862 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:02:43.893 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:02:43.942 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:02:43.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:02:44.002 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:02:44.008 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:02:44.056 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:02:44.056 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:02:44.126 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:02:44.132 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:02:44.179 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:02:44.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:02:44.245 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:02:44.251 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:02:44.299 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:02:44.299 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:02:44.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-12T18:02:44.366 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-09-12T18:02:44.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-12T18:02:44.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-12T18:02:44.445 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T18:02:44.454 INFO:teuthology.task.internal:Starting timer... 2024-09-12T18:02:44.455 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T18:02:44.508 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T18:02:44.515 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2024-09-12T18:02:44.516 DEBUG:teuthology.task.selinux:Excluding smithi129: OS 'ubuntu' does not support SELinux 2024-09-12T18:02:44.516 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-09-12T18:02:44.516 DEBUG:teuthology.task.selinux:Excluding smithi176: OS 'ubuntu' does not support SELinux 2024-09-12T18:02:44.516 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T18:02:44.516 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T18:02:44.516 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T18:02:44.516 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T18:02:44.525 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T18:02:44.528 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T18:02:44.674 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T18:02:44.687 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T18:02:44.688 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi129.front.sepia.ceph.com,smithi151.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T18:10:22.856 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-12T18:10:22.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T18:10:22.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:10:22.943 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T18:10:23.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T18:10:23.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:10:23.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:10:23.104 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-12T18:10:23.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:10:23.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:10:23.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:10:23.260 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-12T18:10:23.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T18:10:23.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T18:10:23.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:10:23.415 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-12T18:10:23.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-12T18:10:23.494 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T18:10:23.505 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T18:10:23.505 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:10:23.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:10:23.508 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:10:23.508 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:10:23.510 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:10:23.510 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:10:23.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:10:23.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:10:23.537 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Command line: ntpd -gq 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: ---------------------------------------------------- 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: corporation. Support and training for ntp-4 are 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: available at https://www.nwtime.org/support 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: ---------------------------------------------------- 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: proto: precision = 0.067 usec (-24) 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: basedate set to 2022-02-04 2024-09-12T18:10:23.538 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:10:23.539 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.539 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.539 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.539 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.540 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:10:23.540 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:10:23.540 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:10:23.540 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2024-09-12T18:10:23.540 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listen normally on 4 lo [::1]:123 2024-09-12T18:10:23.541 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2024-09-12T18:10:23.541 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:23 ntpd[18460]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:10:23.542 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:10:23.542 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Command line: ntpd -gq 2024-09-12T18:10:23.542 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: ---------------------------------------------------- 2024-09-12T18:10:23.542 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:10:23.542 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:10:23.542 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: corporation. Support and training for ntp-4 are 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: available at https://www.nwtime.org/support 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: ---------------------------------------------------- 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: proto: precision = 0.043 usec (-24) 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: basedate set to 2022-02-04 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Command line: ntpd -gq 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: ---------------------------------------------------- 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:10:23.543 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: corporation. Support and training for ntp-4 are 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: available at https://www.nwtime.org/support 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: ---------------------------------------------------- 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: proto: precision = 0.044 usec (-24) 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: basedate set to 2022-02-04 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.544 INFO:teuthology.orchestra.run.smithi129.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.545 INFO:teuthology.orchestra.run.smithi129.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.545 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.545 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.546 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listen normally on 3 enp3s0f1 172.21.15.129:123 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listen normally on 4 lo [::1]:123 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7261%5]:123 2024-09-12T18:10:23.547 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:23 ntpd[18490]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listen normally on 4 lo [::1]:123 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-09-12T18:10:23.548 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:23 ntpd[18491]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:10:23.562 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:10:23.562 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Command line: ntpd -gq 2024-09-12T18:10:23.563 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: ---------------------------------------------------- 2024-09-12T18:10:23.563 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:10:23.563 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:10:23.563 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: corporation. Support and training for ntp-4 are 2024-09-12T18:10:23.563 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: available at https://www.nwtime.org/support 2024-09-12T18:10:23.563 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: ---------------------------------------------------- 2024-09-12T18:10:23.564 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: proto: precision = 0.055 usec (-24) 2024-09-12T18:10:23.564 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: basedate set to 2022-02-04 2024-09-12T18:10:23.564 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:10:23.564 INFO:teuthology.orchestra.run.smithi176.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.564 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:10:23.565 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.565 INFO:teuthology.orchestra.run.smithi176.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listen normally on 3 enp3s0f1 172.21.15.176:123 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listen normally on 4 lo [::1]:123 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f61%5]:123 2024-09-12T18:10:23.566 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:23 ntpd[18503]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:24 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:24.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:24 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:24 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.539 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:24 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.539 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:24 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:24.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:24.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:24.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:24 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:25.537 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:25 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:25 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:25.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:25 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:25 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:25.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:25 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:25.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:25 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:25.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:25.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:25 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:26.537 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:26 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:26 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:26.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:26 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:26.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:26 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:26 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:26 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:26 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:26 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:26.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:26 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:26.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:26.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:26 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:26.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:26.565 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:26.565 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:26 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:27.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:27 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:27.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:27.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:27 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:27.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:27 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:27.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:27 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:27.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:27.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:27 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.537 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:28 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:28 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:28 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:28 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:28 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:28 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:28 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:28 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:28 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:28 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:28.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:28 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:29.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:29 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:29.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:29.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:29 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:29.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:29 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:29.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:29 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:29.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:29.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:29 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.539 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 18:10:30 ntpd[18460]: ntpd: time slew -0.000536 s 2024-09-12T18:10:30.539 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.000536s 2024-09-12T18:10:30.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:10:30.539 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 18:10:30 ntpd[18460]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:10:30.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:30 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:30 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:30 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:30 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:30 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:30.541 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:30 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:30.543 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:30 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.563 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stdout:12 Sep 18:10:30 ntpd[18503]: ntpd: time slew +0.001149 s 2024-09-12T18:10:30.564 INFO:teuthology.orchestra.run.smithi176.stdout:ntpd: time slew +0.001149s 2024-09-12T18:10:30.565 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:10:30.565 INFO:teuthology.orchestra.run.smithi176.stderr:12 Sep 18:10:30 ntpd[18503]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:10:30.594 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:10:30.594 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-09-12T18:10:30.594 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.594 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.595 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.595 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.613 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:10:30.613 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-09-12T18:10:30.613 INFO:teuthology.orchestra.run.smithi176.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.613 INFO:teuthology.orchestra.run.smithi176.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.613 INFO:teuthology.orchestra.run.smithi176.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:30.613 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 18:10:31 ntpd[18491]: ntpd: time slew +0.000452 s 2024-09-12T18:10:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew +0.000452s 2024-09-12T18:10:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:10:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 18:10:31 ntpd[18491]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:10:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:10:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-12T18:10:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:32.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:32.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:32.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:32.540 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:10:32.541 INFO:teuthology.orchestra.run.smithi129.stdout:12 Sep 18:10:32 ntpd[18490]: ntpd: time slew -0.000087 s 2024-09-12T18:10:32.542 INFO:teuthology.orchestra.run.smithi129.stdout:ntpd: time slew -0.000087s 2024-09-12T18:10:32.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:10:32.542 INFO:teuthology.orchestra.run.smithi129.stderr:12 Sep 18:10:32 ntpd[18490]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:10:32.594 INFO:teuthology.orchestra.run.smithi129.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:10:32.594 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================== 2024-09-12T18:10:32.594 INFO:teuthology.orchestra.run.smithi129.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:32.594 INFO:teuthology.orchestra.run.smithi129.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:32.594 INFO:teuthology.orchestra.run.smithi129.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:32.594 INFO:teuthology.orchestra.run.smithi129.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:10:32.595 INFO:teuthology.run_tasks:Running task install... 2024-09-12T18:10:32.603 DEBUG:teuthology.task.install:project ceph 2024-09-12T18:10:32.603 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}} 2024-09-12T18:10:32.603 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'} 2024-09-12T18:10:32.603 INFO:teuthology.task.install:Using flavor: default 2024-09-12T18:10:32.609 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T18:10:32.609 INFO:teuthology.task.install:extra packages: [] 2024-09-12T18:10:32.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2024-09-12T18:10:32.610 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-key list | grep Ceph 2024-09-12T18:10:32.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-09-12T18:10:32.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-key list | grep Ceph 2024-09-12T18:10:32.671 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:10:32.677 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:10:32.678 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:10:32.695 INFO:teuthology.orchestra.run.smithi129.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:10:32.701 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:10:32.701 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:10:32.702 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:10:32.702 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:10:32.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:10:32.707 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:10:32.708 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:10:32.708 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:10:32.708 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:10:32.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:10:32.711 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:10:32.711 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:10:32.711 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:10:32.712 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:10:32.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:10:32.722 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:10:32.723 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:10:32.723 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:10:32.724 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T18:10:32.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:10:32.850 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:10:32.850 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:32.856 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:10:32.856 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:32.860 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:10:32.860 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:32.867 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T18:10:32.867 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:32.960 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:10:32.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:10:32.966 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:10:32.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:10:32.971 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:10:32.971 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:10:32.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-12T18:10:32.981 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:10:32.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:10:32.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-12T18:10:32.985 DEBUG:teuthology.orchestra.run.smithi129:> sudo apt-get update 2024-09-12T18:10:32.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2024-09-12T18:10:33.140 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:10:33.141 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:10:33.154 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:10:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:10:33.158 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:10:33.163 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:10:33.163 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:10:33.164 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:10:33.175 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:10:33.175 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:10:33.180 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:10:33.192 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:10:33.195 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:10:33.205 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:10:33.210 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:10:33.216 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:10:33.217 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:10:33.226 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:10:33.231 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:10:33.237 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:10:33.239 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:10:33.249 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:10:33.253 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:10:33.259 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:10:33.260 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:10:33.270 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:10:33.273 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:10:33.280 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:10:33.286 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T18:10:33.290 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:10:33.290 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:10:33.300 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:10:33.306 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:10:33.310 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T18:10:33.354 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:10:33.438 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:10:33.480 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 29.3 kB in 0s (89.6 kB/s) 2024-09-12T18:10:33.507 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 29.3 kB in 0s (87.5 kB/s) 2024-09-12T18:10:33.520 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 29.3 kB in 0s (82.6 kB/s) 2024-09-12T18:10:33.655 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 29.3 kB in 0s (60.5 kB/s) 2024-09-12T18:10:34.498 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T18:10:34.498 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T18:10:34.514 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:34.515 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:34.560 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T18:10:34.567 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T18:10:34.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:34.579 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T18:10:34.642 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T18:10:34.693 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T18:10:34.709 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T18:10:34.753 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T18:10:34.754 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T18:10:34.761 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T18:10:34.787 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-09-12T18:10:34.788 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-09-12T18:10:34.854 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T18:10:34.855 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T18:10:34.940 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:10:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:10:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:10:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:10:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:10:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:10:34.941 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:10:34.941 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-12T18:10:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:10:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:10:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:10:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:10:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:10:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:10:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet zip 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:10:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-12T18:10:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-09-12T18:10:34.947 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-09-12T18:10:34.948 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-09-12T18:10:34.978 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:10:34.978 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:10:34.978 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:10:34.978 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:10:34.979 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:10:34.979 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:10:34.979 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:10:34.979 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-09-12T18:10:34.980 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:10:34.981 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:10:34.981 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:10:34.981 INFO:teuthology.orchestra.run.smithi176.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:10:34.981 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:10:34.981 INFO:teuthology.orchestra.run.smithi176.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:10:34.982 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet zip 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:10:34.983 INFO:teuthology.orchestra.run.smithi176.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:10:34.984 INFO:teuthology.orchestra.run.smithi176.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:10:34.984 INFO:teuthology.orchestra.run.smithi176.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:10:34.984 INFO:teuthology.orchestra.run.smithi176.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:10:34.984 INFO:teuthology.orchestra.run.smithi176.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:10:34.984 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2024-09-12T18:10:34.984 INFO:teuthology.orchestra.run.smithi176.stdout: btrfs-tools 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:10:35.047 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:10:35.048 INFO:teuthology.orchestra.run.smithi151.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:10:35.049 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:10:35.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:10:35.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:10:35.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:10:35.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:10:35.050 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:10:35.050 INFO:teuthology.orchestra.run.smithi151.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:10:35.071 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:10:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:10:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:10:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:10:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:10:35.072 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:10:35.072 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:10:35.073 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-12T18:10:35.073 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:10:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:10:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:10:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:10:35.074 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:10:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:10:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:10:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:10:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:10:35.075 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:10:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet zip 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:10:35.077 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-09-12T18:10:35.078 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2024-09-12T18:10:35.086 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-09-12T18:10:35.087 INFO:teuthology.orchestra.run.smithi176.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:10:35.087 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:10:35.087 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:10:35.088 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:10:35.088 INFO:teuthology.orchestra.run.smithi176.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:10:35.088 INFO:teuthology.orchestra.run.smithi176.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:10:35.089 INFO:teuthology.orchestra.run.smithi176.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:10:35.090 INFO:teuthology.orchestra.run.smithi176.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:10:35.132 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:10:35.132 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:10:35.132 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:10:35.132 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:10:35.135 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T18:10:35.136 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:10:35.137 INFO:teuthology.orchestra.run.smithi129.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:10:35.138 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:10:35.138 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet zip 2024-09-12T18:10:35.138 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2024-09-12T18:10:35.138 INFO:teuthology.orchestra.run.smithi129.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:10:35.138 INFO:teuthology.orchestra.run.smithi129.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:10:35.138 INFO:teuthology.orchestra.run.smithi129.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:10:35.139 INFO:teuthology.orchestra.run.smithi129.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:10:35.139 INFO:teuthology.orchestra.run.smithi129.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:10:35.139 INFO:teuthology.orchestra.run.smithi129.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:10:35.139 INFO:teuthology.orchestra.run.smithi129.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:10:35.139 INFO:teuthology.orchestra.run.smithi129.stdout:Recommended packages: 2024-09-12T18:10:35.139 INFO:teuthology.orchestra.run.smithi129.stdout: btrfs-tools 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:10:35.186 INFO:teuthology.orchestra.run.smithi062.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:10:35.188 INFO:teuthology.orchestra.run.smithi062.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:10:35.188 INFO:teuthology.orchestra.run.smithi062.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:10:35.188 INFO:teuthology.orchestra.run.smithi062.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:10:35.188 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:10:35.188 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:10:35.189 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:10:35.190 INFO:teuthology.orchestra.run.smithi062.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:10:35.196 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:10:35.196 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 251 MB of archives. 2024-09-12T18:10:35.196 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:10:35.196 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:10:35.234 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:10:35.234 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 251 MB of archives. 2024-09-12T18:10:35.234 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:10:35.234 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:10:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:10:35.240 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2024-09-12T18:10:35.240 INFO:teuthology.orchestra.run.smithi129.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:10:35.240 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:10:35.241 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:10:35.241 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:10:35.241 INFO:teuthology.orchestra.run.smithi129.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T18:10:35.241 INFO:teuthology.orchestra.run.smithi129.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:10:35.242 INFO:teuthology.orchestra.run.smithi129.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:10:35.242 INFO:teuthology.orchestra.run.smithi129.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:10:35.242 INFO:teuthology.orchestra.run.smithi129.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:10:35.242 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:10:35.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:10:35.244 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:10:35.244 INFO:teuthology.orchestra.run.smithi129.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:10:35.282 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:10:35.335 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:10:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 251 MB of archives. 2024-09-12T18:10:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:10:35.336 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:10:35.378 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:10:35.402 INFO:teuthology.orchestra.run.smithi129.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:10:35.402 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 251 MB of archives. 2024-09-12T18:10:35.402 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T18:10:35.402 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T18:10:35.412 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:10:35.429 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:10:35.452 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:10:35.516 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:10:35.531 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:10:35.558 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:10:35.559 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:10:35.563 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:10:35.565 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:10:35.572 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:10:35.585 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:10:35.600 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:10:35.631 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:10:35.632 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:10:35.637 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:10:35.639 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:10:35.646 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:10:35.662 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:10:35.674 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:10:35.707 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:10:35.719 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:10:35.755 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:10:35.800 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:10:35.830 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:10:35.850 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:10:35.863 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:10:35.876 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:10:35.886 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:10:35.889 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:10:35.899 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:10:35.943 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:10:35.947 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:10:35.983 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:10:35.985 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:10:35.988 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:10:35.994 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:10:35.997 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:10:36.024 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:10:36.030 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:10:36.033 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:10:36.035 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:10:36.036 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:10:36.037 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:10:36.041 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:10:36.054 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:10:36.059 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:10:36.065 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:10:36.071 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:10:36.079 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:10:36.082 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:10:36.083 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:10:36.084 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:10:36.092 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:10:36.101 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:10:36.106 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:10:36.112 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:10:36.144 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:10:36.145 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:10:36.149 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:10:36.152 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:10:36.154 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:10:36.157 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:10:36.158 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:10:36.159 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:10:36.161 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:10:36.162 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:10:36.163 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:10:36.172 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:10:36.183 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:10:36.192 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:10:36.193 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:10:36.196 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:10:36.201 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:10:36.204 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:10:36.205 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:10:36.206 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:10:36.207 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:10:36.208 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:10:36.213 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:10:36.222 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:10:36.224 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:10:36.225 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:10:36.226 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:10:36.227 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:10:36.228 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:10:36.234 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:10:36.244 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:10:36.245 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:10:36.246 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:10:36.248 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:10:36.251 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:10:36.253 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:10:36.255 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:10:36.260 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T18:10:36.276 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:10:36.291 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:10:36.292 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:10:36.293 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:10:36.298 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:10:36.299 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:10:36.309 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:10:36.310 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:10:36.311 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:10:36.314 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:10:36.315 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:10:36.319 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:10:36.324 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:10:36.328 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:10:36.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:10:36.330 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:10:36.331 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:10:36.332 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:10:36.336 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:10:36.336 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:10:36.341 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:10:36.345 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:10:36.348 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:10:36.349 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:10:36.350 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:10:36.352 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:10:36.358 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:10:36.360 INFO:teuthology.orchestra.run.smithi176.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:10:36.389 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:10:36.390 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:10:36.392 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:10:36.394 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:10:36.395 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:10:36.397 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:10:36.406 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:10:36.415 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:10:36.416 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:10:36.416 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:10:36.417 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:10:36.417 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:10:36.423 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:10:36.424 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:10:36.435 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:10:36.436 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:10:36.436 INFO:teuthology.orchestra.run.smithi129.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:10:36.437 INFO:teuthology.orchestra.run.smithi129.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:10:36.439 INFO:teuthology.orchestra.run.smithi176.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:10:36.439 INFO:teuthology.orchestra.run.smithi176.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:10:36.442 INFO:teuthology.orchestra.run.smithi176.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:10:36.442 INFO:teuthology.orchestra.run.smithi129.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:10:36.443 INFO:teuthology.orchestra.run.smithi176.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:10:36.444 INFO:teuthology.orchestra.run.smithi176.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:10:36.455 INFO:teuthology.orchestra.run.smithi176.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:10:36.470 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:10:36.472 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:10:36.472 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:10:36.475 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:10:36.479 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:10:36.480 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:10:36.482 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:10:36.499 INFO:teuthology.orchestra.run.smithi129.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:10:36.500 INFO:teuthology.orchestra.run.smithi129.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:10:36.501 INFO:teuthology.orchestra.run.smithi129.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:10:36.502 INFO:teuthology.orchestra.run.smithi129.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:10:36.520 INFO:teuthology.orchestra.run.smithi176.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:10:36.521 INFO:teuthology.orchestra.run.smithi176.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:10:36.522 INFO:teuthology.orchestra.run.smithi176.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:10:36.525 INFO:teuthology.orchestra.run.smithi176.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:10:36.529 INFO:teuthology.orchestra.run.smithi129.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:10:36.552 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:10:36.553 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:10:36.556 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:10:36.557 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:10:36.560 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:10:36.561 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:10:36.562 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:10:36.563 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:10:36.563 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:10:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:10:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:10:36.576 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:10:36.580 INFO:teuthology.orchestra.run.smithi129.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:10:36.581 INFO:teuthology.orchestra.run.smithi129.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:10:36.583 INFO:teuthology.orchestra.run.smithi129.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:10:36.585 INFO:teuthology.orchestra.run.smithi129.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:10:36.585 INFO:teuthology.orchestra.run.smithi129.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:10:36.602 INFO:teuthology.orchestra.run.smithi176.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:10:36.603 INFO:teuthology.orchestra.run.smithi176.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:10:36.606 INFO:teuthology.orchestra.run.smithi176.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:10:36.607 INFO:teuthology.orchestra.run.smithi176.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:10:36.610 INFO:teuthology.orchestra.run.smithi129.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:10:36.612 INFO:teuthology.orchestra.run.smithi176.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:10:36.613 INFO:teuthology.orchestra.run.smithi176.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:10:36.633 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:10:36.637 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:10:36.641 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:10:36.643 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:10:36.643 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:10:36.646 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:10:36.652 INFO:teuthology.orchestra.run.smithi129.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:10:36.653 INFO:teuthology.orchestra.run.smithi129.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:10:36.662 INFO:teuthology.orchestra.run.smithi129.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:10:36.662 INFO:teuthology.orchestra.run.smithi129.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:10:36.663 INFO:teuthology.orchestra.run.smithi129.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:10:36.664 INFO:teuthology.orchestra.run.smithi129.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:10:36.667 INFO:teuthology.orchestra.run.smithi129.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:10:36.672 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T18:10:36.683 INFO:teuthology.orchestra.run.smithi176.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:10:36.687 INFO:teuthology.orchestra.run.smithi129.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:10:36.688 INFO:teuthology.orchestra.run.smithi176.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:10:36.692 INFO:teuthology.orchestra.run.smithi129.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:10:36.723 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:10:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:10:36.727 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:10:36.729 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:10:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:10:36.734 INFO:teuthology.orchestra.run.smithi129.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:10:36.735 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:10:36.743 INFO:teuthology.orchestra.run.smithi129.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:10:36.744 INFO:teuthology.orchestra.run.smithi129.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:10:36.747 INFO:teuthology.orchestra.run.smithi129.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:10:36.749 INFO:teuthology.orchestra.run.smithi129.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:10:36.753 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T18:10:36.753 INFO:teuthology.orchestra.run.smithi129.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:10:36.761 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T18:10:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T18:10:36.799 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:10:36.799 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T18:10:36.801 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:10:36.801 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T18:10:36.803 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:10:36.804 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:10:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:10:36.806 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:10:36.809 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:10:36.809 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T18:10:36.824 INFO:teuthology.orchestra.run.smithi129.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:10:36.825 INFO:teuthology.orchestra.run.smithi129.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:10:36.830 INFO:teuthology.orchestra.run.smithi129.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:10:36.841 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:10:36.844 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:10:36.845 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:10:36.851 INFO:teuthology.orchestra.run.smithi176.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:10:36.852 INFO:teuthology.orchestra.run.smithi176.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:10:36.855 INFO:teuthology.orchestra.run.smithi176.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:10:36.855 INFO:teuthology.orchestra.run.smithi176.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:10:36.857 INFO:teuthology.orchestra.run.smithi176.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:10:36.889 INFO:teuthology.orchestra.run.smithi176.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:10:36.892 INFO:teuthology.orchestra.run.smithi176.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:10:36.893 INFO:teuthology.orchestra.run.smithi176.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:10:36.903 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:10:36.903 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:10:36.959 INFO:teuthology.orchestra.run.smithi176.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:10:36.959 INFO:teuthology.orchestra.run.smithi176.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:10:36.965 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:10:36.966 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:10:36.967 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:10:36.968 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:10:36.969 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:10:36.970 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:10:36.972 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:10:36.973 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:10:36.976 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:10:36.977 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:10:36.977 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:10:36.979 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:10:36.993 INFO:teuthology.orchestra.run.smithi129.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:10:36.995 INFO:teuthology.orchestra.run.smithi129.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:10:36.998 INFO:teuthology.orchestra.run.smithi129.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:10:36.998 INFO:teuthology.orchestra.run.smithi129.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:10:37.001 INFO:teuthology.orchestra.run.smithi129.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:10:37.015 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:10:37.017 INFO:teuthology.orchestra.run.smithi176.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:10:37.018 INFO:teuthology.orchestra.run.smithi176.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:10:37.019 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:10:37.019 INFO:teuthology.orchestra.run.smithi176.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:10:37.019 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:10:37.020 INFO:teuthology.orchestra.run.smithi176.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:10:37.021 INFO:teuthology.orchestra.run.smithi176.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:10:37.022 INFO:teuthology.orchestra.run.smithi176.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:10:37.029 INFO:teuthology.orchestra.run.smithi176.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:10:37.037 INFO:teuthology.orchestra.run.smithi129.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:10:37.040 INFO:teuthology.orchestra.run.smithi129.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:10:37.041 INFO:teuthology.orchestra.run.smithi129.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:10:37.046 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:10:37.052 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:10:37.052 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:10:37.076 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:10:37.077 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:10:37.098 INFO:teuthology.orchestra.run.smithi129.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:10:37.098 INFO:teuthology.orchestra.run.smithi129.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:10:37.099 INFO:teuthology.orchestra.run.smithi176.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:10:37.102 INFO:teuthology.orchestra.run.smithi176.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:10:37.104 INFO:teuthology.orchestra.run.smithi176.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:10:37.128 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:10:37.138 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:10:37.139 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:10:37.139 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:10:37.141 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:10:37.141 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:10:37.143 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:10:37.150 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:10:37.160 INFO:teuthology.orchestra.run.smithi129.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:10:37.161 INFO:teuthology.orchestra.run.smithi129.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:10:37.161 INFO:teuthology.orchestra.run.smithi129.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:10:37.162 INFO:teuthology.orchestra.run.smithi129.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:10:37.163 INFO:teuthology.orchestra.run.smithi129.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:10:37.164 INFO:teuthology.orchestra.run.smithi129.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:10:37.171 INFO:teuthology.orchestra.run.smithi129.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:10:37.180 INFO:teuthology.orchestra.run.smithi176.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:10:37.186 INFO:teuthology.orchestra.run.smithi176.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:10:37.189 INFO:teuthology.orchestra.run.smithi176.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:10:37.190 INFO:teuthology.orchestra.run.smithi176.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:10:37.201 INFO:teuthology.orchestra.run.smithi176.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:10:37.203 INFO:teuthology.orchestra.run.smithi176.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:10:37.205 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:10:37.207 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:10:37.211 INFO:teuthology.orchestra.run.smithi176.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:10:37.219 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:10:37.222 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:10:37.224 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:10:37.241 INFO:teuthology.orchestra.run.smithi129.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:10:37.244 INFO:teuthology.orchestra.run.smithi129.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:10:37.246 INFO:teuthology.orchestra.run.smithi129.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:10:37.262 INFO:teuthology.orchestra.run.smithi176.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:10:37.263 INFO:teuthology.orchestra.run.smithi176.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:10:37.264 INFO:teuthology.orchestra.run.smithi176.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:10:37.278 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:10:37.279 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:10:37.289 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:10:37.290 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:10:37.298 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:10:37.298 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:10:37.300 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:10:37.300 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:10:37.301 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:10:37.304 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:10:37.307 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:10:37.309 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:10:37.310 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:10:37.321 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:10:37.322 INFO:teuthology.orchestra.run.smithi129.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:10:37.323 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:10:37.329 INFO:teuthology.orchestra.run.smithi129.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:10:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:10:37.331 INFO:teuthology.orchestra.run.smithi129.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:10:37.332 INFO:teuthology.orchestra.run.smithi129.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi129.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:10:37.343 INFO:teuthology.orchestra.run.smithi176.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:10:37.344 INFO:teuthology.orchestra.run.smithi129.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:10:37.345 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:10:37.348 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:10:37.352 INFO:teuthology.orchestra.run.smithi129.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:10:37.371 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:10:37.376 INFO:teuthology.orchestra.run.smithi176.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:10:37.382 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:10:37.383 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:10:37.384 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:10:37.385 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:10:37.388 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:10:37.407 INFO:teuthology.orchestra.run.smithi129.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:10:37.409 INFO:teuthology.orchestra.run.smithi129.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:10:37.409 INFO:teuthology.orchestra.run.smithi129.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:10:37.432 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:10:37.437 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:10:37.440 INFO:teuthology.orchestra.run.smithi176.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:10:37.441 INFO:teuthology.orchestra.run.smithi176.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:10:37.441 INFO:teuthology.orchestra.run.smithi176.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:10:37.441 INFO:teuthology.orchestra.run.smithi176.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:10:37.446 INFO:teuthology.orchestra.run.smithi176.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:10:37.448 INFO:teuthology.orchestra.run.smithi176.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:10:37.452 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:10:37.453 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:10:37.458 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:10:37.458 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:10:37.459 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:10:37.463 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:10:37.465 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:10:37.483 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:10:37.484 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:10:37.485 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:10:37.490 INFO:teuthology.orchestra.run.smithi129.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:10:37.490 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:10:37.492 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:10:37.492 INFO:teuthology.orchestra.run.smithi129.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:10:37.509 INFO:teuthology.orchestra.run.smithi129.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:10:37.510 INFO:teuthology.orchestra.run.smithi129.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:10:37.510 INFO:teuthology.orchestra.run.smithi129.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:10:37.515 INFO:teuthology.orchestra.run.smithi129.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:10:37.517 INFO:teuthology.orchestra.run.smithi129.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:10:37.527 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:10:37.631 INFO:teuthology.orchestra.run.smithi176.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:10:37.678 INFO:teuthology.orchestra.run.smithi176.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:10:37.681 INFO:teuthology.orchestra.run.smithi176.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:10:37.726 INFO:teuthology.orchestra.run.smithi129.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T18:10:37.729 INFO:teuthology.orchestra.run.smithi129.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T18:10:37.755 INFO:teuthology.orchestra.run.smithi176.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:10:37.794 INFO:teuthology.orchestra.run.smithi129.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T18:10:37.876 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:10:38.122 INFO:teuthology.orchestra.run.smithi176.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:10:38.877 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:10:39.076 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:10:39.081 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:10:39.084 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:10:39.155 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:10:39.452 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:10:39.459 INFO:teuthology.orchestra.run.smithi176.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:10:39.460 INFO:teuthology.orchestra.run.smithi176.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:10:39.477 INFO:teuthology.orchestra.run.smithi176.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:10:39.492 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:10:39.493 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:10:39.510 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:10:39.539 INFO:teuthology.orchestra.run.smithi176.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:10:39.569 INFO:teuthology.orchestra.run.smithi176.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:10:39.572 INFO:teuthology.orchestra.run.smithi176.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:10:39.664 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:10:39.735 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:10:39.738 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:10:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:10:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:10:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:10:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:10:40.842 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:10:40.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:10:42.199 INFO:teuthology.orchestra.run.smithi129.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T18:10:42.941 INFO:teuthology.orchestra.run.smithi129.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T18:10:42.977 INFO:teuthology.orchestra.run.smithi129.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T18:10:42.984 INFO:teuthology.orchestra.run.smithi176.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:10:42.993 INFO:teuthology.orchestra.run.smithi129.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T18:10:43.232 INFO:teuthology.orchestra.run.smithi129.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T18:10:43.268 INFO:teuthology.orchestra.run.smithi176.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:10:43.269 INFO:teuthology.orchestra.run.smithi176.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:10:43.795 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:10:44.132 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:10:44.132 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:10:44.194 INFO:teuthology.orchestra.run.smithi129.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T18:10:44.249 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:10:44.538 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:10:44.539 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:10:46.308 INFO:teuthology.orchestra.run.smithi176.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:10:46.311 INFO:teuthology.orchestra.run.smithi176.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:10:46.375 INFO:teuthology.orchestra.run.smithi176.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:10:47.090 INFO:teuthology.orchestra.run.smithi176.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:10:47.515 INFO:teuthology.orchestra.run.smithi062.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:10:47.517 INFO:teuthology.orchestra.run.smithi062.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:10:47.519 INFO:teuthology.orchestra.run.smithi062.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:10:47.587 INFO:teuthology.orchestra.run.smithi129.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T18:10:47.587 INFO:teuthology.orchestra.run.smithi129.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T18:10:47.597 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:10:47.600 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:10:47.601 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:10:47.604 INFO:teuthology.orchestra.run.smithi129.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T18:10:47.672 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 251 MB in 12s (20.9 MB/s) 2024-09-12T18:10:47.834 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:10:47.846 INFO:teuthology.orchestra.run.smithi129.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T18:10:47.916 INFO:teuthology.orchestra.run.smithi129.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T18:10:47.920 INFO:teuthology.orchestra.run.smithi129.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T18:10:47.928 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:10:47.934 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:10:47.968 INFO:teuthology.orchestra.run.smithi062.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:10:48.024 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:10:48.128 INFO:teuthology.orchestra.run.smithi151.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:10:48.327 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:10:48.354 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:10:48.403 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:10:48.562 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 251 MB in 13s (19.7 MB/s) 2024-09-12T18:10:48.714 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:10:48.723 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 251 MB in 13s (19.2 MB/s) 2024-09-12T18:10:48.729 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:10:48.740 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:10:48.780 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:10:48.826 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:10:48.832 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:10:48.889 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:10:48.916 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:10:48.988 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:10:48.993 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:10:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:10:49.226 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:10:49.236 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:10:49.253 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:49.263 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:10:49.301 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:49.302 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:10:49.409 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:10:49.436 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:10:49.475 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:10:49.605 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:10:49.632 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:10:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:10:49.672 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:10:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:49.712 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:49.804 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:10:49.830 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:10:49.862 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:10:50.032 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:10:50.042 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:10:50.059 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:50.069 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:50.098 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:50.108 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:50.301 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:10:50.327 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:50.375 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:50.409 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:10:50.424 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:10:50.459 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:10:50.546 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:10:50.572 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:50.612 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:50.721 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librados2. 2024-09-12T18:10:50.736 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:50.762 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:10:50.770 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:50.788 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:50.829 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:50.878 INFO:teuthology.orchestra.run.smithi129.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T18:10:50.956 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:10:50.983 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:51.023 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:51.114 INFO:teuthology.orchestra.run.smithi129.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T18:10:51.115 INFO:teuthology.orchestra.run.smithi129.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T18:10:51.158 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:10:51.184 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:51.225 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:51.249 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:10:51.275 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:10:51.315 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:10:51.384 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:10:51.411 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:10:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:10:51.578 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:10:51.601 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:10:51.604 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:10:51.627 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:51.645 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:10:51.668 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:51.779 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2024-09-12T18:10:51.806 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:51.915 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-09-12T18:10:51.942 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:51.956 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:51.982 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:52.079 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:10:52.105 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:52.146 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:52.431 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:10:52.458 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:10:52.485 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:10:52.498 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:10:52.511 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:10:52.552 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:10:52.616 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:10:52.641 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:52.681 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:52.784 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:10:52.814 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:52.822 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:10:52.848 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:52.850 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:52.880 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:52.992 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:10:53.019 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:10:53.059 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:53.287 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:10:53.302 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:10:53.303 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:53.309 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:10:53.319 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:53.335 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:53.337 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:53.361 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:53.374 INFO:teuthology.orchestra.run.smithi129.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T18:10:53.376 INFO:teuthology.orchestra.run.smithi129.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T18:10:53.377 INFO:teuthology.orchestra.run.smithi129.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T18:10:53.400 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:53.622 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:10:53.640 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:53.655 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:10:53.681 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:53.681 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:10:53.722 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:53.876 INFO:teuthology.orchestra.run.smithi129.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T18:10:53.887 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:10:53.913 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:53.954 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.000 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:10:54.027 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:10:54.050 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:10:54.066 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.076 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:10:54.117 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:10:54.249 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:10:54.275 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:10:54.307 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.327 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:10:54.354 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:54.402 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.419 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:10:54.445 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:10:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 251 MB in 19s (13.5 MB/s) 2024-09-12T18:10:54.486 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:10:54.535 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:10:54.550 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:54.593 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:10:54.593 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.680 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:10:54.692 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:10:54.696 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:10:54.697 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:10:54.722 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:10:54.730 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.737 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:54.766 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:10:54.780 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:54.905 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:10:54.928 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:10:54.971 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:55.054 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:10:55.058 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:10:55.080 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:10:55.084 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:10:55.120 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:10:55.124 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:10:55.125 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:10:55.151 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:10:55.191 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:10:55.309 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:10:55.335 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:10:55.375 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:10:55.410 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:10:55.437 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:10:55.477 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:10:55.478 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:10:55.503 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:10:55.506 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:10:55.533 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:10:55.543 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:10:55.581 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:10:55.671 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:10:55.697 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:10:55.705 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:10:55.721 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:55.737 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:10:55.763 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:55.855 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:10:55.881 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:10:55.913 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:10:55.982 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:10:56.008 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:56.049 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:56.110 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:10:56.116 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:10:56.137 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:56.142 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:10:56.182 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:10:56.194 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:56.216 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:10:56.243 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:10:56.283 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:10:56.394 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:10:56.420 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:10:56.451 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:10:56.504 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:10:56.505 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:10:56.505 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:10:56.611 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:10:56.637 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:10:56.638 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:10:56.665 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:56.677 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:10:56.713 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:56.714 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:10:56.729 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:10:56.772 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:10:56.804 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:10:56.831 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:10:56.871 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:10:56.930 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package zip. 2024-09-12T18:10:56.956 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:10:56.997 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:10:57.101 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:10:57.117 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:10:57.127 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:10:57.143 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:10:57.167 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:10:57.183 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:10:57.199 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:10:57.226 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:10:57.267 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package unzip. 2024-09-12T18:10:57.282 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:10:57.293 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:10:57.333 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:10:57.463 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:10:57.478 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:10:57.513 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:10:57.528 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:10:57.555 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:10:57.595 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:10:57.602 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:10:57.629 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:10:57.668 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:10:57.731 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:10:57.757 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:10:57.825 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:10:57.840 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:10:57.879 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package zip. 2024-09-12T18:10:57.881 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librados2. 2024-09-12T18:10:57.883 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:10:57.895 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:10:57.896 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:57.930 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:10:57.932 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:10:57.939 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:58.136 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-09-12T18:10:58.163 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:10:58.203 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:10:58.241 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package unzip. 2024-09-12T18:10:58.267 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:10:58.304 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:10:58.307 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:10:58.331 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:58.371 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:58.426 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libnbd0. 2024-09-12T18:10:58.452 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T18:10:58.474 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-09-12T18:10:58.489 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:10:58.492 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T18:10:58.524 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:10:58.703 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:10:58.729 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:10:58.778 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:10:58.804 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:10:58.830 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:58.870 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:58.920 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:10:58.946 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:10:58.948 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:10:58.963 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:58.998 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:59.110 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:10:59.137 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:10:59.137 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:59.176 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:59.326 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:10:59.352 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:10:59.393 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:10:59.415 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:10:59.441 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:59.482 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:59.530 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:10:59.556 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:59.588 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:59.704 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:10:59.730 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:59.759 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:10:59.770 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:59.774 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:59.818 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:10:59.821 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:10:59.847 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:10:59.887 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.137 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:11:00.153 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:00.182 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:11:00.195 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.209 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:00.216 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:11:00.231 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:00.232 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:11:00.240 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.258 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:11:00.274 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.298 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:00.440 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:11:00.455 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:00.490 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.576 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:11:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.636 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:11:00.663 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:11:00.720 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:00.776 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:11:00.802 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:00.843 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:00.990 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:11:01.016 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:01.048 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:01.054 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:11:01.081 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:01.120 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:01.187 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:11:01.214 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:11:01.254 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:11:01.477 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:11:01.504 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:01.544 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:01.590 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:11:01.618 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:11:01.657 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:11:01.712 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:11:01.742 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:01.791 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:11:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:01.929 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:02.273 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:11:02.299 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:11:02.339 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:11:02.383 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:11:02.410 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:11:02.449 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:02.600 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:11:02.628 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:11:02.666 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:11:02.752 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:11:02.779 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:11:02.818 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:02.884 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:11:02.911 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:02.960 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:02.969 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:11:02.985 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:11:03.001 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:11:03.019 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:11:03.027 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:03.068 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:03.305 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:11:03.331 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:11:03.331 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:11:03.357 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:11:03.371 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:03.397 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:11:03.546 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:11:03.573 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:11:03.613 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:03.630 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:11:03.649 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:11:03.657 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:11:03.675 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:11:03.688 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:03.707 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:03.709 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:11:03.735 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:11:03.775 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:11:03.915 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:11:03.942 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:11:03.977 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:11:03.982 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:11:04.003 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package zip. 2024-09-12T18:11:04.003 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:11:04.018 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:11:04.027 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:11:04.043 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:11:04.061 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:11:04.067 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:04.302 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:11:04.314 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package unzip. 2024-09-12T18:11:04.328 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:11:04.329 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:11:04.346 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:11:04.364 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:11:04.368 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:04.373 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:11:04.412 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:11:04.588 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:11:04.614 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:11:04.654 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:04.672 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:11:04.698 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:11:04.729 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:04.749 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:11:04.775 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:11:04.815 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:11:04.893 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:11:04.919 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:11:04.924 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:11:04.940 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:11:04.968 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:11:04.974 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:04.990 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:11:05.017 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:11:05.057 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:11:05.151 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:11:05.177 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:11:05.226 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:11:05.278 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:11:05.304 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:11:05.334 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:11:05.344 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:11:05.359 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:11:05.360 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:05.386 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:11:05.400 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:05.451 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:11:05.596 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:11:05.622 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:11:05.648 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:11:05.670 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:11:05.674 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:11:05.714 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:11:05.762 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:11:05.789 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:11:05.829 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:11:05.993 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:11:06.011 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:11:06.016 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:11:06.019 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:11:06.026 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:06.042 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:11:06.060 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:11:06.069 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:06.073 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:11:06.082 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:11:06.089 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:11:06.123 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:11:06.347 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:11:06.347 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:11:06.373 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:11:06.373 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:11:06.401 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:11:06.405 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:06.413 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:11:06.428 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:11:06.452 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:11:06.467 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:11:06.478 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:11:06.708 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:11:06.717 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:11:06.734 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:06.743 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:11:06.775 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:06.783 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:11:06.829 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:11:06.856 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:11:06.896 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:11:06.977 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:11:07.129 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:11:07.156 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:11:07.190 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:11:07.196 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:11:07.212 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:11:07.217 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:11:07.238 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:07.257 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:11:07.278 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:07.547 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:11:07.560 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:11:07.573 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:11:07.587 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:11:07.613 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:07.626 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:07.916 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:11:07.929 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:11:07.943 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:11:07.956 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:11:07.982 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:11:07.995 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:11:08.294 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:11:08.317 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:11:08.321 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:11:08.324 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:11:08.344 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:11:08.351 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:11:08.352 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:11:08.384 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:11:08.390 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:11:08.622 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:11:08.648 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:11:08.651 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:11:08.678 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:11:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:11:08.688 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:11:08.709 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:11:08.713 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:11:08.754 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:08.987 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:11:09.008 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:11:09.014 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:11:09.034 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:11:09.054 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:11:09.057 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:11:09.074 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:11:09.083 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:11:09.126 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:11:09.407 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:11:09.427 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:11:09.433 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:11:09.446 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:11:09.450 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:11:09.453 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:11:09.473 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:11:09.477 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:09.493 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:09.505 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:09.513 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:11:09.526 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:09.788 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:11:09.815 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:11:09.818 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:11:09.843 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:11:09.845 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:11:09.846 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:09.883 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:11:09.884 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:10.141 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:11:10.168 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:11:10.170 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:11:10.170 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:11:10.196 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:11:10.200 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:11:10.208 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:10.236 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:11:10.245 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:10.255 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:11:10.281 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:11:10.321 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:10.510 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:11:10.526 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:11:10.557 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:11:10.560 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:10.565 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:11:10.583 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:11:10.592 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:11:10.599 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:11:10.625 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:11:10.627 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:10.631 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:10.657 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:10.838 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:11:10.864 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:11:10.884 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:11:10.900 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:11:10.904 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:11:10.911 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:11:10.934 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:11:10.937 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:11:10.960 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:11:10.977 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:10.986 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:11:11.027 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:11.179 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:11:11.206 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:11:11.209 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:11:11.234 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:11:11.245 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:11:11.274 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:11:11.297 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:11:11.324 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:11:11.329 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:11:11.356 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:11:11.364 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:11.396 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:11.565 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:11:11.585 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:11:11.592 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:11:11.612 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:11:11.631 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:11:11.652 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:11:11.693 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:11:11.699 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:11:11.719 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:11:11.725 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:11:11.768 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:11.790 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:11:12.003 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:11:12.030 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:11:12.032 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:11:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:11:12.058 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:11:12.068 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:11:12.069 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:12.081 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:11:12.095 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:11:12.098 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:12.121 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:11:12.135 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:11:12.391 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:11:12.401 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:11:12.404 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:11:12.405 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:11:12.416 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:11:12.418 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:11:12.431 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:11:12.432 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:11:12.450 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:11:12.460 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:11:12.471 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:11:12.472 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:11:12.741 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:11:12.753 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:11:12.765 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:11:12.774 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:11:12.778 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:11:12.780 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:11:12.800 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:11:12.800 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:11:12.805 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:11:12.820 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:11:12.840 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:11:12.845 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:11:13.143 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:11:13.170 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:11:13.184 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:11:13.190 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:11:13.209 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:11:13.211 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:11:13.217 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:11:13.251 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:13.257 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:11:13.269 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:11:13.296 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:11:13.336 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:11:13.554 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:11:13.555 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:11:13.569 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:11:13.581 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:11:13.604 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:11:13.621 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:11:13.656 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:11:13.683 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:11:13.709 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:11:13.722 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:13.736 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:11:13.775 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:13.883 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:11:13.909 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:11:13.924 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:11:13.949 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:11:13.951 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:11:13.991 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:11:14.017 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:11:14.044 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:14.062 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:11:14.083 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:14.089 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:14.128 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:14.278 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:11:14.302 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:11:14.305 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:11:14.329 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:11:14.345 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:11:14.369 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:14.488 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:11:14.500 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:11:14.515 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:14.527 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:14.554 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:14.566 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:14.605 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:11:14.620 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:11:14.655 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:11:14.656 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:11:14.680 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:11:14.723 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:14.874 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:11:14.886 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:11:14.901 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:11:14.912 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:11:14.940 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:14.952 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:14.958 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:11:14.985 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:11:15.024 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:11:15.052 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:11:15.067 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:15.110 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:15.238 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:11:15.243 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:11:15.265 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:11:15.270 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:11:15.305 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:11:15.309 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:11:15.386 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:11:15.412 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:11:15.453 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:11:15.491 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:11:15.518 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:15.558 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:15.599 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:11:15.604 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:11:15.620 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:15.626 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:15.654 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:15.657 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:15.755 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:11:15.782 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:11:15.822 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:11:15.878 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:11:15.905 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:11:15.945 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:16.061 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:11:16.082 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:11:16.088 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:16.109 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:16.127 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:16.148 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:16.158 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:11:16.185 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:11:16.215 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:11:16.227 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:16.230 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:11:16.265 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:11:16.511 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:11:16.526 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:11:16.561 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:16.610 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:11:16.637 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:16.677 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:16.730 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:11:16.758 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:16.777 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:11:16.797 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:16.804 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:16.843 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:16.847 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:11:16.873 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:11:16.913 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:17.081 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:11:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:17.147 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:17.225 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:11:17.240 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:11:17.275 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:17.553 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:11:17.579 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:11:17.619 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:11:17.768 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:11:17.795 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:17.833 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph. 2024-09-12T18:11:17.834 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:17.849 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:17.883 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:17.922 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:11:17.937 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:11:17.980 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:11:17.988 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2024-09-12T18:11:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:18.038 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:18.169 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:11:18.196 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:18.235 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:18.292 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:11:18.318 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:11:18.324 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:11:18.351 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:18.358 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:11:18.390 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:18.605 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:11:18.632 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:18.672 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:18.746 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:11:18.773 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:11:18.777 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:11:18.804 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:18.813 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:18.843 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:18.939 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-09-12T18:11:18.965 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:19.005 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:19.166 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:11:19.191 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:11:19.192 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:11:19.218 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:19.224 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:11:19.246 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:11:19.258 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:19.273 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:19.275 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:11:19.302 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:19.312 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:19.333 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:19.510 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:11:19.527 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:11:19.536 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:11:19.554 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:11:19.576 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:11:19.585 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:19.608 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:11:19.623 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:11:19.657 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:19.712 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:11:19.739 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:19.779 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:19.896 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:11:19.904 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:11:19.912 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:11:19.920 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:19.955 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:11:19.962 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:19.976 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:11:19.992 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:20.034 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:20.249 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:11:20.276 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:11:20.316 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:20.357 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:11:20.384 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:20.426 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:20.694 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:11:20.718 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:11:20.720 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:11:20.734 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:20.761 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:20.777 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:20.951 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:11:20.978 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:21.017 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:21.047 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:11:21.063 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:11:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:21.102 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:21.141 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:21.157 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:11:21.184 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:21.223 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:21.345 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:11:21.372 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:11:21.412 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:11:21.477 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:11:21.492 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:11:21.504 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:11:21.508 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:11:21.542 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:21.543 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:11:21.757 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:11:21.784 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:21.821 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:11:21.823 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:21.847 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:11:21.895 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:11:21.922 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:11:21.949 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:21.988 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:22.145 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:11:22.168 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:11:22.172 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:22.195 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:11:22.212 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:22.223 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:11:22.234 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:22.250 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:22.290 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:22.342 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:11:22.369 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:11:22.408 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:22.520 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:11:22.533 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:11:22.536 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:11:22.578 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:22.590 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:11:22.702 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:11:22.711 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:11:22.728 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:22.738 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:11:22.768 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:22.777 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:22.920 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:11:22.932 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:11:22.946 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:22.959 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:22.986 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:22.998 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:23.122 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:11:23.150 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:23.188 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:23.332 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:11:23.346 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:11:23.359 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:11:23.373 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:23.398 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:23.413 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:23.710 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:11:23.737 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:11:23.777 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:24.114 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:11:24.141 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:24.180 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:24.491 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph. 2024-09-12T18:11:24.506 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:24.574 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:24.885 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:11:24.912 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:24.951 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:25.288 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:11:25.303 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:25.340 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:25.708 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:11:25.734 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:25.774 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:25.777 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:11:25.795 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:11:25.836 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:26.110 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:11:26.137 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:11:26.176 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:26.201 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:11:26.219 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:11:26.251 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:26.331 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:11:26.358 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:11:26.389 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:26.479 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:11:26.506 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:26.546 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:26.705 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:11:26.733 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:11:26.734 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:11:26.761 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:11:26.771 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:26.800 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:26.889 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:11:26.906 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:11:26.947 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:27.100 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:11:27.103 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:11:27.116 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:11:27.130 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:11:27.149 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:27.263 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:11:27.418 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:11:27.446 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:11:27.476 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:27.589 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:11:27.616 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:11:27.676 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:11:27.703 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:11:27.751 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:27.754 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:11:27.997 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:11:28.025 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:11:28.055 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:28.064 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:11:28.092 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:28.095 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:11:28.122 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:11:28.130 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:28.162 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:11:28.342 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:11:28.370 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:11:28.480 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:11:28.481 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:11:28.508 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:28.509 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:28.511 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:11:28.546 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:28.548 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:28.901 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:11:28.928 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:11:28.967 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:29.265 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:11:29.270 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:11:29.293 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:29.297 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:11:29.309 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:11:29.331 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:29.336 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:11:29.345 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:29.375 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:29.550 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:11:29.578 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:11:29.616 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:29.636 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:11:29.664 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:11:29.702 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:11:29.707 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:11:29.734 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:29.773 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:29.894 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:11:29.922 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:11:29.960 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:11:30.031 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:11:30.059 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:11:30.097 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:11:30.272 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:11:30.300 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:11:30.330 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:11:30.392 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:11:30.420 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:11:30.458 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:11:30.502 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:11:30.530 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:11:30.568 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:30.599 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:11:30.628 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:11:30.658 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:11:30.804 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:11:30.831 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:11:30.847 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:11:30.872 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:11:30.875 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:11:30.914 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:11:30.978 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:11:31.006 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:11:31.044 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:11:31.199 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:11:31.226 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:11:31.226 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:11:31.254 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:11:31.265 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:11:31.292 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:11:31.389 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:11:31.417 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:11:31.455 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:11:31.559 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:11:31.575 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:11:31.609 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:11:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:11:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:11:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:11:31.817 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:11:31.845 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:11:31.883 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:11:31.904 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:11:31.932 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:11:31.970 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:11:31.984 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:11:32.012 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:11:32.051 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:11:32.203 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:11:32.234 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:11:32.269 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:11:32.372 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:11:32.400 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:11:32.438 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:11:32.634 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:11:32.663 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:32.701 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:32.720 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:11:32.749 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:11:32.750 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:11:32.778 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:11:32.795 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:32.825 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:11:32.908 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:11:32.926 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:32.966 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:33.020 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:11:33.048 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:11:33.086 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:11:33.121 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:11:33.149 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:11:33.187 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:11:33.286 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:11:33.314 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:11:33.324 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:11:33.351 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:11:33.352 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:11:33.390 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:33.431 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:11:33.459 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:33.498 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:11:33.697 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:11:33.710 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:11:33.725 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:33.726 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:11:33.751 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package jq. 2024-09-12T18:11:33.763 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:11:33.767 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:33.779 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:33.817 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:11:33.836 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:11:33.864 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:33.902 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:33.991 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2024-09-12T18:11:34.008 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:34.044 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package socat. 2024-09-12T18:11:34.049 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:11:34.071 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:11:34.072 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:11:34.098 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:11:34.102 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:34.222 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:11:34.231 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:11:34.250 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:11:34.289 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:11:34.327 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2024-09-12T18:11:34.356 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:11:34.393 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:34.397 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:11:34.426 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:11:34.464 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:11:34.576 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:11:34.592 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:34.626 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:11:34.713 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:11:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:11:34.771 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:11:34.793 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:11:34.810 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:34.843 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:34.888 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-09-12T18:11:34.904 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:34.946 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:11:34.982 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:11:35.010 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:35.048 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:35.134 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:11:35.163 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:35.200 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:35.216 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-09-12T18:11:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:11:35.283 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:35.586 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:11:35.603 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:11:35.645 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:11:36.001 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:11:36.008 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:11:36.025 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:36.029 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:11:36.066 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:36.068 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:36.371 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:11:36.400 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:11:36.437 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:11:36.766 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:11:36.793 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:11:36.849 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:11:37.143 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:11:37.171 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:11:37.210 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:11:37.289 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:11:37.317 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:37.355 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:37.514 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:11:37.541 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:11:37.580 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:11:37.643 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:11:37.671 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:37.710 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:37.797 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:11:37.826 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:37.858 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:11:37.863 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:37.875 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:11:37.908 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:11:38.012 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:11:38.040 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:11:38.079 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:38.142 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:11:38.159 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:38.211 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:11:38.225 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:38.241 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:11:38.278 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:11:38.425 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:11:38.453 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:11:38.491 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:11:38.536 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:11:38.565 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:11:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:38.606 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:11:38.631 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:11:38.633 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:11:38.659 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:38.672 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:11:38.697 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:38.795 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:11:38.823 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:11:38.853 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:38.940 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:11:38.969 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:11:38.993 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:11:39.006 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:11:39.010 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:39.052 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:39.302 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:11:39.331 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:11:39.344 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:11:39.347 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:11:39.353 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:11:39.368 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:39.373 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:39.375 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:11:39.381 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:11:39.411 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:39.413 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:39.509 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:11:39.711 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:11:39.713 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:11:39.730 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:11:39.739 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:11:39.763 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:11:39.769 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:11:39.774 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:11:39.787 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:11:39.803 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:11:39.812 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:11:39.840 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:11:39.854 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:40.092 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:11:40.101 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:11:40.119 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:11:40.119 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:40.141 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:11:40.158 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:11:40.159 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:40.168 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:11:40.207 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:40.273 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:11:40.302 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:11:40.340 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:40.444 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package jq. 2024-09-12T18:11:40.472 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:11:40.510 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:11:40.579 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:11:40.608 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:11:40.630 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:11:40.643 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:11:40.646 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:40.659 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:11:40.671 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:11:40.709 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:11:40.748 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package socat. 2024-09-12T18:11:40.765 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:11:40.798 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:40.933 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:11:40.948 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:11:40.950 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:11:40.977 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:11:40.991 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:11:41.015 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:11:41.032 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:11:41.077 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:11:41.094 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:11:41.126 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:11:41.340 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:11:41.352 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:11:41.368 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:11:41.380 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:11:41.387 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:11:41.406 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:41.416 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:11:41.418 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:11:41.453 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:41.672 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:11:41.687 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:11:41.689 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:41.716 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:11:41.730 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:41.743 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:11:41.745 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:41.757 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:11:41.771 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:11:41.785 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:11:41.823 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:11:41.831 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:11:42.074 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:11:42.102 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:11:42.140 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:11:42.144 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:11:42.162 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:11:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:11:42.191 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:11:42.211 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:11:42.229 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:42.418 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:11:42.435 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:11:42.468 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:42.481 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:11:42.510 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:11:42.548 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:42.633 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:11:42.661 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:11:42.699 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:42.902 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:11:42.913 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:11:42.930 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:11:42.941 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:11:42.968 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:11:42.980 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:43.010 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:11:43.038 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:11:43.076 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:11:43.264 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:11:43.283 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:11:43.293 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:11:43.305 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:11:43.330 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:43.358 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:11:43.363 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:11:43.391 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:11:43.429 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:11:43.627 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:11:43.656 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:11:43.686 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:11:43.783 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:11:43.810 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:11:43.811 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:11:43.839 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:11:43.849 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:43.877 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:44.014 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:11:44.042 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:11:44.080 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:44.127 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:11:44.155 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:11:44.181 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:11:44.193 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:44.209 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:11:44.239 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:11:44.293 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:11:44.322 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:11:44.351 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:44.357 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:11:44.374 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:11:44.415 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:44.534 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:11:44.562 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:11:44.600 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:11:44.655 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:11:44.672 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:44.713 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:44.922 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:11:44.930 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:11:44.950 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:44.957 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:11:44.988 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:44.998 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:44.999 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:11:45.016 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:11:45.049 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:45.103 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:11:45.132 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:45.161 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:45.276 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:11:45.305 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:11:45.334 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:45.362 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:11:45.390 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:11:45.428 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:11:45.816 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:11:45.844 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:11:45.882 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:45.924 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:11:45.940 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:45.974 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:46.089 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:11:46.114 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:46.155 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:46.231 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:46.288 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:11:46.312 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:11:46.316 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:46.341 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:11:46.354 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:46.378 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:11:46.479 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:11:46.486 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:46.648 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:11:46.665 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:11:46.706 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:11:46.864 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:11:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:47.140 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:11:47.143 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:11:47.171 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:11:47.197 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:11:47.209 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:47.307 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:11:47.336 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:47.373 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:47.470 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:11:47.487 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:11:47.499 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:11:47.528 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:11:47.638 INFO:teuthology.orchestra.run.smithi176.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:11:47.669 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:47.706 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:47.857 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:11:47.885 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:11:47.911 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:11:47.923 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:11:47.932 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:11:48.005 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:48.037 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:48.234 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:11:48.257 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user cephadm....done 2024-09-12T18:11:48.263 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:11:48.278 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:11:48.301 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:48.412 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:48.596 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:11:48.629 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:11:48.657 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:11:48.695 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:11:48.697 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:48.805 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2024-09-12T18:11:48.953 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:48.965 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:49.019 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:11:49.032 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:11:49.060 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:11:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:49.082 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:49.098 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:49.246 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:49.317 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:49.489 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:49.569 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:11:49.580 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-09-12T18:11:49.590 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:49.597 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:11:49.635 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:11:49.694 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:49.849 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:49.946 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:11:49.954 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:49.975 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:11:49.987 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:50.012 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:11:50.109 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:50.188 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:50.235 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:11:50.299 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:11:50.314 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:50.327 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:11:50.357 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:11:50.381 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:50.545 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:50.565 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:50.665 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:11:50.694 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:11:50.722 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:11:50.760 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:50.825 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:50.916 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:11:50.930 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:50.951 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:11:51.038 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:11:51.066 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:11:51.104 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:51.160 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:51.173 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:11:51.411 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:51.436 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:51.440 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:11:51.695 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:51.763 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:51.833 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:11:51.861 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:51.899 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:51.954 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:51.997 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:11:52.025 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:52.214 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:52.265 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:11:52.356 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:11:52.402 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:52.482 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:52.558 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:52.583 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:11:52.661 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:52.684 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:52.818 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:52.827 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:11:52.844 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:11:52.886 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:52.912 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:52.960 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:11:53.077 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:53.171 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:53.174 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:11:53.272 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:11:53.328 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:53.353 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:11:53.373 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:53.449 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:11:53.491 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:11:53.507 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:11:53.556 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:11:53.575 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:11:53.629 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:53.634 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:53.681 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:53.755 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:11:53.826 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:11:53.881 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:53.893 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:11:54.007 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:11:54.040 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:54.133 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:11:54.141 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:11:54.175 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:11:54.237 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:11:54.257 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:11:54.337 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:11:54.392 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:11:54.401 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:54.480 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:54.615 INFO:teuthology.orchestra.run.smithi129.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:11:54.660 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:54.830 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:11:54.865 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:11:54.890 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:54.928 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:11:54.953 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:55.015 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:11:55.046 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:11:55.220 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:11:55.300 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:55.345 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:55.389 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:11:55.410 INFO:teuthology.orchestra.run.smithi129.stdout:Adding system user cephadm....done 2024-09-12T18:11:55.515 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:11:55.567 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:11:55.568 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:55.782 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:11:55.818 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:11:55.860 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:11:55.986 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:56.005 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:56.042 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:11:56.052 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:11:56.179 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:11:56.265 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:56.351 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:11:56.374 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:56.446 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:11:56.477 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:11:56.483 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:11:56.697 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:56.706 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:11:56.751 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:56.939 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:57.065 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:57.092 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:11:57.119 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:57.179 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:11:57.200 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:11:57.370 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:57.430 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:11:57.467 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:11:57.517 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:11:57.657 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:11:57.755 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:57.810 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:11:57.902 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:57.958 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:11:58.047 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:58.053 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:11:58.145 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:58.321 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:11:58.334 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:11:58.390 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:58.538 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:58.593 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:11:58.606 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:11:58.625 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:58.726 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:58.856 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:58.927 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:11:58.961 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:11:59.044 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:11:59.207 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:59.208 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:11:59.254 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:11:59.361 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:11:59.458 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:59.459 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:59.581 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:11:59.584 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:11:59.693 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:11:59.794 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:11:59.832 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:11:59.894 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:11:59.912 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:11:59.974 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:00.038 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:12:00.164 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:12:00.220 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:12:00.284 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:12:00.423 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:12:00.542 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:12:00.610 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:12:00.791 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:12:00.793 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:00.822 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:12:00.876 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:12:00.928 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:12:00.977 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:12:01.220 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:12:01.337 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:12:01.346 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:12:01.433 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:12:01.463 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:12:01.472 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:12:01.685 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:01.730 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:12:01.773 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:12:01.782 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:12:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:12:01.998 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:12:02.033 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:12:02.033 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:02.087 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:12:02.168 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:12:02.213 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:12:02.284 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:02.316 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:12:02.339 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:12:02.410 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:12:02.434 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:12:02.444 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:12:02.570 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:12:02.665 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:12:02.695 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:12:02.720 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:12:02.964 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:12:02.975 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:12:02.987 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:12:03.077 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:12:03.207 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:12:03.247 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:12:03.284 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:03.311 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:12:03.385 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:12:03.438 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:12:03.457 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:03.506 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:12:03.563 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:12:03.583 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:12:03.670 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:12:03.740 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:12:03.856 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:12:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:12:03.921 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:12:03.991 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:12:04.101 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:12:04.136 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:12:04.197 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:12:04.291 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:12:04.385 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:12:04.395 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:12:04.448 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:12:04.511 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:12:04.550 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:12:04.646 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:12:04.707 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:12:04.837 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:12:04.880 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:12:04.902 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:12:04.983 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:12:05.109 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:12:05.131 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:12:05.163 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:12:05.178 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:12:05.257 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:12:05.377 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:12:05.503 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:12:05.542 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:12:05.546 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:12:05.558 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:12:05.668 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:12:05.673 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:12:05.774 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:12:05.796 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:12:05.797 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:12:05.856 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:12:05.923 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:05.977 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:12:06.088 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:12:06.101 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:12:06.227 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:12:06.232 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:12:06.278 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:12:06.356 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:12:06.482 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:12:06.529 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:12:06.550 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:12:06.616 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:12:06.628 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:12:06.630 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:12:06.706 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:12:06.748 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:12:06.862 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:12:06.896 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:12:06.960 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:12:07.022 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:12:07.083 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:12:07.086 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:12:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:12:07.273 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:07.382 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:12:07.496 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:12:07.593 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:12:07.692 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:12:07.714 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:12:07.755 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:12:07.856 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:12:07.861 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:12:07.968 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:12:07.974 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:07.987 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:12:08.107 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:08.109 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:12:08.230 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:08.235 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:12:08.252 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:12:08.330 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:12:08.351 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:12:08.378 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:12:08.461 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:12:08.544 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:12:08.578 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:12:08.646 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:12:08.657 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:12:08.846 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:12:08.881 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:12:08.967 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:12:08.999 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:12:09.130 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:12:09.139 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:12:09.242 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:12:09.242 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:12:09.256 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:12:09.368 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:12:09.390 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:09.516 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:12:09.523 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:12:09.610 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:12:09.635 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:12:09.817 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:12:09.886 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:12:09.903 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:12:09.980 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:12:10.052 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:12:10.153 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:12:10.247 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:12:10.265 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:12:10.286 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:12:10.356 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:10.457 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:10.537 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:12:10.555 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:12:10.575 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:12:10.642 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:12:10.813 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:12:10.840 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:12:10.911 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:10.936 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:12:11.037 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.072 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:12:11.163 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:12:11.184 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:12:11.207 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:12:11.279 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:12:11.310 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.396 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.411 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.440 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.491 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:12:11.497 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.529 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:12:11.540 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.599 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:12:11.626 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:12:11.658 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.865 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.869 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:11.869 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:11.910 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:12:11.952 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:11.991 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.077 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.118 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:12:12.194 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:12:12.220 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:12:12.368 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.453 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.453 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:12:12.494 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.496 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.571 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.579 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:12:12.606 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.620 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.672 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.730 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:12:12.732 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:12.746 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:12:12.819 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:12:12.872 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:12.872 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:12.935 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:12.935 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:13.057 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:12:13.183 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:12:13.373 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:13.408 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:13.498 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:13.534 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:13.585 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:12:13.625 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:13.660 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:13.751 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:12:13.786 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:12:13.819 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:12:13.945 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:12:13.965 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:14.109 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:14.213 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:12:14.234 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:14.338 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:12:14.360 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:14.487 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:14.656 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:12:14.966 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:12:15.029 INFO:teuthology.orchestra.run.smithi176.stdout:Adding group ceph....done 2024-09-12T18:12:15.030 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.063 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.165 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.172 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.250 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:12:15.291 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.298 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.364 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user ceph....done 2024-09-12T18:12:15.368 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:12:15.417 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.424 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.507 INFO:teuthology.orchestra.run.smithi176.stdout:Setting system user ceph properties....done 2024-09-12T18:12:15.523 INFO:teuthology.orchestra.run.smithi176.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:12:15.543 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.550 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:15.644 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:12:15.656 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:12:15.972 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:12:15.980 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:12:16.094 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-09-12T18:12:16.094 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2024-09-12T18:12:16.240 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:12:16.437 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-09-12T18:12:16.445 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2024-09-12T18:12:16.445 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:16.571 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:16.597 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2024-09-12T18:12:16.597 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-09-12T18:12:16.614 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:12:16.615 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:12:16.641 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:12:16.751 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:12:16.764 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:12:16.909 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:12:17.042 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:17.042 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:17.056 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:12:17.110 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:12:17.245 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:12:17.371 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:17.497 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:17.539 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:17.577 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:17.632 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:12:17.678 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:17.884 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:12:17.888 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:17.968 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.012 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.085 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.159 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:18.160 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:18.195 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:12:18.350 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.471 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.597 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.610 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:18.610 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:18.621 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.643 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:18.643 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:18.723 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:18.938 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:18.939 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:12:18.978 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:12:19.039 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.136 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.349 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:19.350 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:19.377 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:12:19.450 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.457 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.567 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.668 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.670 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:19.671 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:19.769 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:12:19.836 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:19.849 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:20.072 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:20.073 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:20.121 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:20.121 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:20.202 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:20.450 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:20.450 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:20.559 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:20.637 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:20.771 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:20.771 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:20.899 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.033 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.040 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.166 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:21.247 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:21.264 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:21.264 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:21.276 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.292 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.409 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.519 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.561 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:21.561 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:21.751 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.788 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.868 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.914 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:21.969 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.037 INFO:teuthology.orchestra.run.smithi129.stdout:Adding group ceph....done 2024-09-12T18:12:22.065 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.112 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.291 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:22.291 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:22.293 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.396 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.438 INFO:teuthology.orchestra.run.smithi129.stdout:Adding system user ceph....done 2024-09-12T18:12:22.465 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:12:22.539 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.574 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:22.589 INFO:teuthology.orchestra.run.smithi129.stdout:Setting system user ceph properties....done 2024-09-12T18:12:22.605 INFO:teuthology.orchestra.run.smithi129.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:12:22.726 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:22.743 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:12:22.761 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:22.761 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:22.801 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:22.960 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.072 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:12:23.086 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.212 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.232 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.366 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.492 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.503 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.621 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.643 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:23.757 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:12:23.835 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:23.858 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:23.994 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:23.995 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:12:24.096 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:24.101 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:24.101 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:12:24.248 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:24.434 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:24.437 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:12:24.500 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2024-09-12T18:12:24.597 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:24.702 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:24.709 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2024-09-12T18:12:24.710 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2024-09-12T18:12:24.906 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:12:24.906 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:12:24.906 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:12:24.906 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:12:24.906 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:12:24.906 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:12:24.907 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:12:24.907 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:12:24.907 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:12:24.907 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2024-09-12T18:12:24.908 INFO:teuthology.orchestra.run.smithi176.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:12:24.910 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2024-09-12T18:12:24.910 INFO:teuthology.orchestra.run.smithi176.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:12:24.940 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2024-09-12T18:12:24.941 INFO:teuthology.orchestra.run.smithi176.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:12:24.943 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2024-09-12T18:12:24.943 INFO:teuthology.orchestra.run.smithi176.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:12:24.957 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:12:24.994 INFO:teuthology.orchestra.run.smithi176.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:12:24.994 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:12:24.994 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:12:24.994 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:12:25.094 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:12:25.154 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:12:25.154 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:12:25.154 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:12:25.163 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:12:25.163 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:12:25.164 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:12:25.164 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:12:25.165 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:12:25.362 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:25.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:12:25.365 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:25.421 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T18:12:25.441 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:25.535 INFO:teuthology.orchestra.run.smithi176.stdout:Preconfiguring packages ... 2024-09-12T18:12:25.630 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 5,494 kB in 0s (22.3 MB/s) 2024-09-12T18:12:25.635 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T18:12:25.636 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T18:12:25.677 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:25.678 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:12:25.766 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package flex. 2024-09-12T18:12:25.846 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:12:25.847 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:12:25.847 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:12:25.847 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:12:25.847 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:12:25.847 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:12:25.847 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:12:25.848 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:12:25.848 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:12:25.848 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-12T18:12:25.849 INFO:teuthology.orchestra.run.smithi062.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:12:25.850 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-12T18:12:25.850 INFO:teuthology.orchestra.run.smithi062.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:12:25.858 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:12:25.864 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:25.881 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-12T18:12:25.882 INFO:teuthology.orchestra.run.smithi062.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:12:25.883 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2024-09-12T18:12:25.884 INFO:teuthology.orchestra.run.smithi062.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:12:26.065 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:12:26.065 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:12:26.065 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:12:26.066 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:12:26.151 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:26.201 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:26.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:12:26.234 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:12:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T18:12:26.360 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:26.360 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:12:26.514 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T18:12:26.515 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T18:12:26.537 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:12:26.712 INFO:teuthology.orchestra.run.smithi151.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:12:26.712 INFO:teuthology.orchestra.run.smithi151.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:12:26.712 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:12:26.712 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:12:26.712 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:12:26.712 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:12:26.713 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:12:26.713 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:12:26.713 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:12:26.713 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-12T18:12:26.714 INFO:teuthology.orchestra.run.smithi151.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:12:26.716 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-12T18:12:26.716 INFO:teuthology.orchestra.run.smithi151.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:12:26.745 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-12T18:12:26.746 INFO:teuthology.orchestra.run.smithi151.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:12:26.748 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-09-12T18:12:26.748 INFO:teuthology.orchestra.run.smithi151.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:12:26.789 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:12:26.791 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:12:26.792 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:12:26.799 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:12:26.799 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:12:26.799 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:12:26.799 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:12:26.825 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:12:26.826 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:12:26.828 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:12:26.829 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:12:26.830 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:12:26.886 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:26.900 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:26.901 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:12:26.961 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:12:26.962 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:12:26.963 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:12:26.976 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:12:26.977 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:12:26.978 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:12:26.978 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:12:26.979 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:12:27.073 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:12:27.129 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:27.129 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:12:27.261 INFO:teuthology.orchestra.run.smithi062.stdout:Preconfiguring packages ... 2024-09-12T18:12:27.342 INFO:teuthology.orchestra.run.smithi151.stdout:Preconfiguring packages ... 2024-09-12T18:12:27.392 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 5,494 kB in 1s (5,447 kB/s) 2024-09-12T18:12:27.447 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 5,494 kB in 0s (21.7 MB/s) 2024-09-12T18:12:27.509 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:27.533 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package flex. 2024-09-12T18:12:27.580 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package flex. 2024-09-12T18:12:27.603 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:27.641 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:12:27.647 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:27.673 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:12:27.679 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:27.690 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:12:27.729 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:12:27.729 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:27.978 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:27.983 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:28.075 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:28.105 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:28.236 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:28.284 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:28.284 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:12:28.291 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:28.401 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:12:28.471 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:12:28.483 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:28.613 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:28.751 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:28.804 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:28.902 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:28.938 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:28.940 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:29.011 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:29.145 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:12:29.313 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package bison. 2024-09-12T18:12:29.346 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:29.351 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:29.418 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:29.424 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:12:29.466 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:29.475 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:29.479 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:29.485 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:29.490 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:12:29.596 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:29.599 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:29.751 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:29.765 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:12:29.782 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:12:29.824 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:29.843 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:29.956 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:30.015 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:30.044 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:12:30.060 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:12:30.102 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:30.145 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:30.316 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:30.439 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:12:30.448 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:30.467 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:30.505 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:30.689 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package bison. 2024-09-12T18:12:30.766 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:12:30.778 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package bison. 2024-09-12T18:12:30.782 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:30.794 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:30.800 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:12:30.824 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:30.850 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:30.878 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:30.884 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:30.890 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:12:30.939 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:31.102 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:12:31.130 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:31.169 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:31.183 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:12:31.199 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:12:31.231 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:12:31.241 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:31.260 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:12:31.298 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:31.495 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:12:31.521 INFO:teuthology.orchestra.run.smithi129.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:31.523 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:12:31.524 DEBUG:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:12:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:31.577 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:12:31.606 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:12:31.624 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2024-09-12T18:12:31.638 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:12:31.685 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:31.764 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:31.847 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2024-09-12T18:12:31.847 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2024-09-12T18:12:31.881 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:12:31.890 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:31.909 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:31.956 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:31.997 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:12:32.016 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:32.023 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:32.055 INFO:teuthology.orchestra.run.smithi129.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:12:32.055 INFO:teuthology.orchestra.run.smithi129.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:12:32.055 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:12:32.055 INFO:teuthology.orchestra.run.smithi129.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:12:32.055 INFO:teuthology.orchestra.run.smithi129.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:12:32.055 INFO:teuthology.orchestra.run.smithi129.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:12:32.056 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:32.056 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:12:32.056 INFO:teuthology.orchestra.run.smithi129.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:12:32.056 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:12:32.057 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2024-09-12T18:12:32.058 INFO:teuthology.orchestra.run.smithi129.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:12:32.059 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2024-09-12T18:12:32.059 INFO:teuthology.orchestra.run.smithi129.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:12:32.089 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2024-09-12T18:12:32.090 INFO:teuthology.orchestra.run.smithi129.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:12:32.091 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be upgraded: 2024-09-12T18:12:32.092 INFO:teuthology.orchestra.run.smithi129.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:12:32.142 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:32.209 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:12:32.225 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:32.267 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:32.268 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:32.274 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:12:32.275 INFO:teuthology.orchestra.run.smithi129.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:12:32.275 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:12:32.275 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:12:32.275 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:12:32.291 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:32.332 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:32.378 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:32.451 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:12:32.512 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:32.519 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:12:32.535 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:32.577 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:32.593 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:12:32.610 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:32.639 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:32.652 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:32.752 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:12:32.790 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:33.005 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:12:33.009 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:12:33.009 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:12:33.041 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:12:33.041 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:12:33.043 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:12:33.044 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:12:33.044 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:12:33.157 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:12:33.199 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:12:33.283 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:33.325 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:33.409 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:33.451 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:33.460 INFO:teuthology.orchestra.run.smithi129.stdout:Preconfiguring packages ... 2024-09-12T18:12:33.535 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:33.560 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:33.661 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:33.678 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:33.723 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 5,494 kB in 1s (5,409 kB/s) 2024-09-12T18:12:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:33.844 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package flex. 2024-09-12T18:12:33.845 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:33.908 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:12:33.914 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:33.946 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:33.959 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:12:33.982 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:34.010 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:12:34.018 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:12:34.073 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:34.081 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:34.200 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:34.217 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:34.351 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:34.351 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:34.481 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:34.487 DEBUG:teuthology.parallel:result is None 2024-09-12T18:12:34.544 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:34.716 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:12:35.151 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:35.537 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:35.685 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:35.691 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:35.831 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:36.047 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:36.052 DEBUG:teuthology.parallel:result is None 2024-09-12T18:12:36.132 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:36.136 DEBUG:teuthology.parallel:result is None 2024-09-12T18:12:36.249 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:12:36.379 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:12:36.723 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:37.096 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package bison. 2024-09-12T18:12:37.201 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:12:37.206 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:12:37.249 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:37.565 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:12:37.593 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:12:37.631 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:37.910 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:12:37.938 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:12:37.977 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:38.313 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:12:38.341 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:38.380 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:38.599 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:12:38.627 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:12:38.657 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:38.910 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:12:38.926 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:12:38.968 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:39.446 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:12:39.573 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:12:39.698 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:12:39.950 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:12:40.077 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:40.202 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:12:40.291 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:12:40.354 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:12:40.472 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:12:40.615 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:12:41.833 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:12:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:12:42.271 DEBUG:teuthology.parallel:result is None 2024-09-12T18:12:42.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:12:42.426 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:12:42.446 INFO:teuthology.orchestra.run.smithi062.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.446 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.446 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:12:42.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:12:42.594 DEBUG:teuthology.orchestra.run.smithi129:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:12:42.613 INFO:teuthology.orchestra.run.smithi129.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.613 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.613 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:12:42.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:12:42.759 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:12:42.779 INFO:teuthology.orchestra.run.smithi151.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.779 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.779 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:12:42.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:12:42.943 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:12:42.962 INFO:teuthology.orchestra.run.smithi176.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.963 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:12:42.963 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:12:42.964 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T18:12:42.965 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:42.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:12:42.980 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:42.980 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:12:42.995 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:42.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:12:43.010 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:43.010 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:12:43.024 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T18:12:43.025 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:43.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:12:43.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:12:43.092 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:43.092 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:12:43.104 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:12:43.161 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:43.161 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:12:43.174 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:12:43.227 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:43.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:12:43.241 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:12:43.293 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T18:12:43.294 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:43.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:12:43.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:12:43.365 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:43.365 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:12:43.378 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:12:43.432 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:43.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:12:43.449 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:12:43.504 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:43.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:12:43.518 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:12:43.574 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T18:12:43.574 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:43.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:12:43.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:12:43.644 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:43.644 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:12:43.658 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:12:43.712 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:43.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:12:43.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:12:43.780 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:43.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:12:43.795 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:12:43.851 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T18:12:43.966 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T18:12:43.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-09-12T18:12:43.969 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-09-12T18:12:43.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-09-12T18:12:43.974 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-12T18:12:43.987 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T18:12:43.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:12:44.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:12:44.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:12:44.030 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:12:44.042 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T18:12:44.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:12:44.082 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:12:44.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:12:44.086 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:12:44.111 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T18:12:44.111 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T18:12:44.111 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'bhubbard@redhat.com', 'first_in_suite': False, 'job_id': '7901167', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_bhubbard@teuthology', 'priority': 150, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 245, 'sha1': '46406987da2067f022005d68ecbb989daaabb837', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKvMl2iCcrmCdHm6eJtj9klE7xUn5XhSF6KGuf/plZaAY3vvsR3m6PRXdlQt3V3mZlsy2QJs3QEUs2yWM5vnqQ=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMAYTS+BzX404MLlmwbbaVpJJz0oxnl4e/JIvXmUkOG6vLHbHiL6J9L9E6GwgZ8qS4cgt0uLFGLwDt/teMC1ubQ=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOOQzf3KwXm3m8b30wdyPHPoB13NXVbCIMddA/eANpVH366YxUANt4YjdfKWOQ7atoBtLJEFo3xLThWtjM0hPxk=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBV4xga5KUT2U/N54v0O0z6YVYJQZ4OQkLr/jQ7BC1ncd2Byrx8VE3nnBgJygzaRDK+pZugy/JZopgiyMECsVZk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_02:37:30', 'tube': 'smithi', 'user': 'bhubbard', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T18:12:44.112 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:12:44.137 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:12:44.140 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:12:44.143 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:12:44.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:12:44.189 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:12:44.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:12:44.193 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:12:44.207 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:44.207 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:12:44.250 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:12:44.250 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-09-12T18:12:44.297 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:12:44.297 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:44.297 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T18:12:44.297 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:44.297 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-12 18:06:41.359680289 +0000 2024-09-12T18:12:44.298 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-12 18:06:41.107682540 +0000 2024-09-12T18:12:44.298 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-12 18:06:41.107682540 +0000 2024-09-12T18:12:44.298 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-09-12T18:12:44.298 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:12:44.351 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-12T18:12:44.352 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-12T18:12:44.352 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000392382 s, 1.3 MB/s 2024-09-12T18:12:44.353 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:12:44.402 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-09-12T18:12:44.450 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:12:44.450 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:44.450 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T18:12:44.450 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:44.451 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-12 18:06:41.843675966 +0000 2024-09-12T18:12:44.451 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-12 18:06:41.591678217 +0000 2024-09-12T18:12:44.451 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-12 18:06:41.591678217 +0000 2024-09-12T18:12:44.451 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-09-12T18:12:44.452 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:12:44.503 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-12T18:12:44.503 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-12T18:12:44.503 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000336186 s, 1.5 MB/s 2024-09-12T18:12:44.504 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:12:44.554 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-09-12T18:12:44.601 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:12:44.601 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:44.601 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-12T18:12:44.601 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:44.601 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-12 18:06:42.315671749 +0000 2024-09-12T18:12:44.602 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-12 18:06:42.063674001 +0000 2024-09-12T18:12:44.602 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-12 18:06:42.063674001 +0000 2024-09-12T18:12:44.602 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-09-12T18:12:44.602 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:12:44.655 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-12T18:12:44.656 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-12T18:12:44.656 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000338153 s, 1.5 MB/s 2024-09-12T18:12:44.658 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:12:44.707 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-12 18:06:42.791667498 +0000 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-12 18:06:42.551669641 +0000 2024-09-12T18:12:44.753 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-12 18:06:42.551669641 +0000 2024-09-12T18:12:44.754 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-09-12T18:12:44.754 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:12:44.807 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-12T18:12:44.807 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-12T18:12:44.807 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000323506 s, 1.6 MB/s 2024-09-12T18:12:44.808 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:12:44.858 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T18:12:44.859 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:44.859 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:12:44.865 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:12:44.865 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 18:06:44.976472222 +0000 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 18:06:44.748474258 +0000 2024-09-12T18:12:44.913 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 18:06:44.748474258 +0000 2024-09-12T18:12:44.914 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T18:12:44.914 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:12:44.967 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T18:12:44.967 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T18:12:44.968 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000447549 s, 1.1 MB/s 2024-09-12T18:12:44.969 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:12:45.019 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-12T18:12:45.068 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:12:45.068 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.068 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T18:12:45.068 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.068 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 18:06:45.460467899 +0000 2024-09-12T18:12:45.068 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 18:06:45.216470078 +0000 2024-09-12T18:12:45.069 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 18:06:45.216470078 +0000 2024-09-12T18:12:45.069 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T18:12:45.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:12:45.123 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T18:12:45.123 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T18:12:45.123 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.0003546 s, 1.4 MB/s 2024-09-12T18:12:45.124 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:12:45.178 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-12T18:12:45.224 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:12:45.224 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.225 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-12T18:12:45.225 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.225 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 18:06:45.932463682 +0000 2024-09-12T18:12:45.225 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 18:06:45.684465898 +0000 2024-09-12T18:12:45.225 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 18:06:45.684465898 +0000 2024-09-12T18:12:45.225 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T18:12:45.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:12:45.280 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T18:12:45.281 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T18:12:45.281 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000426317 s, 1.2 MB/s 2024-09-12T18:12:45.282 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:12:45.329 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-12T18:12:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 941 Links: 1 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 18:06:46.424459288 +0000 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 18:06:46.168461574 +0000 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 18:06:46.168461574 +0000 2024-09-12T18:12:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T18:12:45.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:12:45.430 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T18:12:45.431 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T18:12:45.431 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000372795 s, 1.4 MB/s 2024-09-12T18:12:45.432 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:12:45.482 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T18:12:45.484 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:45.484 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:12:45.490 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:12:45.490 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-12T18:12:45.539 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:12:45.539 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.539 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-12T18:12:45.539 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.540 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 18:06:43.046091571 +0000 2024-09-12T18:12:45.540 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 18:06:42.762094107 +0000 2024-09-12T18:12:45.540 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 18:06:42.762094107 +0000 2024-09-12T18:12:45.540 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-12T18:12:45.540 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:12:45.593 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T18:12:45.593 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T18:12:45.594 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000443137 s, 1.2 MB/s 2024-09-12T18:12:45.595 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:12:45.648 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-12T18:12:45.695 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:12:45.695 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.695 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-12T18:12:45.695 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.695 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 18:06:43.506087462 +0000 2024-09-12T18:12:45.695 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 18:06:43.278089499 +0000 2024-09-12T18:12:45.696 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 18:06:43.278089499 +0000 2024-09-12T18:12:45.696 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-12T18:12:45.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:12:45.748 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T18:12:45.749 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T18:12:45.749 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000367121 s, 1.4 MB/s 2024-09-12T18:12:45.750 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:12:45.801 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 18:06:44.022082854 +0000 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 18:06:43.754085247 +0000 2024-09-12T18:12:45.847 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 18:06:43.754085247 +0000 2024-09-12T18:12:45.848 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-12T18:12:45.848 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:12:45.903 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T18:12:45.903 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T18:12:45.903 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000315359 s, 1.6 MB/s 2024-09-12T18:12:45.904 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:12:45.952 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-12T18:12:45.998 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-12 18:06:44.526078351 +0000 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-12 18:06:44.254080781 +0000 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-12 18:06:44.254080781 +0000 2024-09-12T18:12:45.999 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-12T18:12:45.999 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:12:46.054 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-12T18:12:46.054 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-12T18:12:46.055 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000379317 s, 1.3 MB/s 2024-09-12T18:12:46.055 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:12:46.104 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T18:12:46.104 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T18:12:46.105 INFO:tasks.ceph:Generating config... 2024-09-12T18:12:46.106 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:12:46.107 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T18:12:46.107 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T18:12:46.107 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T18:12:46.107 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T18:12:46.107 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T18:12:46.107 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T18:12:46.107 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T18:12:46.108 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T18:12:46.109 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T18:12:46.109 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T18:12:46.109 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T18:12:46.109 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T18:12:46.109 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T18:12:46.109 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T18:12:46.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T18:12:46.145 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T18:12:46.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T18:12:46.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:12:46.292 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]'), ('mon.c', '[v2:172.21.15.62:3302,v1:172.21.15.62:6791]')] 2024-09-12T18:12:46.292 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-09-12T18:12:46.293 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:46.293 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:12:46.340 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --addv b '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --addv c '[v2:172.21.15.62:3302,v1:172.21.15.62:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2024-09-12T18:12:46.432065+0000 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-09-12T18:12:46.432065+0000 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 17 (quincy) 2024-09-12T18:12:46.431 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2024-09-12T18:12:46.432 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T18:12:46.432 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.b 2024-09-12T18:12:46.432 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.62:3302/0,v1:172.21.15.62:6791/0] mon.c 2024-09-12T18:12:46.432 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T18:12:46.433 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:12:46.438 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5c1106a1-8b30-400f-94eb-0bea28eb5927... 2024-09-12T18:12:46.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:12:46.481 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:12:46.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:12:46.486 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:12:46.511 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-09-12T18:12:46.511 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-09-12T18:12:46.511 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:12:46.511 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-09-12T18:12:46.511 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.511 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.512 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:12:46.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:12:46.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-09-12T18:12:46.515 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug trim objects = true 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-09-12T18:12:46.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore compression algorithm = zstd 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore compression mode = aggressive 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-09-12T18:12:46.517 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd max markdown count = 1000 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-09-12T18:12:46.518 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:12:46.519 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-09-12T18:12:46.520 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout:[client.0] 2024-09-12T18:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:12:46.522 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-12T18:12:46.522 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-12T18:12:46.523 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:12:46.524 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-12T18:12:46.525 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-12T18:12:46.526 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-12T18:12:46.527 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore compression algorithm = zstd 2024-09-12T18:12:46.528 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore compression mode = aggressive 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: osd max markdown count = 1000 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-12T18:12:46.529 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-12T18:12:46.530 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:12:46.531 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:12:46.532 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-09-12T18:12:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:12:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-09-12T18:12:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.536 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-09-12T18:12:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore compression algorithm = zstd 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore compression mode = aggressive 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-09-12T18:12:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: osd max markdown count = 1000 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-09-12T18:12:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:12:46.543 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-09-12T18:12:46.544 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2024-09-12T18:12:46.544 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2024-09-12T18:12:46.544 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2024-09-12T18:12:46.544 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2024-09-12T18:12:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-09-12T18:12:46.545 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:12:46.546 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-09-12T18:12:46.547 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-09-12T18:12:46.548 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]" 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-09-12T18:12:46.549 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.550 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression algorithm = zstd 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore compression mode = aggressive 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-09-12T18:12:46.551 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: osd max markdown count = 1000 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-12T18:12:46.552 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-09-12T18:12:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.554 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-09-12T18:12:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-09-12T18:12:46.556 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-12T18:12:46.557 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T18:12:46.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T18:12:46.639 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T18:12:46.639 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:46.640 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T18:12:46.645 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:46.645 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T18:12:46.692 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T18:12:46.692 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:46.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:12:46.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:12:46.759 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:46.759 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:46.804 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:12:46.804 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:46.804 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:12:46.805 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:12:46.827 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:46.828 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:46.873 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T18:12:46.873 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:46.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:12:46.874 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:12:46.897 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:46.897 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:46.945 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T18:12:46.946 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:46.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:12:46.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:12:46.970 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:46.970 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:47.018 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T18:12:47.019 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T18:12:47.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:12:47.063 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:12:47.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:12:47.150 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:12:47.154 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T18:12:47.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T18:12:47.237 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T18:12:47.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T18:12:47.295 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T18:12:47.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T18:12:47.375 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T18:12:47.386 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T18:12:47.386 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T18:12:47.386 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T18:12:47.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T18:12:47.401 INFO:tasks.ceph:role: osd.0 2024-09-12T18:12:47.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:12:47.401 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:12:47.465 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:12:47.466 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:12:47.917 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-09-12T18:12:47.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-09-12T18:12:47.927 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T18:12:48.022 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T18:12:48.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:48.077 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:12:48.078 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-12T18:12:48.191+0000 7f82508307c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T18:12:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-12T18:12:48.195+0000 7f82508307c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T18:12:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-12T18:12:48.195+0000 7f82508307c0 -1 bdev(0x5623f2e8d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T18:12:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-12T18:12:48.195+0000 7f82508307c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T18:12:51.361 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T18:12:51.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T18:12:51.390 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T18:12:51.390 INFO:tasks.ceph:role: osd.1 2024-09-12T18:12:51.390 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T18:12:51.391 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:12:51.453 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:12:51.453 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:12:51.453 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:12:51.453 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:12:51.454 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:12:51.454 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:12:51.454 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:12:51.454 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:12:51.454 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:12:51.454 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:12:51.944 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-12T18:12:51.946 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-12T18:12:51.946 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T18:12:52.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T18:12:52.107 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:12:52.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:52.108 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T18:12:52.233+0000 7f9a2dd7b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T18:12:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T18:12:52.241+0000 7f9a2dd7b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T18:12:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T18:12:52.241+0000 7f9a2dd7b7c0 -1 bdev(0x55871eacd800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T18:12:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T18:12:52.241+0000 7f9a2dd7b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T18:12:55.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T18:12:55.432 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T18:12:55.447 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T18:12:55.447 INFO:tasks.ceph:role: osd.2 2024-09-12T18:12:55.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T18:12:55.447 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:12:55.510 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:12:55.510 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:12:55.510 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:12:55.511 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:12:55.977 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-12T18:12:55.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-12T18:12:55.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T18:12:56.080 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T18:12:56.089 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:12:56.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:56.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:12:56.199 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T18:12:56.198+0000 7f4eaa2827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T18:12:56.202 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T18:12:56.198+0000 7f4eaa2827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T18:12:56.202 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T18:12:56.198+0000 7f4eaa2827c0 -1 bdev(0x561d5dd09800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T18:12:56.202 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-12T18:12:56.198+0000 7f4eaa2827c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T18:12:59.339 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T18:12:59.352 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T18:12:59.352 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:59.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T18:12:59.367 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:59.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T18:12:59.420 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:59.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T18:12:59.476 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:12:59.477 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T18:12:59.490 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:12:59.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T18:12:59.504 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:12:59.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T18:12:59.517 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T18:12:59.518 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T18:12:59.525 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T18:12:59.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAfL+NmnSrYAxAATRExiyX/D5mLx9e1uxpSeQ== 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAfL+NmaR8KCRAAJlITD17Tpx3byybLvQXTKw== 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAfL+NmxJ80DhAAKYVr5Uh03IVI0zwpPP3y4g== 2024-09-12T18:12:59.579 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAgL+NmrKTRCxAAVl9+Gxu2dAcJquy13PhYEQ== 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAkL+NmBMsaDhAAAHSigIQAHSx6mhMIrsGckQ== 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAoL+NmoTgADBAAtv7V/Abz/zh8I6YnSDxc9Q== 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-09-12T18:12:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAfL+NmLXVxFhAAgt95XxEHThkTi9nzRNZv9g== 2024-09-12T18:12:59.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:12:59.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:12:59.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T18:12:59.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:12:59.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:12:59.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:13:00.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:13:00.069 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T18:13:00.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T18:13:00.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:13:00.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T18:13:00.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T18:13:00.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:13:00.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T18:13:00.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T18:13:00.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:13:00.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T18:13:00.512 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:13:00.559 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T18:13:00.560 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T18:13:00.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T18:13:00.606 INFO:tasks.ceph.mon.a:Started 2024-09-12T18:13:00.607 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T18:13:00.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T18:13:00.608 INFO:tasks.ceph.mon.b:Started 2024-09-12T18:13:00.609 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T18:13:00.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T18:13:00.610 INFO:tasks.ceph.mon.c:Started 2024-09-12T18:13:00.611 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T18:13:00.611 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T18:13:00.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T18:13:00.613 INFO:tasks.ceph.mgr.x:Started 2024-09-12T18:13:00.613 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T18:13:00.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T18:13:00.616 INFO:tasks.ceph.mgr.y:Started 2024-09-12T18:13:00.616 DEBUG:tasks.ceph:set 0 configs 2024-09-12T18:13:00.616 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T18:13:00.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T18:13:01.058 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-09-12T18:13:01.077 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T18:13:01.078 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T18:13:01.078 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-12T18:13:01.078 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T18:13:01.092 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T18:13:01.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T18:13:01.106 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-12T18:13:01.106 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T18:13:01.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new d5348027-f4dc-457f-8b4e-a4341015d874 0 2024-09-12T18:13:01.379 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-12T18:13:01.397 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 939481c0-5bf6-4136-b772-e0ba4c215bf1 1 2024-09-12T18:13:01.597 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-12T18:13:01.614 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 66fc0ac1-f14f-48bf-a557-110b23bff1d2 2 2024-09-12T18:13:01.817 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-12T18:13:01.836 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T18:13:01.836 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T18:13:01.839 INFO:tasks.ceph.osd.0:Started 2024-09-12T18:13:01.839 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T18:13:01.839 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T18:13:01.842 INFO:tasks.ceph.osd.1:Started 2024-09-12T18:13:01.842 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T18:13:01.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T18:13:01.844 INFO:tasks.ceph.osd.2:Started 2024-09-12T18:13:01.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:02.063 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:02.063 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:01.815814+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:02.080 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T18:13:02.080 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T18:13:02.383 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:02.574 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T18:13:02.574 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":5,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:01.815814+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:02.595 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T18:13:02.904 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:02.902+0000 7f87cf6a17c0 -1 Falling back to public interface 2024-09-12T18:13:02.918 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:02.915+0000 7f14d90d97c0 -1 Falling back to public interface 2024-09-12T18:13:02.986 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:02.985+0000 7f2bfc4fa7c0 -1 Falling back to public interface 2024-09-12T18:13:04.353 INFO:tasks.ceph.mgr.x.smithi062.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:13:04.354 INFO:tasks.ceph.mgr.x.smithi062.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:13:04.354 INFO:tasks.ceph.mgr.x.smithi062.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:13:04.354 INFO:tasks.ceph.mgr.y.smithi062.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:13:04.354 INFO:tasks.ceph.mgr.y.smithi062.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:13:04.354 INFO:tasks.ceph.mgr.y.smithi062.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:13:06.727 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:06.726+0000 7f87cf6a17c0 -1 osd.2 0 log_to_monitors true 2024-09-12T18:13:06.755 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:06.751+0000 7f14d90d97c0 -1 osd.0 0 log_to_monitors true 2024-09-12T18:13:06.805 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:06.805+0000 7f2bfc4fa7c0 -1 osd.1 0 log_to_monitors true 2024-09-12T18:13:07.356 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-09-12T18:13:07.350+0000 7f6a8cf28640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T18:13:07.356 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-09-12T18:13:07.354+0000 7f6a8cf28640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T18:13:08.898 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:09.206 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T18:13:09.206 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":7,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:08.392800+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:09.221 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:09.219+0000 7f14d5894640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T18:13:09.224 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T18:13:09.249 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:09.247+0000 7f14cceb4640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:13:09.256 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:09.257+0000 7f2bf8cb5640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T18:13:09.256 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:09.254+0000 7f87cb64a640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T18:13:09.273 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:09.273+0000 7f2bf02d5640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:13:09.275 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:09.274+0000 7f87c347c640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:13:15.526 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:15.841 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T18:13:15.842 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":11,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:13.284820+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:15.860 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T18:13:15.860 INFO:tasks.ceph:Creating RBD pool 2024-09-12T18:13:15.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T18:13:16.321 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2024-09-12T18:13:16.344 DEBUG:teuthology.orchestra.run.smithi062:> rbd --cluster ceph pool init rbd 2024-09-12T18:13:19.381 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T18:13:19.381 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T18:13:19.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T18:13:19.384 INFO:tasks.ceph.mds.a:Started 2024-09-12T18:13:19.384 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T18:13:19.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:13:19.473 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2024-09-12T18:13:19.739 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:19.739 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":2,"btime":"2024-09-12T18:13:19:497703+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T18:13:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 2 2024-09-12T18:13:19.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T18:13:20.066 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:20.066 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2024-09-12T18:13:20.066 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:20.067 INFO:teuthology.orchestra.run.smithi062.stdout:] 2024-09-12T18:13:20.085 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T18:13:20.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T18:13:21.374 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2024-09-12T18:13:21.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T18:13:22.387 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2024-09-12T18:13:22.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T18:13:23.387 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T18:13:23.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:23.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:23.725 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:22.766205+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:23.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:24.053 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:24.054 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:22.766205+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:24.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T18:13:25.435 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T18:13:25.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T18:13:25.506 INFO:tasks.ceph.mds.a.smithi062.stderr:2024-09-12T18:13:25.502+0000 7fa92a684640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T18:13:26.733 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T18:13:26.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:13:27.072 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:27.072 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"btime":"2024-09-12T18:13:26:704705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:13:22.766125+0000","modified":"2024-09-12T18:13:25.788129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4214,"qdb_cluster":[4214]},"id":1}]} 2024-09-12T18:13:27.072 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2024-09-12T18:13:27.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:27.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:27.398 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:25.702443+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:27.418 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:13:27.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:27.738 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:27.740 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:27.757 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:13:26.335961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90064,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025456,"statfs":{"total":289910292480,"available":289818066944,"internally_reserved":0,"allocated":671744,"data_stored":1357981,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001030"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.429070+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:23.429070+0000","last_peered":"2024-09-12T18:13:23.429070+0000","last_clean":"2024-09-12T18:13:23.429070+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:23.429070+0000","last_undegraded":"2024-09-12T18:13:23.429070+0000","last_fullsized":"2024-09-12T18:13:23.429070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:24.321634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.431925+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:23.431925+0000","last_peered":"2024-09-12T18:13:23.431925+0000","last_clean":"2024-09-12T18:13:23.431925+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:23.431925+0000","last_undegraded":"2024-09-12T18:13:23.431925+0000","last_fullsized":"2024-09-12T18:13:23.431925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:57.317766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403792+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:24.403792+0000","last_peered":"2024-09-12T18:13:24.403792+0000","last_clean":"2024-09-12T18:13:24.403792+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:24.403792+0000","last_undegraded":"2024-09-12T18:13:24.403792+0000","last_fullsized":"2024-09-12T18:13:24.403792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403938+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:24.403938+0000","last_peered":"2024-09-12T18:13:24.403938+0000","last_clean":"2024-09-12T18:13:24.403938+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:24.403938+0000","last_undegraded":"2024-09-12T18:13:24.403938+0000","last_fullsized":"2024-09-12T18:13:24.403938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.416293+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:23.416293+0000","last_peered":"2024-09-12T18:13:23.416293+0000","last_clean":"2024-09-12T18:13:23.416293+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:23.416293+0000","last_undegraded":"2024-09-12T18:13:23.416293+0000","last_fullsized":"2024-09-12T18:13:23.416293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:42.614792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403296+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:24.403296+0000","last_peered":"2024-09-12T18:13:24.403296+0000","last_clean":"2024-09-12T18:13:24.403296+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:24.403296+0000","last_undegraded":"2024-09-12T18:13:24.403296+0000","last_fullsized":"2024-09-12T18:13:24.403296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402912+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:24.402912+0000","last_peered":"2024-09-12T18:13:24.402912+0000","last_clean":"2024-09-12T18:13:24.402912+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:24.402912+0000","last_undegraded":"2024-09-12T18:13:24.402912+0000","last_fullsized":"2024-09-12T18:13:24.402912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402261+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:24.402261+0000","last_peered":"2024-09-12T18:13:24.402261+0000","last_clean":"2024-09-12T18:13:24.402261+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:24.402261+0000","last_undegraded":"2024-09-12T18:13:24.402261+0000","last_fullsized":"2024-09-12T18:13:24.402261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405280+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:24.405280+0000","last_peered":"2024-09-12T18:13:24.405280+0000","last_clean":"2024-09-12T18:13:24.405280+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:24.405280+0000","last_undegraded":"2024-09-12T18:13:24.405280+0000","last_fullsized":"2024-09-12T18:13:24.405280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.431864+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:23.431864+0000","last_peered":"2024-09-12T18:13:23.431864+0000","last_clean":"2024-09-12T18:13:23.431864+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:23.431864+0000","last_undegraded":"2024-09-12T18:13:23.431864+0000","last_fullsized":"2024-09-12T18:13:23.431864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:51.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404742+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:24.404742+0000","last_peered":"2024-09-12T18:13:24.404742+0000","last_clean":"2024-09-12T18:13:24.404742+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:24.404742+0000","last_undegraded":"2024-09-12T18:13:24.404742+0000","last_fullsized":"2024-09-12T18:13:24.404742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.428728+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:23.428728+0000","last_peered":"2024-09-12T18:13:23.428728+0000","last_clean":"2024-09-12T18:13:23.428728+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:23.428728+0000","last_undegraded":"2024-09-12T18:13:23.428728+0000","last_fullsized":"2024-09-12T18:13:23.428728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:50.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.426526+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:23.426526+0000","last_peered":"2024-09-12T18:13:23.426526+0000","last_clean":"2024-09-12T18:13:23.426526+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:23.426526+0000","last_undegraded":"2024-09-12T18:13:23.426526+0000","last_fullsized":"2024-09-12T18:13:23.426526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.512380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403486+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:24.403486+0000","last_peered":"2024-09-12T18:13:24.403486+0000","last_clean":"2024-09-12T18:13:24.403486+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:24.403486+0000","last_undegraded":"2024-09-12T18:13:24.403486+0000","last_fullsized":"2024-09-12T18:13:24.403486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402696+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:24.402696+0000","last_peered":"2024-09-12T18:13:24.402696+0000","last_clean":"2024-09-12T18:13:24.402696+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:24.402696+0000","last_undegraded":"2024-09-12T18:13:24.402696+0000","last_fullsized":"2024-09-12T18:13:24.402696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402432+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:24.402432+0000","last_peered":"2024-09-12T18:13:24.402432+0000","last_clean":"2024-09-12T18:13:24.402432+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:24.402432+0000","last_undegraded":"2024-09-12T18:13:24.402432+0000","last_fullsized":"2024-09-12T18:13:24.402432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406118+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:24.406118+0000","last_peered":"2024-09-12T18:13:24.406118+0000","last_clean":"2024-09-12T18:13:24.406118+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:24.406118+0000","last_undegraded":"2024-09-12T18:13:24.406118+0000","last_fullsized":"2024-09-12T18:13:24.406118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430494+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:23.430494+0000","last_peered":"2024-09-12T18:13:23.430494+0000","last_clean":"2024-09-12T18:13:23.430494+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:23.430494+0000","last_undegraded":"2024-09-12T18:13:23.430494+0000","last_fullsized":"2024-09-12T18:13:23.430494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:12.691639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405125+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:24.405125+0000","last_peered":"2024-09-12T18:13:24.405125+0000","last_clean":"2024-09-12T18:13:24.405125+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:24.405125+0000","last_undegraded":"2024-09-12T18:13:24.405125+0000","last_fullsized":"2024-09-12T18:13:24.405125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404568+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:24.404568+0000","last_peered":"2024-09-12T18:13:24.404568+0000","last_clean":"2024-09-12T18:13:24.404568+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:24.404568+0000","last_undegraded":"2024-09-12T18:13:24.404568+0000","last_fullsized":"2024-09-12T18:13:24.404568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404645+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:24.404645+0000","last_peered":"2024-09-12T18:13:24.404645+0000","last_clean":"2024-09-12T18:13:24.404645+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:24.404645+0000","last_undegraded":"2024-09-12T18:13:24.404645+0000","last_fullsized":"2024-09-12T18:13:24.404645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423981+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:23.423981+0000","last_peered":"2024-09-12T18:13:23.423981+0000","last_clean":"2024-09-12T18:13:23.423981+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:23.423981+0000","last_undegraded":"2024-09-12T18:13:23.423981+0000","last_fullsized":"2024-09-12T18:13:23.423981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:23.264843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402995+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:24.402995+0000","last_peered":"2024-09-12T18:13:24.402995+0000","last_clean":"2024-09-12T18:13:24.402995+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:24.402995+0000","last_undegraded":"2024-09-12T18:13:24.402995+0000","last_fullsized":"2024-09-12T18:13:24.402995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.428659+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:23.428659+0000","last_peered":"2024-09-12T18:13:23.428659+0000","last_clean":"2024-09-12T18:13:23.428659+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:23.428659+0000","last_undegraded":"2024-09-12T18:13:23.428659+0000","last_fullsized":"2024-09-12T18:13:23.428659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.841313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.433470+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:23.433470+0000","last_peered":"2024-09-12T18:13:23.433470+0000","last_clean":"2024-09-12T18:13:23.433470+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:23.433470+0000","last_undegraded":"2024-09-12T18:13:23.433470+0000","last_fullsized":"2024-09-12T18:13:23.433470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:19.942418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405444+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:24.405444+0000","last_peered":"2024-09-12T18:13:24.405444+0000","last_clean":"2024-09-12T18:13:24.405444+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:24.405444+0000","last_undegraded":"2024-09-12T18:13:24.405444+0000","last_fullsized":"2024-09-12T18:13:24.405444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405864+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:24.405864+0000","last_peered":"2024-09-12T18:13:24.405864+0000","last_clean":"2024-09-12T18:13:24.405864+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:24.405864+0000","last_undegraded":"2024-09-12T18:13:24.405864+0000","last_fullsized":"2024-09-12T18:13:24.405864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.428457+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:23.428457+0000","last_peered":"2024-09-12T18:13:23.428457+0000","last_clean":"2024-09-12T18:13:23.428457+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:23.428457+0000","last_undegraded":"2024-09-12T18:13:23.428457+0000","last_fullsized":"2024-09-12T18:13:23.428457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.722700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404239+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:24.404239+0000","last_peered":"2024-09-12T18:13:24.404239+0000","last_clean":"2024-09-12T18:13:24.404239+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:24.404239+0000","last_undegraded":"2024-09-12T18:13:24.404239+0000","last_fullsized":"2024-09-12T18:13:24.404239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.424042+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:23.424042+0000","last_peered":"2024-09-12T18:13:23.424042+0000","last_clean":"2024-09-12T18:13:23.424042+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:23.424042+0000","last_undegraded":"2024-09-12T18:13:23.424042+0000","last_fullsized":"2024-09-12T18:13:23.424042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:15.365795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403084+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:24.403084+0000","last_peered":"2024-09-12T18:13:24.403084+0000","last_clean":"2024-09-12T18:13:24.403084+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:24.403084+0000","last_undegraded":"2024-09-12T18:13:24.403084+0000","last_fullsized":"2024-09-12T18:13:24.403084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402939+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:24.402939+0000","last_peered":"2024-09-12T18:13:24.402939+0000","last_clean":"2024-09-12T18:13:24.402939+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:24.402939+0000","last_undegraded":"2024-09-12T18:13:24.402939+0000","last_fullsized":"2024-09-12T18:13:24.402939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.416922+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:23.416922+0000","last_peered":"2024-09-12T18:13:23.416922+0000","last_clean":"2024-09-12T18:13:23.416922+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:23.416922+0000","last_undegraded":"2024-09-12T18:13:23.416922+0000","last_fullsized":"2024-09-12T18:13:23.416922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:14.047154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404022+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:24.404022+0000","last_peered":"2024-09-12T18:13:24.404022+0000","last_clean":"2024-09-12T18:13:24.404022+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:24.404022+0000","last_undegraded":"2024-09-12T18:13:24.404022+0000","last_fullsized":"2024-09-12T18:13:24.404022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430295+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:23.430295+0000","last_peered":"2024-09-12T18:13:23.430295+0000","last_clean":"2024-09-12T18:13:23.430295+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:23.430295+0000","last_undegraded":"2024-09-12T18:13:23.430295+0000","last_fullsized":"2024-09-12T18:13:23.430295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:01.666019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403579+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:24.403579+0000","last_peered":"2024-09-12T18:13:24.403579+0000","last_clean":"2024-09-12T18:13:24.403579+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:24.403579+0000","last_undegraded":"2024-09-12T18:13:24.403579+0000","last_fullsized":"2024-09-12T18:13:24.403579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406244+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:24.406244+0000","last_peered":"2024-09-12T18:13:24.406244+0000","last_clean":"2024-09-12T18:13:24.406244+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:24.406244+0000","last_undegraded":"2024-09-12T18:13:24.406244+0000","last_fullsized":"2024-09-12T18:13:24.406244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.406884+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:23.406884+0000","last_peered":"2024-09-12T18:13:23.406884+0000","last_clean":"2024-09-12T18:13:23.406884+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:23.406884+0000","last_undegraded":"2024-09-12T18:13:23.406884+0000","last_fullsized":"2024-09-12T18:13:23.406884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405254+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:24.405254+0000","last_peered":"2024-09-12T18:13:24.405254+0000","last_clean":"2024-09-12T18:13:24.405254+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:24.405254+0000","last_undegraded":"2024-09-12T18:13:24.405254+0000","last_fullsized":"2024-09-12T18:13:24.405254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404648+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:24.404648+0000","last_peered":"2024-09-12T18:13:24.404648+0000","last_clean":"2024-09-12T18:13:24.404648+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:24.404648+0000","last_undegraded":"2024-09-12T18:13:24.404648+0000","last_fullsized":"2024-09-12T18:13:24.404648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404076+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:24.404076+0000","last_peered":"2024-09-12T18:13:24.404076+0000","last_clean":"2024-09-12T18:13:24.404076+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:24.404076+0000","last_undegraded":"2024-09-12T18:13:24.404076+0000","last_fullsized":"2024-09-12T18:13:24.404076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.427414+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:23.427414+0000","last_peered":"2024-09-12T18:13:23.427414+0000","last_clean":"2024-09-12T18:13:23.427414+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:23.427414+0000","last_undegraded":"2024-09-12T18:13:23.427414+0000","last_fullsized":"2024-09-12T18:13:23.427414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:51.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.431666+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:23.431666+0000","last_peered":"2024-09-12T18:13:23.431666+0000","last_clean":"2024-09-12T18:13:23.431666+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:23.431666+0000","last_undegraded":"2024-09-12T18:13:23.431666+0000","last_fullsized":"2024-09-12T18:13:23.431666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423115+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:23.423115+0000","last_peered":"2024-09-12T18:13:23.423115+0000","last_clean":"2024-09-12T18:13:23.423115+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:23.423115+0000","last_undegraded":"2024-09-12T18:13:23.423115+0000","last_fullsized":"2024-09-12T18:13:23.423115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.165975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406376+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:24.406376+0000","last_peered":"2024-09-12T18:13:24.406376+0000","last_clean":"2024-09-12T18:13:24.406376+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:24.406376+0000","last_undegraded":"2024-09-12T18:13:24.406376+0000","last_fullsized":"2024-09-12T18:13:24.406376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405083+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:24.405083+0000","last_peered":"2024-09-12T18:13:24.405083+0000","last_clean":"2024-09-12T18:13:24.405083+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:24.405083+0000","last_undegraded":"2024-09-12T18:13:24.405083+0000","last_fullsized":"2024-09-12T18:13:24.405083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405705+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:24.405705+0000","last_peered":"2024-09-12T18:13:24.405705+0000","last_clean":"2024-09-12T18:13:24.405705+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:24.405705+0000","last_undegraded":"2024-09-12T18:13:24.405705+0000","last_fullsized":"2024-09-12T18:13:24.405705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404473+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:24.404473+0000","last_peered":"2024-09-12T18:13:24.404473+0000","last_clean":"2024-09-12T18:13:24.404473+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:24.404473+0000","last_undegraded":"2024-09-12T18:13:24.404473+0000","last_fullsized":"2024-09-12T18:13:24.404473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404770+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:24.404770+0000","last_peered":"2024-09-12T18:13:24.404770+0000","last_clean":"2024-09-12T18:13:24.404770+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:24.404770+0000","last_undegraded":"2024-09-12T18:13:24.404770+0000","last_fullsized":"2024-09-12T18:13:24.404770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404793+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:24.404793+0000","last_peered":"2024-09-12T18:13:24.404793+0000","last_clean":"2024-09-12T18:13:24.404793+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:24.404793+0000","last_undegraded":"2024-09-12T18:13:24.404793+0000","last_fullsized":"2024-09-12T18:13:24.404793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405933+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:24.405933+0000","last_peered":"2024-09-12T18:13:24.405933+0000","last_clean":"2024-09-12T18:13:24.405933+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:24.405933+0000","last_undegraded":"2024-09-12T18:13:24.405933+0000","last_fullsized":"2024-09-12T18:13:24.405933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406083+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:24.406083+0000","last_peered":"2024-09-12T18:13:24.406083+0000","last_clean":"2024-09-12T18:13:24.406083+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:24.406083+0000","last_undegraded":"2024-09-12T18:13:24.406083+0000","last_fullsized":"2024-09-12T18:13:24.406083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.407697+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:23.407697+0000","last_peered":"2024-09-12T18:13:23.407697+0000","last_clean":"2024-09-12T18:13:23.407697+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:23.407697+0000","last_undegraded":"2024-09-12T18:13:23.407697+0000","last_fullsized":"2024-09-12T18:13:23.407697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404220+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:24.404220+0000","last_peered":"2024-09-12T18:13:24.404220+0000","last_clean":"2024-09-12T18:13:24.404220+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:24.404220+0000","last_undegraded":"2024-09-12T18:13:24.404220+0000","last_fullsized":"2024-09-12T18:13:24.404220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.412462+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:23.412462+0000","last_peered":"2024-09-12T18:13:23.412462+0000","last_clean":"2024-09-12T18:13:23.412462+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:23.412462+0000","last_undegraded":"2024-09-12T18:13:23.412462+0000","last_fullsized":"2024-09-12T18:13:23.412462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405577+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:24.405577+0000","last_peered":"2024-09-12T18:13:24.405577+0000","last_clean":"2024-09-12T18:13:24.405577+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:24.405577+0000","last_undegraded":"2024-09-12T18:13:24.405577+0000","last_fullsized":"2024-09-12T18:13:24.405577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405753+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:24.405753+0000","last_peered":"2024-09-12T18:13:24.405753+0000","last_clean":"2024-09-12T18:13:24.405753+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:24.405753+0000","last_undegraded":"2024-09-12T18:13:24.405753+0000","last_fullsized":"2024-09-12T18:13:24.405753+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404857+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:24.404857+0000","last_peered":"2024-09-12T18:13:24.404857+0000","last_clean":"2024-09-12T18:13:24.404857+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:24.404857+0000","last_undegraded":"2024-09-12T18:13:24.404857+0000","last_fullsized":"2024-09-12T18:13:24.404857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403879+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:24.403879+0000","last_peered":"2024-09-12T18:13:24.403879+0000","last_clean":"2024-09-12T18:13:24.403879+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:24.403879+0000","last_undegraded":"2024-09-12T18:13:24.403879+0000","last_fullsized":"2024-09-12T18:13:24.403879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406423+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:24.406423+0000","last_peered":"2024-09-12T18:13:24.406423+0000","last_clean":"2024-09-12T18:13:24.406423+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:24.406423+0000","last_undegraded":"2024-09-12T18:13:24.406423+0000","last_fullsized":"2024-09-12T18:13:24.406423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404932+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:24.404932+0000","last_peered":"2024-09-12T18:13:24.404932+0000","last_clean":"2024-09-12T18:13:24.404932+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:24.404932+0000","last_undegraded":"2024-09-12T18:13:24.404932+0000","last_fullsized":"2024-09-12T18:13:24.404932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403887+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:24.403887+0000","last_peered":"2024-09-12T18:13:24.403887+0000","last_clean":"2024-09-12T18:13:24.403887+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:24.403887+0000","last_undegraded":"2024-09-12T18:13:24.403887+0000","last_fullsized":"2024-09-12T18:13:24.403887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430412+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:23.430412+0000","last_peered":"2024-09-12T18:13:23.430412+0000","last_clean":"2024-09-12T18:13:23.430412+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:23.430412+0000","last_undegraded":"2024-09-12T18:13:23.430412+0000","last_fullsized":"2024-09-12T18:13:23.430412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:21.373920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404097+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:24.404097+0000","last_peered":"2024-09-12T18:13:24.404097+0000","last_clean":"2024-09-12T18:13:24.404097+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:24.404097+0000","last_undegraded":"2024-09-12T18:13:24.404097+0000","last_fullsized":"2024-09-12T18:13:24.404097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.406945+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:23.406945+0000","last_peered":"2024-09-12T18:13:23.406945+0000","last_clean":"2024-09-12T18:13:23.406945+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:23.406945+0000","last_undegraded":"2024-09-12T18:13:23.406945+0000","last_fullsized":"2024-09-12T18:13:23.406945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405620+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:24.405620+0000","last_peered":"2024-09-12T18:13:24.405620+0000","last_clean":"2024-09-12T18:13:24.405620+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:24.405620+0000","last_undegraded":"2024-09-12T18:13:24.405620+0000","last_fullsized":"2024-09-12T18:13:24.405620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406060+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:24.406060+0000","last_peered":"2024-09-12T18:13:24.406060+0000","last_clean":"2024-09-12T18:13:24.406060+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:24.406060+0000","last_undegraded":"2024-09-12T18:13:24.406060+0000","last_fullsized":"2024-09-12T18:13:24.406060+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404645+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:24.404645+0000","last_peered":"2024-09-12T18:13:24.404645+0000","last_clean":"2024-09-12T18:13:24.404645+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:24.404645+0000","last_undegraded":"2024-09-12T18:13:24.404645+0000","last_fullsized":"2024-09-12T18:13:24.404645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405066+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:24.405066+0000","last_peered":"2024-09-12T18:13:24.405066+0000","last_clean":"2024-09-12T18:13:24.405066+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:24.405066+0000","last_undegraded":"2024-09-12T18:13:24.405066+0000","last_fullsized":"2024-09-12T18:13:24.405066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406576+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:24.406576+0000","last_peered":"2024-09-12T18:13:24.406576+0000","last_clean":"2024-09-12T18:13:24.406576+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:24.406576+0000","last_undegraded":"2024-09-12T18:13:24.406576+0000","last_fullsized":"2024-09-12T18:13:24.406576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405012+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:24.405012+0000","last_peered":"2024-09-12T18:13:24.405012+0000","last_clean":"2024-09-12T18:13:24.405012+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:24.405012+0000","last_undegraded":"2024-09-12T18:13:24.405012+0000","last_fullsized":"2024-09-12T18:13:24.405012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423913+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:23.423913+0000","last_peered":"2024-09-12T18:13:23.423913+0000","last_clean":"2024-09-12T18:13:23.423913+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:23.423913+0000","last_undegraded":"2024-09-12T18:13:23.423913+0000","last_fullsized":"2024-09-12T18:13:23.423913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:01.598467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404880+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:24.404880+0000","last_peered":"2024-09-12T18:13:24.404880+0000","last_clean":"2024-09-12T18:13:24.404880+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:24.404880+0000","last_undegraded":"2024-09-12T18:13:24.404880+0000","last_fullsized":"2024-09-12T18:13:24.404880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.413390+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:23.413390+0000","last_peered":"2024-09-12T18:13:23.413390+0000","last_clean":"2024-09-12T18:13:23.413390+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:23.413390+0000","last_undegraded":"2024-09-12T18:13:23.413390+0000","last_fullsized":"2024-09-12T18:13:23.413390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.424895+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:23.424895+0000","last_peered":"2024-09-12T18:13:23.424895+0000","last_clean":"2024-09-12T18:13:23.424895+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:23.424895+0000","last_undegraded":"2024-09-12T18:13:23.424895+0000","last_fullsized":"2024-09-12T18:13:23.424895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:37.846742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406253+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:24.406253+0000","last_peered":"2024-09-12T18:13:24.406253+0000","last_clean":"2024-09-12T18:13:24.406253+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:24.406253+0000","last_undegraded":"2024-09-12T18:13:24.406253+0000","last_fullsized":"2024-09-12T18:13:24.406253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406329+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:24.406329+0000","last_peered":"2024-09-12T18:13:24.406329+0000","last_clean":"2024-09-12T18:13:24.406329+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:24.406329+0000","last_undegraded":"2024-09-12T18:13:24.406329+0000","last_fullsized":"2024-09-12T18:13:24.406329+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403077+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:24.403077+0000","last_peered":"2024-09-12T18:13:24.403077+0000","last_clean":"2024-09-12T18:13:24.403077+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:24.403077+0000","last_undegraded":"2024-09-12T18:13:24.403077+0000","last_fullsized":"2024-09-12T18:13:24.403077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.390721+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:25.390721+0000","last_peered":"2024-09-12T18:13:25.390721+0000","last_clean":"2024-09-12T18:13:25.390721+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:25.390721+0000","last_undegraded":"2024-09-12T18:13:25.390721+0000","last_fullsized":"2024-09-12T18:13:25.390721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404093+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:24.404093+0000","last_peered":"2024-09-12T18:13:24.404093+0000","last_clean":"2024-09-12T18:13:24.404093+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:24.404093+0000","last_undegraded":"2024-09-12T18:13:24.404093+0000","last_fullsized":"2024-09-12T18:13:24.404093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.424912+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:23.424912+0000","last_peered":"2024-09-12T18:13:23.424912+0000","last_clean":"2024-09-12T18:13:23.424912+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:23.424912+0000","last_undegraded":"2024-09-12T18:13:23.424912+0000","last_fullsized":"2024-09-12T18:13:23.424912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:53.816463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403691+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:24.403691+0000","last_peered":"2024-09-12T18:13:24.403691+0000","last_clean":"2024-09-12T18:13:24.403691+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:24.403691+0000","last_undegraded":"2024-09-12T18:13:24.403691+0000","last_fullsized":"2024-09-12T18:13:24.403691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405078+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:24.405078+0000","last_peered":"2024-09-12T18:13:24.405078+0000","last_clean":"2024-09-12T18:13:24.405078+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:24.405078+0000","last_undegraded":"2024-09-12T18:13:24.405078+0000","last_fullsized":"2024-09-12T18:13:24.405078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403374+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:24.403374+0000","last_peered":"2024-09-12T18:13:24.403374+0000","last_clean":"2024-09-12T18:13:24.403374+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:24.403374+0000","last_undegraded":"2024-09-12T18:13:24.403374+0000","last_fullsized":"2024-09-12T18:13:24.403374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.434528+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:23.434528+0000","last_peered":"2024-09-12T18:13:23.434528+0000","last_clean":"2024-09-12T18:13:23.434528+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:23.434528+0000","last_undegraded":"2024-09-12T18:13:23.434528+0000","last_fullsized":"2024-09-12T18:13:23.434528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404156+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:24.404156+0000","last_peered":"2024-09-12T18:13:24.404156+0000","last_clean":"2024-09-12T18:13:24.404156+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:24.404156+0000","last_undegraded":"2024-09-12T18:13:24.404156+0000","last_fullsized":"2024-09-12T18:13:24.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403589+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:24.403589+0000","last_peered":"2024-09-12T18:13:24.403589+0000","last_clean":"2024-09-12T18:13:24.403589+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:24.403589+0000","last_undegraded":"2024-09-12T18:13:24.403589+0000","last_fullsized":"2024-09-12T18:13:24.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405981+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:24.405981+0000","last_peered":"2024-09-12T18:13:24.405981+0000","last_clean":"2024-09-12T18:13:24.405981+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:24.405981+0000","last_undegraded":"2024-09-12T18:13:24.405981+0000","last_fullsized":"2024-09-12T18:13:24.405981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403044+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:24.403044+0000","last_peered":"2024-09-12T18:13:24.403044+0000","last_clean":"2024-09-12T18:13:24.403044+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:24.403044+0000","last_undegraded":"2024-09-12T18:13:24.403044+0000","last_fullsized":"2024-09-12T18:13:24.403044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.426382+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:23.426382+0000","last_peered":"2024-09-12T18:13:23.426382+0000","last_clean":"2024-09-12T18:13:23.426382+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:23.426382+0000","last_undegraded":"2024-09-12T18:13:23.426382+0000","last_fullsized":"2024-09-12T18:13:23.426382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:16.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403315+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:24.403315+0000","last_peered":"2024-09-12T18:13:24.403315+0000","last_clean":"2024-09-12T18:13:24.403315+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:24.403315+0000","last_undegraded":"2024-09-12T18:13:24.403315+0000","last_fullsized":"2024-09-12T18:13:24.403315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405753+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:24.405753+0000","last_peered":"2024-09-12T18:13:24.405753+0000","last_clean":"2024-09-12T18:13:24.405753+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:24.405753+0000","last_undegraded":"2024-09-12T18:13:24.405753+0000","last_fullsized":"2024-09-12T18:13:24.405753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403613+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:24.403613+0000","last_peered":"2024-09-12T18:13:24.403613+0000","last_clean":"2024-09-12T18:13:24.403613+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:24.403613+0000","last_undegraded":"2024-09-12T18:13:24.403613+0000","last_fullsized":"2024-09-12T18:13:24.403613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.433975+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:23.433975+0000","last_peered":"2024-09-12T18:13:23.433975+0000","last_clean":"2024-09-12T18:13:23.433975+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:23.433975+0000","last_undegraded":"2024-09-12T18:13:23.433975+0000","last_fullsized":"2024-09-12T18:13:23.433975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:21.164974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.427739+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:23.427739+0000","last_peered":"2024-09-12T18:13:23.427739+0000","last_clean":"2024-09-12T18:13:23.427739+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:23.427739+0000","last_undegraded":"2024-09-12T18:13:23.427739+0000","last_fullsized":"2024-09-12T18:13:23.427739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430391+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:23.430391+0000","last_peered":"2024-09-12T18:13:23.430391+0000","last_clean":"2024-09-12T18:13:23.430391+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:23.430391+0000","last_undegraded":"2024-09-12T18:13:23.430391+0000","last_fullsized":"2024-09-12T18:13:23.430391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:01.502777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430600+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:23.430600+0000","last_peered":"2024-09-12T18:13:23.430600+0000","last_clean":"2024-09-12T18:13:23.430600+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:23.430600+0000","last_undegraded":"2024-09-12T18:13:23.430600+0000","last_fullsized":"2024-09-12T18:13:23.430600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403182+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:24.403182+0000","last_peered":"2024-09-12T18:13:24.403182+0000","last_clean":"2024-09-12T18:13:24.403182+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:24.403182+0000","last_undegraded":"2024-09-12T18:13:24.403182+0000","last_fullsized":"2024-09-12T18:13:24.403182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404882+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:24.404882+0000","last_peered":"2024-09-12T18:13:24.404882+0000","last_clean":"2024-09-12T18:13:24.404882+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:24.404882+0000","last_undegraded":"2024-09-12T18:13:24.404882+0000","last_fullsized":"2024-09-12T18:13:24.404882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405114+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:24.405114+0000","last_peered":"2024-09-12T18:13:24.405114+0000","last_clean":"2024-09-12T18:13:24.405114+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:24.405114+0000","last_undegraded":"2024-09-12T18:13:24.405114+0000","last_fullsized":"2024-09-12T18:13:24.405114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.434440+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:23.434440+0000","last_peered":"2024-09-12T18:13:23.434440+0000","last_clean":"2024-09-12T18:13:23.434440+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:23.434440+0000","last_undegraded":"2024-09-12T18:13:23.434440+0000","last_fullsized":"2024-09-12T18:13:23.434440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423030+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:23.423030+0000","last_peered":"2024-09-12T18:13:23.423030+0000","last_clean":"2024-09-12T18:13:23.423030+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:23.423030+0000","last_undegraded":"2024-09-12T18:13:23.423030+0000","last_fullsized":"2024-09-12T18:13:23.423030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:36.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406091+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:24.406091+0000","last_peered":"2024-09-12T18:13:24.406091+0000","last_clean":"2024-09-12T18:13:24.406091+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:24.406091+0000","last_undegraded":"2024-09-12T18:13:24.406091+0000","last_fullsized":"2024-09-12T18:13:24.406091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405738+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:24.405738+0000","last_peered":"2024-09-12T18:13:24.405738+0000","last_clean":"2024-09-12T18:13:24.405738+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:24.405738+0000","last_undegraded":"2024-09-12T18:13:24.405738+0000","last_fullsized":"2024-09-12T18:13:24.405738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405729+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:24.405729+0000","last_peered":"2024-09-12T18:13:24.405729+0000","last_clean":"2024-09-12T18:13:24.405729+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:24.405729+0000","last_undegraded":"2024-09-12T18:13:24.405729+0000","last_fullsized":"2024-09-12T18:13:24.405729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":651803,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":646537,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:27.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:28.116 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:28.117 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:28.133 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:13:26.335961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90064,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025456,"statfs":{"total":289910292480,"available":289818066944,"internally_reserved":0,"allocated":671744,"data_stored":1357981,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001030"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.429070+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:23.429070+0000","last_peered":"2024-09-12T18:13:23.429070+0000","last_clean":"2024-09-12T18:13:23.429070+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:23.429070+0000","last_undegraded":"2024-09-12T18:13:23.429070+0000","last_fullsized":"2024-09-12T18:13:23.429070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:24.321634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.431925+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:23.431925+0000","last_peered":"2024-09-12T18:13:23.431925+0000","last_clean":"2024-09-12T18:13:23.431925+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:23.431925+0000","last_undegraded":"2024-09-12T18:13:23.431925+0000","last_fullsized":"2024-09-12T18:13:23.431925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:57.317766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403792+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:24.403792+0000","last_peered":"2024-09-12T18:13:24.403792+0000","last_clean":"2024-09-12T18:13:24.403792+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:24.403792+0000","last_undegraded":"2024-09-12T18:13:24.403792+0000","last_fullsized":"2024-09-12T18:13:24.403792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403938+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:24.403938+0000","last_peered":"2024-09-12T18:13:24.403938+0000","last_clean":"2024-09-12T18:13:24.403938+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:24.403938+0000","last_undegraded":"2024-09-12T18:13:24.403938+0000","last_fullsized":"2024-09-12T18:13:24.403938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.416293+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:23.416293+0000","last_peered":"2024-09-12T18:13:23.416293+0000","last_clean":"2024-09-12T18:13:23.416293+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:23.416293+0000","last_undegraded":"2024-09-12T18:13:23.416293+0000","last_fullsized":"2024-09-12T18:13:23.416293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:42.614792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403296+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:24.403296+0000","last_peered":"2024-09-12T18:13:24.403296+0000","last_clean":"2024-09-12T18:13:24.403296+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:24.403296+0000","last_undegraded":"2024-09-12T18:13:24.403296+0000","last_fullsized":"2024-09-12T18:13:24.403296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402912+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:24.402912+0000","last_peered":"2024-09-12T18:13:24.402912+0000","last_clean":"2024-09-12T18:13:24.402912+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:24.402912+0000","last_undegraded":"2024-09-12T18:13:24.402912+0000","last_fullsized":"2024-09-12T18:13:24.402912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402261+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:24.402261+0000","last_peered":"2024-09-12T18:13:24.402261+0000","last_clean":"2024-09-12T18:13:24.402261+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:24.402261+0000","last_undegraded":"2024-09-12T18:13:24.402261+0000","last_fullsized":"2024-09-12T18:13:24.402261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405280+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:24.405280+0000","last_peered":"2024-09-12T18:13:24.405280+0000","last_clean":"2024-09-12T18:13:24.405280+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:24.405280+0000","last_undegraded":"2024-09-12T18:13:24.405280+0000","last_fullsized":"2024-09-12T18:13:24.405280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.431864+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:23.431864+0000","last_peered":"2024-09-12T18:13:23.431864+0000","last_clean":"2024-09-12T18:13:23.431864+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:23.431864+0000","last_undegraded":"2024-09-12T18:13:23.431864+0000","last_fullsized":"2024-09-12T18:13:23.431864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:51.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404742+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:24.404742+0000","last_peered":"2024-09-12T18:13:24.404742+0000","last_clean":"2024-09-12T18:13:24.404742+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:24.404742+0000","last_undegraded":"2024-09-12T18:13:24.404742+0000","last_fullsized":"2024-09-12T18:13:24.404742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.428728+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:23.428728+0000","last_peered":"2024-09-12T18:13:23.428728+0000","last_clean":"2024-09-12T18:13:23.428728+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:23.428728+0000","last_undegraded":"2024-09-12T18:13:23.428728+0000","last_fullsized":"2024-09-12T18:13:23.428728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:50.691334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.426526+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:23.426526+0000","last_peered":"2024-09-12T18:13:23.426526+0000","last_clean":"2024-09-12T18:13:23.426526+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:23.426526+0000","last_undegraded":"2024-09-12T18:13:23.426526+0000","last_fullsized":"2024-09-12T18:13:23.426526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.512380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403486+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:24.403486+0000","last_peered":"2024-09-12T18:13:24.403486+0000","last_clean":"2024-09-12T18:13:24.403486+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:24.403486+0000","last_undegraded":"2024-09-12T18:13:24.403486+0000","last_fullsized":"2024-09-12T18:13:24.403486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402696+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:24.402696+0000","last_peered":"2024-09-12T18:13:24.402696+0000","last_clean":"2024-09-12T18:13:24.402696+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:24.402696+0000","last_undegraded":"2024-09-12T18:13:24.402696+0000","last_fullsized":"2024-09-12T18:13:24.402696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402432+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:24.402432+0000","last_peered":"2024-09-12T18:13:24.402432+0000","last_clean":"2024-09-12T18:13:24.402432+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:24.402432+0000","last_undegraded":"2024-09-12T18:13:24.402432+0000","last_fullsized":"2024-09-12T18:13:24.402432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406118+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:24.406118+0000","last_peered":"2024-09-12T18:13:24.406118+0000","last_clean":"2024-09-12T18:13:24.406118+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:24.406118+0000","last_undegraded":"2024-09-12T18:13:24.406118+0000","last_fullsized":"2024-09-12T18:13:24.406118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430494+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:23.430494+0000","last_peered":"2024-09-12T18:13:23.430494+0000","last_clean":"2024-09-12T18:13:23.430494+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:23.430494+0000","last_undegraded":"2024-09-12T18:13:23.430494+0000","last_fullsized":"2024-09-12T18:13:23.430494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:12.691639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405125+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:24.405125+0000","last_peered":"2024-09-12T18:13:24.405125+0000","last_clean":"2024-09-12T18:13:24.405125+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:24.405125+0000","last_undegraded":"2024-09-12T18:13:24.405125+0000","last_fullsized":"2024-09-12T18:13:24.405125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404568+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:24.404568+0000","last_peered":"2024-09-12T18:13:24.404568+0000","last_clean":"2024-09-12T18:13:24.404568+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:24.404568+0000","last_undegraded":"2024-09-12T18:13:24.404568+0000","last_fullsized":"2024-09-12T18:13:24.404568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404645+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:24.404645+0000","last_peered":"2024-09-12T18:13:24.404645+0000","last_clean":"2024-09-12T18:13:24.404645+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:24.404645+0000","last_undegraded":"2024-09-12T18:13:24.404645+0000","last_fullsized":"2024-09-12T18:13:24.404645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423981+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:23.423981+0000","last_peered":"2024-09-12T18:13:23.423981+0000","last_clean":"2024-09-12T18:13:23.423981+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:23.423981+0000","last_undegraded":"2024-09-12T18:13:23.423981+0000","last_fullsized":"2024-09-12T18:13:23.423981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:23.264843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402995+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:24.402995+0000","last_peered":"2024-09-12T18:13:24.402995+0000","last_clean":"2024-09-12T18:13:24.402995+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:24.402995+0000","last_undegraded":"2024-09-12T18:13:24.402995+0000","last_fullsized":"2024-09-12T18:13:24.402995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.428659+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:23.428659+0000","last_peered":"2024-09-12T18:13:23.428659+0000","last_clean":"2024-09-12T18:13:23.428659+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:23.428659+0000","last_undegraded":"2024-09-12T18:13:23.428659+0000","last_fullsized":"2024-09-12T18:13:23.428659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:54.841313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.433470+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:23.433470+0000","last_peered":"2024-09-12T18:13:23.433470+0000","last_clean":"2024-09-12T18:13:23.433470+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:23.433470+0000","last_undegraded":"2024-09-12T18:13:23.433470+0000","last_fullsized":"2024-09-12T18:13:23.433470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:19.942418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405444+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:24.405444+0000","last_peered":"2024-09-12T18:13:24.405444+0000","last_clean":"2024-09-12T18:13:24.405444+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:24.405444+0000","last_undegraded":"2024-09-12T18:13:24.405444+0000","last_fullsized":"2024-09-12T18:13:24.405444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405864+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:24.405864+0000","last_peered":"2024-09-12T18:13:24.405864+0000","last_clean":"2024-09-12T18:13:24.405864+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:24.405864+0000","last_undegraded":"2024-09-12T18:13:24.405864+0000","last_fullsized":"2024-09-12T18:13:24.405864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.428457+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:23.428457+0000","last_peered":"2024-09-12T18:13:23.428457+0000","last_clean":"2024-09-12T18:13:23.428457+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:23.428457+0000","last_undegraded":"2024-09-12T18:13:23.428457+0000","last_fullsized":"2024-09-12T18:13:23.428457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:34.722700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404239+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:24.404239+0000","last_peered":"2024-09-12T18:13:24.404239+0000","last_clean":"2024-09-12T18:13:24.404239+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:24.404239+0000","last_undegraded":"2024-09-12T18:13:24.404239+0000","last_fullsized":"2024-09-12T18:13:24.404239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.424042+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:23.424042+0000","last_peered":"2024-09-12T18:13:23.424042+0000","last_clean":"2024-09-12T18:13:23.424042+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:23.424042+0000","last_undegraded":"2024-09-12T18:13:23.424042+0000","last_fullsized":"2024-09-12T18:13:23.424042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:15.365795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403084+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:24.403084+0000","last_peered":"2024-09-12T18:13:24.403084+0000","last_clean":"2024-09-12T18:13:24.403084+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:24.403084+0000","last_undegraded":"2024-09-12T18:13:24.403084+0000","last_fullsized":"2024-09-12T18:13:24.403084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.402939+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:24.402939+0000","last_peered":"2024-09-12T18:13:24.402939+0000","last_clean":"2024-09-12T18:13:24.402939+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:24.402939+0000","last_undegraded":"2024-09-12T18:13:24.402939+0000","last_fullsized":"2024-09-12T18:13:24.402939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.416922+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:23.416922+0000","last_peered":"2024-09-12T18:13:23.416922+0000","last_clean":"2024-09-12T18:13:23.416922+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:23.416922+0000","last_undegraded":"2024-09-12T18:13:23.416922+0000","last_fullsized":"2024-09-12T18:13:23.416922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:14.047154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404022+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:24.404022+0000","last_peered":"2024-09-12T18:13:24.404022+0000","last_clean":"2024-09-12T18:13:24.404022+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:24.404022+0000","last_undegraded":"2024-09-12T18:13:24.404022+0000","last_fullsized":"2024-09-12T18:13:24.404022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430295+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:23.430295+0000","last_peered":"2024-09-12T18:13:23.430295+0000","last_clean":"2024-09-12T18:13:23.430295+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:23.430295+0000","last_undegraded":"2024-09-12T18:13:23.430295+0000","last_fullsized":"2024-09-12T18:13:23.430295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:01.666019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403579+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:24.403579+0000","last_peered":"2024-09-12T18:13:24.403579+0000","last_clean":"2024-09-12T18:13:24.403579+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:24.403579+0000","last_undegraded":"2024-09-12T18:13:24.403579+0000","last_fullsized":"2024-09-12T18:13:24.403579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406244+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:24.406244+0000","last_peered":"2024-09-12T18:13:24.406244+0000","last_clean":"2024-09-12T18:13:24.406244+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:24.406244+0000","last_undegraded":"2024-09-12T18:13:24.406244+0000","last_fullsized":"2024-09-12T18:13:24.406244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.406884+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:23.406884+0000","last_peered":"2024-09-12T18:13:23.406884+0000","last_clean":"2024-09-12T18:13:23.406884+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:23.406884+0000","last_undegraded":"2024-09-12T18:13:23.406884+0000","last_fullsized":"2024-09-12T18:13:23.406884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405254+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:24.405254+0000","last_peered":"2024-09-12T18:13:24.405254+0000","last_clean":"2024-09-12T18:13:24.405254+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:24.405254+0000","last_undegraded":"2024-09-12T18:13:24.405254+0000","last_fullsized":"2024-09-12T18:13:24.405254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404648+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:24.404648+0000","last_peered":"2024-09-12T18:13:24.404648+0000","last_clean":"2024-09-12T18:13:24.404648+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:24.404648+0000","last_undegraded":"2024-09-12T18:13:24.404648+0000","last_fullsized":"2024-09-12T18:13:24.404648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404076+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:24.404076+0000","last_peered":"2024-09-12T18:13:24.404076+0000","last_clean":"2024-09-12T18:13:24.404076+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:24.404076+0000","last_undegraded":"2024-09-12T18:13:24.404076+0000","last_fullsized":"2024-09-12T18:13:24.404076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.427414+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:23.427414+0000","last_peered":"2024-09-12T18:13:23.427414+0000","last_clean":"2024-09-12T18:13:23.427414+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:23.427414+0000","last_undegraded":"2024-09-12T18:13:23.427414+0000","last_fullsized":"2024-09-12T18:13:23.427414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:51.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.431666+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:23.431666+0000","last_peered":"2024-09-12T18:13:23.431666+0000","last_clean":"2024-09-12T18:13:23.431666+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:23.431666+0000","last_undegraded":"2024-09-12T18:13:23.431666+0000","last_fullsized":"2024-09-12T18:13:23.431666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423115+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:23.423115+0000","last_peered":"2024-09-12T18:13:23.423115+0000","last_clean":"2024-09-12T18:13:23.423115+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:23.423115+0000","last_undegraded":"2024-09-12T18:13:23.423115+0000","last_fullsized":"2024-09-12T18:13:23.423115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:55.165975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406376+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:24.406376+0000","last_peered":"2024-09-12T18:13:24.406376+0000","last_clean":"2024-09-12T18:13:24.406376+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:24.406376+0000","last_undegraded":"2024-09-12T18:13:24.406376+0000","last_fullsized":"2024-09-12T18:13:24.406376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405083+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:24.405083+0000","last_peered":"2024-09-12T18:13:24.405083+0000","last_clean":"2024-09-12T18:13:24.405083+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:24.405083+0000","last_undegraded":"2024-09-12T18:13:24.405083+0000","last_fullsized":"2024-09-12T18:13:24.405083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405705+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:24.405705+0000","last_peered":"2024-09-12T18:13:24.405705+0000","last_clean":"2024-09-12T18:13:24.405705+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:24.405705+0000","last_undegraded":"2024-09-12T18:13:24.405705+0000","last_fullsized":"2024-09-12T18:13:24.405705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404473+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:24.404473+0000","last_peered":"2024-09-12T18:13:24.404473+0000","last_clean":"2024-09-12T18:13:24.404473+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:24.404473+0000","last_undegraded":"2024-09-12T18:13:24.404473+0000","last_fullsized":"2024-09-12T18:13:24.404473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404770+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:24.404770+0000","last_peered":"2024-09-12T18:13:24.404770+0000","last_clean":"2024-09-12T18:13:24.404770+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:24.404770+0000","last_undegraded":"2024-09-12T18:13:24.404770+0000","last_fullsized":"2024-09-12T18:13:24.404770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404793+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:24.404793+0000","last_peered":"2024-09-12T18:13:24.404793+0000","last_clean":"2024-09-12T18:13:24.404793+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:24.404793+0000","last_undegraded":"2024-09-12T18:13:24.404793+0000","last_fullsized":"2024-09-12T18:13:24.404793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405933+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:24.405933+0000","last_peered":"2024-09-12T18:13:24.405933+0000","last_clean":"2024-09-12T18:13:24.405933+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:24.405933+0000","last_undegraded":"2024-09-12T18:13:24.405933+0000","last_fullsized":"2024-09-12T18:13:24.405933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406083+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:24.406083+0000","last_peered":"2024-09-12T18:13:24.406083+0000","last_clean":"2024-09-12T18:13:24.406083+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:24.406083+0000","last_undegraded":"2024-09-12T18:13:24.406083+0000","last_fullsized":"2024-09-12T18:13:24.406083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.407697+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:23.407697+0000","last_peered":"2024-09-12T18:13:23.407697+0000","last_clean":"2024-09-12T18:13:23.407697+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:23.407697+0000","last_undegraded":"2024-09-12T18:13:23.407697+0000","last_fullsized":"2024-09-12T18:13:23.407697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404220+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:24.404220+0000","last_peered":"2024-09-12T18:13:24.404220+0000","last_clean":"2024-09-12T18:13:24.404220+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:24.404220+0000","last_undegraded":"2024-09-12T18:13:24.404220+0000","last_fullsized":"2024-09-12T18:13:24.404220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.412462+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:23.412462+0000","last_peered":"2024-09-12T18:13:23.412462+0000","last_clean":"2024-09-12T18:13:23.412462+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:23.412462+0000","last_undegraded":"2024-09-12T18:13:23.412462+0000","last_fullsized":"2024-09-12T18:13:23.412462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405577+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:24.405577+0000","last_peered":"2024-09-12T18:13:24.405577+0000","last_clean":"2024-09-12T18:13:24.405577+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:24.405577+0000","last_undegraded":"2024-09-12T18:13:24.405577+0000","last_fullsized":"2024-09-12T18:13:24.405577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405753+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:24.405753+0000","last_peered":"2024-09-12T18:13:24.405753+0000","last_clean":"2024-09-12T18:13:24.405753+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:24.405753+0000","last_undegraded":"2024-09-12T18:13:24.405753+0000","last_fullsized":"2024-09-12T18:13:24.405753+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404857+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:24.404857+0000","last_peered":"2024-09-12T18:13:24.404857+0000","last_clean":"2024-09-12T18:13:24.404857+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:24.404857+0000","last_undegraded":"2024-09-12T18:13:24.404857+0000","last_fullsized":"2024-09-12T18:13:24.404857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403879+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:24.403879+0000","last_peered":"2024-09-12T18:13:24.403879+0000","last_clean":"2024-09-12T18:13:24.403879+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:24.403879+0000","last_undegraded":"2024-09-12T18:13:24.403879+0000","last_fullsized":"2024-09-12T18:13:24.403879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406423+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:24.406423+0000","last_peered":"2024-09-12T18:13:24.406423+0000","last_clean":"2024-09-12T18:13:24.406423+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:24.406423+0000","last_undegraded":"2024-09-12T18:13:24.406423+0000","last_fullsized":"2024-09-12T18:13:24.406423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404932+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:24.404932+0000","last_peered":"2024-09-12T18:13:24.404932+0000","last_clean":"2024-09-12T18:13:24.404932+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:24.404932+0000","last_undegraded":"2024-09-12T18:13:24.404932+0000","last_fullsized":"2024-09-12T18:13:24.404932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403887+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:24.403887+0000","last_peered":"2024-09-12T18:13:24.403887+0000","last_clean":"2024-09-12T18:13:24.403887+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:24.403887+0000","last_undegraded":"2024-09-12T18:13:24.403887+0000","last_fullsized":"2024-09-12T18:13:24.403887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430412+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:23.430412+0000","last_peered":"2024-09-12T18:13:23.430412+0000","last_clean":"2024-09-12T18:13:23.430412+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:23.430412+0000","last_undegraded":"2024-09-12T18:13:23.430412+0000","last_fullsized":"2024-09-12T18:13:23.430412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:21.373920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404097+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:24.404097+0000","last_peered":"2024-09-12T18:13:24.404097+0000","last_clean":"2024-09-12T18:13:24.404097+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:24.404097+0000","last_undegraded":"2024-09-12T18:13:24.404097+0000","last_fullsized":"2024-09-12T18:13:24.404097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.406945+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:23.406945+0000","last_peered":"2024-09-12T18:13:23.406945+0000","last_clean":"2024-09-12T18:13:23.406945+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:23.406945+0000","last_undegraded":"2024-09-12T18:13:23.406945+0000","last_fullsized":"2024-09-12T18:13:23.406945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405620+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:24.405620+0000","last_peered":"2024-09-12T18:13:24.405620+0000","last_clean":"2024-09-12T18:13:24.405620+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:24.405620+0000","last_undegraded":"2024-09-12T18:13:24.405620+0000","last_fullsized":"2024-09-12T18:13:24.405620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406060+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:24.406060+0000","last_peered":"2024-09-12T18:13:24.406060+0000","last_clean":"2024-09-12T18:13:24.406060+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:24.406060+0000","last_undegraded":"2024-09-12T18:13:24.406060+0000","last_fullsized":"2024-09-12T18:13:24.406060+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404645+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:24.404645+0000","last_peered":"2024-09-12T18:13:24.404645+0000","last_clean":"2024-09-12T18:13:24.404645+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:24.404645+0000","last_undegraded":"2024-09-12T18:13:24.404645+0000","last_fullsized":"2024-09-12T18:13:24.404645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405066+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:24.405066+0000","last_peered":"2024-09-12T18:13:24.405066+0000","last_clean":"2024-09-12T18:13:24.405066+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:24.405066+0000","last_undegraded":"2024-09-12T18:13:24.405066+0000","last_fullsized":"2024-09-12T18:13:24.405066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406576+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:24.406576+0000","last_peered":"2024-09-12T18:13:24.406576+0000","last_clean":"2024-09-12T18:13:24.406576+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:24.406576+0000","last_undegraded":"2024-09-12T18:13:24.406576+0000","last_fullsized":"2024-09-12T18:13:24.406576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405012+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:24.405012+0000","last_peered":"2024-09-12T18:13:24.405012+0000","last_clean":"2024-09-12T18:13:24.405012+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:24.405012+0000","last_undegraded":"2024-09-12T18:13:24.405012+0000","last_fullsized":"2024-09-12T18:13:24.405012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423913+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:23.423913+0000","last_peered":"2024-09-12T18:13:23.423913+0000","last_clean":"2024-09-12T18:13:23.423913+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:23.423913+0000","last_undegraded":"2024-09-12T18:13:23.423913+0000","last_fullsized":"2024-09-12T18:13:23.423913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:01.598467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404880+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:24.404880+0000","last_peered":"2024-09-12T18:13:24.404880+0000","last_clean":"2024-09-12T18:13:24.404880+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:24.404880+0000","last_undegraded":"2024-09-12T18:13:24.404880+0000","last_fullsized":"2024-09-12T18:13:24.404880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.413390+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:23.413390+0000","last_peered":"2024-09-12T18:13:23.413390+0000","last_clean":"2024-09-12T18:13:23.413390+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:23.413390+0000","last_undegraded":"2024-09-12T18:13:23.413390+0000","last_fullsized":"2024-09-12T18:13:23.413390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.424895+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:23.424895+0000","last_peered":"2024-09-12T18:13:23.424895+0000","last_clean":"2024-09-12T18:13:23.424895+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:23.424895+0000","last_undegraded":"2024-09-12T18:13:23.424895+0000","last_fullsized":"2024-09-12T18:13:23.424895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:37.846742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406253+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:24.406253+0000","last_peered":"2024-09-12T18:13:24.406253+0000","last_clean":"2024-09-12T18:13:24.406253+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:24.406253+0000","last_undegraded":"2024-09-12T18:13:24.406253+0000","last_fullsized":"2024-09-12T18:13:24.406253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406329+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:24.406329+0000","last_peered":"2024-09-12T18:13:24.406329+0000","last_clean":"2024-09-12T18:13:24.406329+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:24.406329+0000","last_undegraded":"2024-09-12T18:13:24.406329+0000","last_fullsized":"2024-09-12T18:13:24.406329+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403077+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:24.403077+0000","last_peered":"2024-09-12T18:13:24.403077+0000","last_clean":"2024-09-12T18:13:24.403077+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:24.403077+0000","last_undegraded":"2024-09-12T18:13:24.403077+0000","last_fullsized":"2024-09-12T18:13:24.403077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.390721+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:25.390721+0000","last_peered":"2024-09-12T18:13:25.390721+0000","last_clean":"2024-09-12T18:13:25.390721+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:25.390721+0000","last_undegraded":"2024-09-12T18:13:25.390721+0000","last_fullsized":"2024-09-12T18:13:25.390721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404093+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:24.404093+0000","last_peered":"2024-09-12T18:13:24.404093+0000","last_clean":"2024-09-12T18:13:24.404093+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:24.404093+0000","last_undegraded":"2024-09-12T18:13:24.404093+0000","last_fullsized":"2024-09-12T18:13:24.404093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.424912+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:23.424912+0000","last_peered":"2024-09-12T18:13:23.424912+0000","last_clean":"2024-09-12T18:13:23.424912+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:23.424912+0000","last_undegraded":"2024-09-12T18:13:23.424912+0000","last_fullsized":"2024-09-12T18:13:23.424912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:53.816463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403691+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:24.403691+0000","last_peered":"2024-09-12T18:13:24.403691+0000","last_clean":"2024-09-12T18:13:24.403691+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:24.403691+0000","last_undegraded":"2024-09-12T18:13:24.403691+0000","last_fullsized":"2024-09-12T18:13:24.403691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405078+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:24.405078+0000","last_peered":"2024-09-12T18:13:24.405078+0000","last_clean":"2024-09-12T18:13:24.405078+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:24.405078+0000","last_undegraded":"2024-09-12T18:13:24.405078+0000","last_fullsized":"2024-09-12T18:13:24.405078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403374+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:24.403374+0000","last_peered":"2024-09-12T18:13:24.403374+0000","last_clean":"2024-09-12T18:13:24.403374+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:24.403374+0000","last_undegraded":"2024-09-12T18:13:24.403374+0000","last_fullsized":"2024-09-12T18:13:24.403374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.434528+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:23.434528+0000","last_peered":"2024-09-12T18:13:23.434528+0000","last_clean":"2024-09-12T18:13:23.434528+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:23.434528+0000","last_undegraded":"2024-09-12T18:13:23.434528+0000","last_fullsized":"2024-09-12T18:13:23.434528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404156+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:24.404156+0000","last_peered":"2024-09-12T18:13:24.404156+0000","last_clean":"2024-09-12T18:13:24.404156+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:24.404156+0000","last_undegraded":"2024-09-12T18:13:24.404156+0000","last_fullsized":"2024-09-12T18:13:24.404156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403589+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:24.403589+0000","last_peered":"2024-09-12T18:13:24.403589+0000","last_clean":"2024-09-12T18:13:24.403589+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:24.403589+0000","last_undegraded":"2024-09-12T18:13:24.403589+0000","last_fullsized":"2024-09-12T18:13:24.403589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405981+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:24.405981+0000","last_peered":"2024-09-12T18:13:24.405981+0000","last_clean":"2024-09-12T18:13:24.405981+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:24.405981+0000","last_undegraded":"2024-09-12T18:13:24.405981+0000","last_fullsized":"2024-09-12T18:13:24.405981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403044+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:24.403044+0000","last_peered":"2024-09-12T18:13:24.403044+0000","last_clean":"2024-09-12T18:13:24.403044+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:24.403044+0000","last_undegraded":"2024-09-12T18:13:24.403044+0000","last_fullsized":"2024-09-12T18:13:24.403044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.426382+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:23.426382+0000","last_peered":"2024-09-12T18:13:23.426382+0000","last_clean":"2024-09-12T18:13:23.426382+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:23.426382+0000","last_undegraded":"2024-09-12T18:13:23.426382+0000","last_fullsized":"2024-09-12T18:13:23.426382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:16.790990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403315+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:24.403315+0000","last_peered":"2024-09-12T18:13:24.403315+0000","last_clean":"2024-09-12T18:13:24.403315+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:24.403315+0000","last_undegraded":"2024-09-12T18:13:24.403315+0000","last_fullsized":"2024-09-12T18:13:24.403315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405753+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:24.405753+0000","last_peered":"2024-09-12T18:13:24.405753+0000","last_clean":"2024-09-12T18:13:24.405753+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:24.405753+0000","last_undegraded":"2024-09-12T18:13:24.405753+0000","last_fullsized":"2024-09-12T18:13:24.405753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403613+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:24.403613+0000","last_peered":"2024-09-12T18:13:24.403613+0000","last_clean":"2024-09-12T18:13:24.403613+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:24.403613+0000","last_undegraded":"2024-09-12T18:13:24.403613+0000","last_fullsized":"2024-09-12T18:13:24.403613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.433975+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:23.433975+0000","last_peered":"2024-09-12T18:13:23.433975+0000","last_clean":"2024-09-12T18:13:23.433975+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:23.433975+0000","last_undegraded":"2024-09-12T18:13:23.433975+0000","last_fullsized":"2024-09-12T18:13:23.433975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:21.164974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.427739+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:23.427739+0000","last_peered":"2024-09-12T18:13:23.427739+0000","last_clean":"2024-09-12T18:13:23.427739+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:23.427739+0000","last_undegraded":"2024-09-12T18:13:23.427739+0000","last_fullsized":"2024-09-12T18:13:23.427739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430391+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:23.430391+0000","last_peered":"2024-09-12T18:13:23.430391+0000","last_clean":"2024-09-12T18:13:23.430391+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:23.430391+0000","last_undegraded":"2024-09-12T18:13:23.430391+0000","last_fullsized":"2024-09-12T18:13:23.430391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:01.502777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.430600+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:23.430600+0000","last_peered":"2024-09-12T18:13:23.430600+0000","last_clean":"2024-09-12T18:13:23.430600+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:23.430600+0000","last_undegraded":"2024-09-12T18:13:23.430600+0000","last_fullsized":"2024-09-12T18:13:23.430600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.403182+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:24.403182+0000","last_peered":"2024-09-12T18:13:24.403182+0000","last_clean":"2024-09-12T18:13:24.403182+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:24.403182+0000","last_undegraded":"2024-09-12T18:13:24.403182+0000","last_fullsized":"2024-09-12T18:13:24.403182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.404882+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:24.404882+0000","last_peered":"2024-09-12T18:13:24.404882+0000","last_clean":"2024-09-12T18:13:24.404882+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:24.404882+0000","last_undegraded":"2024-09-12T18:13:24.404882+0000","last_fullsized":"2024-09-12T18:13:24.404882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405114+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:24.405114+0000","last_peered":"2024-09-12T18:13:24.405114+0000","last_clean":"2024-09-12T18:13:24.405114+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:24.405114+0000","last_undegraded":"2024-09-12T18:13:24.405114+0000","last_fullsized":"2024-09-12T18:13:24.405114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.434440+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:23.434440+0000","last_peered":"2024-09-12T18:13:23.434440+0000","last_clean":"2024-09-12T18:13:23.434440+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:23.434440+0000","last_undegraded":"2024-09-12T18:13:23.434440+0000","last_fullsized":"2024-09-12T18:13:23.434440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-12T18:13:23.423030+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:23.423030+0000","last_peered":"2024-09-12T18:13:23.423030+0000","last_clean":"2024-09-12T18:13:23.423030+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:23.423030+0000","last_undegraded":"2024-09-12T18:13:23.423030+0000","last_fullsized":"2024-09-12T18:13:23.423030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:36.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.406091+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:24.406091+0000","last_peered":"2024-09-12T18:13:24.406091+0000","last_clean":"2024-09-12T18:13:24.406091+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:24.406091+0000","last_undegraded":"2024-09-12T18:13:24.406091+0000","last_fullsized":"2024-09-12T18:13:24.406091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405738+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:24.405738+0000","last_peered":"2024-09-12T18:13:24.405738+0000","last_clean":"2024-09-12T18:13:24.405738+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:24.405738+0000","last_undegraded":"2024-09-12T18:13:24.405738+0000","last_fullsized":"2024-09-12T18:13:24.405738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:13:24.405729+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:24.405729+0000","last_peered":"2024-09-12T18:13:24.405729+0000","last_clean":"2024-09-12T18:13:24.405729+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:24.405729+0000","last_undegraded":"2024-09-12T18:13:24.405729+0000","last_fullsized":"2024-09-12T18:13:24.405729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":651803,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":646537,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:28.137 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:13:28.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T18:13:28.138 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T18:13:28.479 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:28.497 INFO:teuthology.orchestra.run.smithi062.stdout:[{"version":4,"timestamp":"2024-09-12T18:13:09.264927+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6362.985465"}]}] 2024-09-12T18:13:28.497 INFO:tasks.ceph_manager:config epoch is 4 2024-09-12T18:13:28.497 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T18:13:28.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T18:13:28.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T18:13:28.846 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:28.863 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"flags":0,"active_gid":4115,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3033771499},{"type":"v1","addr":"172.21.15.62:6801","nonce":3033771499}]},"active_addr":"172.21.15.62:6801/3033771499","active_change":"2024-09-12T18:13:06.320049+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4120,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2492778172}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":845414196}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2870081016}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":3533262887}]}]} 2024-09-12T18:13:28.867 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T18:13:28.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:13:28.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:29.161 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:29.161 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:25.702443+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:29.179 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:13:29.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:29.479 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:29.479 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:25.702443+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:29.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:13:29.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:13:29.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:13:29.657 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-09-12T18:13:29.657 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:13:29.659 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-09-12T18:13:29.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:13:29.666 INFO:teuthology.orchestra.run.smithi062.stdout:34359738375 2024-09-12T18:13:29.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:13:29.947 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-09-12T18:13:29.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-09-12T18:13:29.998 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-09-12T18:13:30.001 INFO:teuthology.orchestra.run.smithi062.stdout:34359738373 2024-09-12T18:13:30.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-12T18:13:30.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-12T18:13:30.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:13:31.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:13:31.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:13:31.312 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-09-12T18:13:31.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-09-12T18:13:31.330 DEBUG:teuthology.parallel:result is None 2024-09-12T18:13:31.350 INFO:teuthology.orchestra.run.smithi062.stdout:34359738375 2024-09-12T18:13:31.366 INFO:teuthology.orchestra.run.smithi062.stdout:34359738374 2024-09-12T18:13:31.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-12T18:13:31.367 DEBUG:teuthology.parallel:result is None 2024-09-12T18:13:31.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-12T18:13:31.383 DEBUG:teuthology.parallel:result is None 2024-09-12T18:13:31.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:13:31.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:31.736 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:31.754 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-12T18:13:30.336916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":704512,"data_stored":1375416,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.952470"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968456+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:25.968456+0000","last_peered":"2024-09-12T18:13:25.968456+0000","last_clean":"2024-09-12T18:13:25.968456+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:25.968456+0000","last_undegraded":"2024-09-12T18:13:25.968456+0000","last_fullsized":"2024-09-12T18:13:25.968456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968410+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:25.968410+0000","last_peered":"2024-09-12T18:13:25.968410+0000","last_clean":"2024-09-12T18:13:25.968410+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:25.968410+0000","last_undegraded":"2024-09-12T18:13:25.968410+0000","last_fullsized":"2024-09-12T18:13:25.968410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:28.043135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711574+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:25.711574+0000","last_peered":"2024-09-12T18:13:25.711574+0000","last_clean":"2024-09-12T18:13:25.711574+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:25.711574+0000","last_undegraded":"2024-09-12T18:13:25.711574+0000","last_fullsized":"2024-09-12T18:13:25.711574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710459+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:25.710459+0000","last_peered":"2024-09-12T18:13:25.710459+0000","last_clean":"2024-09-12T18:13:25.710459+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:25.710459+0000","last_undegraded":"2024-09-12T18:13:25.710459+0000","last_fullsized":"2024-09-12T18:13:25.710459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968395+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:25.968395+0000","last_peered":"2024-09-12T18:13:25.968395+0000","last_clean":"2024-09-12T18:13:25.968395+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:25.968395+0000","last_undegraded":"2024-09-12T18:13:25.968395+0000","last_fullsized":"2024-09-12T18:13:25.968395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710265+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:25.710265+0000","last_peered":"2024-09-12T18:13:25.710265+0000","last_clean":"2024-09-12T18:13:25.710265+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:25.710265+0000","last_undegraded":"2024-09-12T18:13:25.710265+0000","last_fullsized":"2024-09-12T18:13:25.710265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709989+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:25.709989+0000","last_peered":"2024-09-12T18:13:25.709989+0000","last_clean":"2024-09-12T18:13:25.709989+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:25.709989+0000","last_undegraded":"2024-09-12T18:13:25.709989+0000","last_fullsized":"2024-09-12T18:13:25.709989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709523+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:25.709523+0000","last_peered":"2024-09-12T18:13:25.709523+0000","last_clean":"2024-09-12T18:13:25.709523+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:25.709523+0000","last_undegraded":"2024-09-12T18:13:25.709523+0000","last_fullsized":"2024-09-12T18:13:25.709523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712644+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:25.712644+0000","last_peered":"2024-09-12T18:13:25.712644+0000","last_clean":"2024-09-12T18:13:25.712644+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:25.712644+0000","last_undegraded":"2024-09-12T18:13:25.712644+0000","last_fullsized":"2024-09-12T18:13:25.712644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967673+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:25.967673+0000","last_peered":"2024-09-12T18:13:25.967673+0000","last_clean":"2024-09-12T18:13:25.967673+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:25.967673+0000","last_undegraded":"2024-09-12T18:13:25.967673+0000","last_fullsized":"2024-09-12T18:13:25.967673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711590+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:25.711590+0000","last_peered":"2024-09-12T18:13:25.711590+0000","last_clean":"2024-09-12T18:13:25.711590+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:25.711590+0000","last_undegraded":"2024-09-12T18:13:25.711590+0000","last_fullsized":"2024-09-12T18:13:25.711590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966847+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:25.966847+0000","last_peered":"2024-09-12T18:13:25.966847+0000","last_clean":"2024-09-12T18:13:25.966847+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:25.966847+0000","last_undegraded":"2024-09-12T18:13:25.966847+0000","last_fullsized":"2024-09-12T18:13:25.966847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:11.642559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966591+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:25.966591+0000","last_peered":"2024-09-12T18:13:25.966591+0000","last_clean":"2024-09-12T18:13:25.966591+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:25.966591+0000","last_undegraded":"2024-09-12T18:13:25.966591+0000","last_fullsized":"2024-09-12T18:13:25.966591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:19.521219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710513+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:25.710513+0000","last_peered":"2024-09-12T18:13:25.710513+0000","last_clean":"2024-09-12T18:13:25.710513+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:25.710513+0000","last_undegraded":"2024-09-12T18:13:25.710513+0000","last_fullsized":"2024-09-12T18:13:25.710513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710072+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:25.710072+0000","last_peered":"2024-09-12T18:13:25.710072+0000","last_clean":"2024-09-12T18:13:25.710072+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:25.710072+0000","last_undegraded":"2024-09-12T18:13:25.710072+0000","last_fullsized":"2024-09-12T18:13:25.710072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709540+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:25.709540+0000","last_peered":"2024-09-12T18:13:25.709540+0000","last_clean":"2024-09-12T18:13:25.709540+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:25.709540+0000","last_undegraded":"2024-09-12T18:13:25.709540+0000","last_fullsized":"2024-09-12T18:13:25.709540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713717+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:25.713717+0000","last_peered":"2024-09-12T18:13:25.713717+0000","last_clean":"2024-09-12T18:13:25.713717+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:25.713717+0000","last_undegraded":"2024-09-12T18:13:25.713717+0000","last_fullsized":"2024-09-12T18:13:25.713717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.970982+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:25.970982+0000","last_peered":"2024-09-12T18:13:25.970982+0000","last_clean":"2024-09-12T18:13:25.970982+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:25.970982+0000","last_undegraded":"2024-09-12T18:13:25.970982+0000","last_fullsized":"2024-09-12T18:13:25.970982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712588+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:25.712588+0000","last_peered":"2024-09-12T18:13:25.712588+0000","last_clean":"2024-09-12T18:13:25.712588+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:25.712588+0000","last_undegraded":"2024-09-12T18:13:25.712588+0000","last_fullsized":"2024-09-12T18:13:25.712588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710743+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:25.710743+0000","last_peered":"2024-09-12T18:13:25.710743+0000","last_clean":"2024-09-12T18:13:25.710743+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:25.710743+0000","last_undegraded":"2024-09-12T18:13:25.710743+0000","last_fullsized":"2024-09-12T18:13:25.710743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711911+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:25.711911+0000","last_peered":"2024-09-12T18:13:25.711911+0000","last_clean":"2024-09-12T18:13:25.711911+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:25.711911+0000","last_undegraded":"2024-09-12T18:13:25.711911+0000","last_fullsized":"2024-09-12T18:13:25.711911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967391+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:25.967391+0000","last_peered":"2024-09-12T18:13:25.967391+0000","last_clean":"2024-09-12T18:13:25.967391+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:25.967391+0000","last_undegraded":"2024-09-12T18:13:25.967391+0000","last_fullsized":"2024-09-12T18:13:25.967391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711033+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:25.711033+0000","last_peered":"2024-09-12T18:13:25.711033+0000","last_clean":"2024-09-12T18:13:25.711033+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:25.711033+0000","last_undegraded":"2024-09-12T18:13:25.711033+0000","last_fullsized":"2024-09-12T18:13:25.711033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966200+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:25.966200+0000","last_peered":"2024-09-12T18:13:25.966200+0000","last_clean":"2024-09-12T18:13:25.966200+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:25.966200+0000","last_undegraded":"2024-09-12T18:13:25.966200+0000","last_fullsized":"2024-09-12T18:13:25.966200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:14.363786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969120+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:25.969120+0000","last_peered":"2024-09-12T18:13:25.969120+0000","last_clean":"2024-09-12T18:13:25.969120+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:25.969120+0000","last_undegraded":"2024-09-12T18:13:25.969120+0000","last_fullsized":"2024-09-12T18:13:25.969120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713398+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:25.713398+0000","last_peered":"2024-09-12T18:13:25.713398+0000","last_clean":"2024-09-12T18:13:25.713398+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:25.713398+0000","last_undegraded":"2024-09-12T18:13:25.713398+0000","last_fullsized":"2024-09-12T18:13:25.713398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711806+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:25.711806+0000","last_peered":"2024-09-12T18:13:25.711806+0000","last_clean":"2024-09-12T18:13:25.711806+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:25.711806+0000","last_undegraded":"2024-09-12T18:13:25.711806+0000","last_fullsized":"2024-09-12T18:13:25.711806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969248+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:25.969248+0000","last_peered":"2024-09-12T18:13:25.969248+0000","last_clean":"2024-09-12T18:13:25.969248+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:25.969248+0000","last_undegraded":"2024-09-12T18:13:25.969248+0000","last_fullsized":"2024-09-12T18:13:25.969248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:39.628972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712080+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:25.712080+0000","last_peered":"2024-09-12T18:13:25.712080+0000","last_clean":"2024-09-12T18:13:25.712080+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:25.712080+0000","last_undegraded":"2024-09-12T18:13:25.712080+0000","last_fullsized":"2024-09-12T18:13:25.712080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968152+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:25.968152+0000","last_peered":"2024-09-12T18:13:25.968152+0000","last_clean":"2024-09-12T18:13:25.968152+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:25.968152+0000","last_undegraded":"2024-09-12T18:13:25.968152+0000","last_fullsized":"2024-09-12T18:13:25.968152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711247+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:25.711247+0000","last_peered":"2024-09-12T18:13:25.711247+0000","last_clean":"2024-09-12T18:13:25.711247+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:25.711247+0000","last_undegraded":"2024-09-12T18:13:25.711247+0000","last_fullsized":"2024-09-12T18:13:25.711247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709806+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:25.709806+0000","last_peered":"2024-09-12T18:13:25.709806+0000","last_clean":"2024-09-12T18:13:25.709806+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:25.709806+0000","last_undegraded":"2024-09-12T18:13:25.709806+0000","last_fullsized":"2024-09-12T18:13:25.709806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969367+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:25.969367+0000","last_peered":"2024-09-12T18:13:25.969367+0000","last_clean":"2024-09-12T18:13:25.969367+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:25.969367+0000","last_undegraded":"2024-09-12T18:13:25.969367+0000","last_fullsized":"2024-09-12T18:13:25.969367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712179+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.712179+0000","last_peered":"2024-09-12T18:13:25.712179+0000","last_clean":"2024-09-12T18:13:25.712179+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:25.712179+0000","last_undegraded":"2024-09-12T18:13:25.712179+0000","last_fullsized":"2024-09-12T18:13:25.712179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969380+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:25.969380+0000","last_peered":"2024-09-12T18:13:25.969380+0000","last_clean":"2024-09-12T18:13:25.969380+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:25.969380+0000","last_undegraded":"2024-09-12T18:13:25.969380+0000","last_fullsized":"2024-09-12T18:13:25.969380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712112+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:25.712112+0000","last_peered":"2024-09-12T18:13:25.712112+0000","last_clean":"2024-09-12T18:13:25.712112+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:25.712112+0000","last_undegraded":"2024-09-12T18:13:25.712112+0000","last_fullsized":"2024-09-12T18:13:25.712112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713760+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:25.713760+0000","last_peered":"2024-09-12T18:13:25.713760+0000","last_clean":"2024-09-12T18:13:25.713760+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:25.713760+0000","last_undegraded":"2024-09-12T18:13:25.713760+0000","last_fullsized":"2024-09-12T18:13:25.713760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967657+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:25.967657+0000","last_peered":"2024-09-12T18:13:25.967657+0000","last_clean":"2024-09-12T18:13:25.967657+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:25.967657+0000","last_undegraded":"2024-09-12T18:13:25.967657+0000","last_fullsized":"2024-09-12T18:13:25.967657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712910+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:25.712910+0000","last_peered":"2024-09-12T18:13:25.712910+0000","last_clean":"2024-09-12T18:13:25.712910+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:25.712910+0000","last_undegraded":"2024-09-12T18:13:25.712910+0000","last_fullsized":"2024-09-12T18:13:25.712910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709830+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:25.709830+0000","last_peered":"2024-09-12T18:13:25.709830+0000","last_clean":"2024-09-12T18:13:25.709830+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:25.709830+0000","last_undegraded":"2024-09-12T18:13:25.709830+0000","last_fullsized":"2024-09-12T18:13:25.709830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711767+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:25.711767+0000","last_peered":"2024-09-12T18:13:25.711767+0000","last_clean":"2024-09-12T18:13:25.711767+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:25.711767+0000","last_undegraded":"2024-09-12T18:13:25.711767+0000","last_fullsized":"2024-09-12T18:13:25.711767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968373+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:25.968373+0000","last_peered":"2024-09-12T18:13:25.968373+0000","last_clean":"2024-09-12T18:13:25.968373+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:25.968373+0000","last_undegraded":"2024-09-12T18:13:25.968373+0000","last_fullsized":"2024-09-12T18:13:25.968373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971527+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:25.971527+0000","last_peered":"2024-09-12T18:13:25.971527+0000","last_clean":"2024-09-12T18:13:25.971527+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:25.971527+0000","last_undegraded":"2024-09-12T18:13:25.971527+0000","last_fullsized":"2024-09-12T18:13:25.971527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966713+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:25.966713+0000","last_peered":"2024-09-12T18:13:25.966713+0000","last_clean":"2024-09-12T18:13:25.966713+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:25.966713+0000","last_undegraded":"2024-09-12T18:13:25.966713+0000","last_fullsized":"2024-09-12T18:13:25.966713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712187+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:25.712187+0000","last_peered":"2024-09-12T18:13:25.712187+0000","last_clean":"2024-09-12T18:13:25.712187+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:25.712187+0000","last_undegraded":"2024-09-12T18:13:25.712187+0000","last_fullsized":"2024-09-12T18:13:25.712187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710755+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:25.710755+0000","last_peered":"2024-09-12T18:13:25.710755+0000","last_clean":"2024-09-12T18:13:25.710755+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:25.710755+0000","last_undegraded":"2024-09-12T18:13:25.710755+0000","last_fullsized":"2024-09-12T18:13:25.710755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711303+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:25.711303+0000","last_peered":"2024-09-12T18:13:25.711303+0000","last_clean":"2024-09-12T18:13:25.711303+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:25.711303+0000","last_undegraded":"2024-09-12T18:13:25.711303+0000","last_fullsized":"2024-09-12T18:13:25.711303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712146+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:25.712146+0000","last_peered":"2024-09-12T18:13:25.712146+0000","last_clean":"2024-09-12T18:13:25.712146+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:25.712146+0000","last_undegraded":"2024-09-12T18:13:25.712146+0000","last_fullsized":"2024-09-12T18:13:25.712146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712561+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:25.712561+0000","last_peered":"2024-09-12T18:13:25.712561+0000","last_clean":"2024-09-12T18:13:25.712561+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:25.712561+0000","last_undegraded":"2024-09-12T18:13:25.712561+0000","last_fullsized":"2024-09-12T18:13:25.712561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710880+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:25.710880+0000","last_peered":"2024-09-12T18:13:25.710880+0000","last_clean":"2024-09-12T18:13:25.710880+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:25.710880+0000","last_undegraded":"2024-09-12T18:13:25.710880+0000","last_fullsized":"2024-09-12T18:13:25.710880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711501+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:25.711501+0000","last_peered":"2024-09-12T18:13:25.711501+0000","last_clean":"2024-09-12T18:13:25.711501+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:25.711501+0000","last_undegraded":"2024-09-12T18:13:25.711501+0000","last_fullsized":"2024-09-12T18:13:25.711501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711977+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:25.711977+0000","last_peered":"2024-09-12T18:13:25.711977+0000","last_clean":"2024-09-12T18:13:25.711977+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:25.711977+0000","last_undegraded":"2024-09-12T18:13:25.711977+0000","last_fullsized":"2024-09-12T18:13:25.711977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968051+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.968051+0000","last_peered":"2024-09-12T18:13:25.968051+0000","last_clean":"2024-09-12T18:13:25.968051+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:25.968051+0000","last_undegraded":"2024-09-12T18:13:25.968051+0000","last_fullsized":"2024-09-12T18:13:25.968051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710918+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:25.710918+0000","last_peered":"2024-09-12T18:13:25.710918+0000","last_clean":"2024-09-12T18:13:25.710918+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:25.710918+0000","last_undegraded":"2024-09-12T18:13:25.710918+0000","last_fullsized":"2024-09-12T18:13:25.710918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968945+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:25.968945+0000","last_peered":"2024-09-12T18:13:25.968945+0000","last_clean":"2024-09-12T18:13:25.968945+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:25.968945+0000","last_undegraded":"2024-09-12T18:13:25.968945+0000","last_fullsized":"2024-09-12T18:13:25.968945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713085+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:25.713085+0000","last_peered":"2024-09-12T18:13:25.713085+0000","last_clean":"2024-09-12T18:13:25.713085+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:25.713085+0000","last_undegraded":"2024-09-12T18:13:25.713085+0000","last_fullsized":"2024-09-12T18:13:25.713085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710339+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:25.710339+0000","last_peered":"2024-09-12T18:13:25.710339+0000","last_clean":"2024-09-12T18:13:25.710339+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:25.710339+0000","last_undegraded":"2024-09-12T18:13:25.710339+0000","last_fullsized":"2024-09-12T18:13:25.710339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712791+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:25.712791+0000","last_peered":"2024-09-12T18:13:25.712791+0000","last_clean":"2024-09-12T18:13:25.712791+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:25.712791+0000","last_undegraded":"2024-09-12T18:13:25.712791+0000","last_fullsized":"2024-09-12T18:13:25.712791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712472+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:25.712472+0000","last_peered":"2024-09-12T18:13:25.712472+0000","last_clean":"2024-09-12T18:13:25.712472+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:25.712472+0000","last_undegraded":"2024-09-12T18:13:25.712472+0000","last_fullsized":"2024-09-12T18:13:25.712472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712072+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:25.712072+0000","last_peered":"2024-09-12T18:13:25.712072+0000","last_clean":"2024-09-12T18:13:25.712072+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:25.712072+0000","last_undegraded":"2024-09-12T18:13:25.712072+0000","last_fullsized":"2024-09-12T18:13:25.712072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710218+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:25.710218+0000","last_peered":"2024-09-12T18:13:25.710218+0000","last_clean":"2024-09-12T18:13:25.710218+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:25.710218+0000","last_undegraded":"2024-09-12T18:13:25.710218+0000","last_fullsized":"2024-09-12T18:13:25.710218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711705+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:25.711705+0000","last_peered":"2024-09-12T18:13:25.711705+0000","last_clean":"2024-09-12T18:13:25.711705+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:25.711705+0000","last_undegraded":"2024-09-12T18:13:25.711705+0000","last_fullsized":"2024-09-12T18:13:25.711705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969393+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:25.969393+0000","last_peered":"2024-09-12T18:13:25.969393+0000","last_clean":"2024-09-12T18:13:25.969393+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:25.969393+0000","last_undegraded":"2024-09-12T18:13:25.969393+0000","last_fullsized":"2024-09-12T18:13:25.969393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712097+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:25.712097+0000","last_peered":"2024-09-12T18:13:25.712097+0000","last_clean":"2024-09-12T18:13:25.712097+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:25.712097+0000","last_undegraded":"2024-09-12T18:13:25.712097+0000","last_fullsized":"2024-09-12T18:13:25.712097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969333+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:25.969333+0000","last_peered":"2024-09-12T18:13:25.969333+0000","last_clean":"2024-09-12T18:13:25.969333+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:25.969333+0000","last_undegraded":"2024-09-12T18:13:25.969333+0000","last_fullsized":"2024-09-12T18:13:25.969333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713169+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:25.713169+0000","last_peered":"2024-09-12T18:13:25.713169+0000","last_clean":"2024-09-12T18:13:25.713169+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:25.713169+0000","last_undegraded":"2024-09-12T18:13:25.713169+0000","last_fullsized":"2024-09-12T18:13:25.713169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711699+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:25.711699+0000","last_peered":"2024-09-12T18:13:25.711699+0000","last_clean":"2024-09-12T18:13:25.711699+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:25.711699+0000","last_undegraded":"2024-09-12T18:13:25.711699+0000","last_fullsized":"2024-09-12T18:13:25.711699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712590+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:25.712590+0000","last_peered":"2024-09-12T18:13:25.712590+0000","last_clean":"2024-09-12T18:13:25.712590+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:25.712590+0000","last_undegraded":"2024-09-12T18:13:25.712590+0000","last_fullsized":"2024-09-12T18:13:25.712590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712999+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:25.712999+0000","last_peered":"2024-09-12T18:13:25.712999+0000","last_clean":"2024-09-12T18:13:25.712999+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:25.712999+0000","last_undegraded":"2024-09-12T18:13:25.712999+0000","last_fullsized":"2024-09-12T18:13:25.712999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712620+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:25.712620+0000","last_peered":"2024-09-12T18:13:25.712620+0000","last_clean":"2024-09-12T18:13:25.712620+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:25.712620+0000","last_undegraded":"2024-09-12T18:13:25.712620+0000","last_fullsized":"2024-09-12T18:13:25.712620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713380+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:25.713380+0000","last_peered":"2024-09-12T18:13:25.713380+0000","last_clean":"2024-09-12T18:13:25.713380+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:25.713380+0000","last_undegraded":"2024-09-12T18:13:25.713380+0000","last_fullsized":"2024-09-12T18:13:25.713380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967087+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:25.967087+0000","last_peered":"2024-09-12T18:13:25.967087+0000","last_clean":"2024-09-12T18:13:25.967087+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:25.967087+0000","last_undegraded":"2024-09-12T18:13:25.967087+0000","last_fullsized":"2024-09-12T18:13:25.967087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:08.786394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713264+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:25.713264+0000","last_peered":"2024-09-12T18:13:25.713264+0000","last_clean":"2024-09-12T18:13:25.713264+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:25.713264+0000","last_undegraded":"2024-09-12T18:13:25.713264+0000","last_fullsized":"2024-09-12T18:13:25.713264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.965581+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:25.965581+0000","last_peered":"2024-09-12T18:13:25.965581+0000","last_clean":"2024-09-12T18:13:25.965581+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:25.965581+0000","last_undegraded":"2024-09-12T18:13:25.965581+0000","last_fullsized":"2024-09-12T18:13:25.965581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967306+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:25.967306+0000","last_peered":"2024-09-12T18:13:25.967306+0000","last_clean":"2024-09-12T18:13:25.967306+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:25.967306+0000","last_undegraded":"2024-09-12T18:13:25.967306+0000","last_fullsized":"2024-09-12T18:13:25.967306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:03.114396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713861+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:25.713861+0000","last_peered":"2024-09-12T18:13:25.713861+0000","last_clean":"2024-09-12T18:13:25.713861+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:25.713861+0000","last_undegraded":"2024-09-12T18:13:25.713861+0000","last_fullsized":"2024-09-12T18:13:25.713861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.714052+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:25.714052+0000","last_peered":"2024-09-12T18:13:25.714052+0000","last_clean":"2024-09-12T18:13:25.714052+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:25.714052+0000","last_undegraded":"2024-09-12T18:13:25.714052+0000","last_fullsized":"2024-09-12T18:13:25.714052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711411+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:25.711411+0000","last_peered":"2024-09-12T18:13:25.711411+0000","last_clean":"2024-09-12T18:13:25.711411+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:25.711411+0000","last_undegraded":"2024-09-12T18:13:25.711411+0000","last_fullsized":"2024-09-12T18:13:25.711411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713926+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:25.713926+0000","last_peered":"2024-09-12T18:13:25.713926+0000","last_clean":"2024-09-12T18:13:25.713926+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:25.713926+0000","last_undegraded":"2024-09-12T18:13:25.713926+0000","last_fullsized":"2024-09-12T18:13:25.713926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712009+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:25.712009+0000","last_peered":"2024-09-12T18:13:25.712009+0000","last_clean":"2024-09-12T18:13:25.712009+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:25.712009+0000","last_undegraded":"2024-09-12T18:13:25.712009+0000","last_fullsized":"2024-09-12T18:13:25.712009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967422+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:25.967422+0000","last_peered":"2024-09-12T18:13:25.967422+0000","last_clean":"2024-09-12T18:13:25.967422+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:25.967422+0000","last_undegraded":"2024-09-12T18:13:25.967422+0000","last_fullsized":"2024-09-12T18:13:25.967422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:51.724774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711400+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:25.711400+0000","last_peered":"2024-09-12T18:13:25.711400+0000","last_clean":"2024-09-12T18:13:25.711400+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:25.711400+0000","last_undegraded":"2024-09-12T18:13:25.711400+0000","last_fullsized":"2024-09-12T18:13:25.711400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711255+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:25.711255+0000","last_peered":"2024-09-12T18:13:25.711255+0000","last_clean":"2024-09-12T18:13:25.711255+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:25.711255+0000","last_undegraded":"2024-09-12T18:13:25.711255+0000","last_fullsized":"2024-09-12T18:13:25.711255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711534+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:25.711534+0000","last_peered":"2024-09-12T18:13:25.711534+0000","last_clean":"2024-09-12T18:13:25.711534+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:25.711534+0000","last_undegraded":"2024-09-12T18:13:25.711534+0000","last_fullsized":"2024-09-12T18:13:25.711534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971815+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:25.971815+0000","last_peered":"2024-09-12T18:13:25.971815+0000","last_clean":"2024-09-12T18:13:25.971815+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:25.971815+0000","last_undegraded":"2024-09-12T18:13:25.971815+0000","last_fullsized":"2024-09-12T18:13:25.971815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711391+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:25.711391+0000","last_peered":"2024-09-12T18:13:25.711391+0000","last_clean":"2024-09-12T18:13:25.711391+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:25.711391+0000","last_undegraded":"2024-09-12T18:13:25.711391+0000","last_fullsized":"2024-09-12T18:13:25.711391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711290+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:25.711290+0000","last_peered":"2024-09-12T18:13:25.711290+0000","last_clean":"2024-09-12T18:13:25.711290+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:25.711290+0000","last_undegraded":"2024-09-12T18:13:25.711290+0000","last_fullsized":"2024-09-12T18:13:25.711290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713569+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:25.713569+0000","last_peered":"2024-09-12T18:13:25.713569+0000","last_clean":"2024-09-12T18:13:25.713569+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:25.713569+0000","last_undegraded":"2024-09-12T18:13:25.713569+0000","last_fullsized":"2024-09-12T18:13:25.713569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711485+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:25.711485+0000","last_peered":"2024-09-12T18:13:25.711485+0000","last_clean":"2024-09-12T18:13:25.711485+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:25.711485+0000","last_undegraded":"2024-09-12T18:13:25.711485+0000","last_fullsized":"2024-09-12T18:13:25.711485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971298+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:25.971298+0000","last_peered":"2024-09-12T18:13:25.971298+0000","last_clean":"2024-09-12T18:13:25.971298+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:25.971298+0000","last_undegraded":"2024-09-12T18:13:25.971298+0000","last_fullsized":"2024-09-12T18:13:25.971298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711703+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:25.711703+0000","last_peered":"2024-09-12T18:13:25.711703+0000","last_clean":"2024-09-12T18:13:25.711703+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:25.711703+0000","last_undegraded":"2024-09-12T18:13:25.711703+0000","last_fullsized":"2024-09-12T18:13:25.711703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713449+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:25.713449+0000","last_peered":"2024-09-12T18:13:25.713449+0000","last_clean":"2024-09-12T18:13:25.713449+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:25.713449+0000","last_undegraded":"2024-09-12T18:13:25.713449+0000","last_fullsized":"2024-09-12T18:13:25.713449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711550+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:25.711550+0000","last_peered":"2024-09-12T18:13:25.711550+0000","last_clean":"2024-09-12T18:13:25.711550+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:25.711550+0000","last_undegraded":"2024-09-12T18:13:25.711550+0000","last_fullsized":"2024-09-12T18:13:25.711550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971442+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:25.971442+0000","last_peered":"2024-09-12T18:13:25.971442+0000","last_clean":"2024-09-12T18:13:25.971442+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:25.971442+0000","last_undegraded":"2024-09-12T18:13:25.971442+0000","last_fullsized":"2024-09-12T18:13:25.971442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968718+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:25.968718+0000","last_peered":"2024-09-12T18:13:25.968718+0000","last_clean":"2024-09-12T18:13:25.968718+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:25.968718+0000","last_undegraded":"2024-09-12T18:13:25.968718+0000","last_fullsized":"2024-09-12T18:13:25.968718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967969+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:25.967969+0000","last_peered":"2024-09-12T18:13:25.967969+0000","last_clean":"2024-09-12T18:13:25.967969+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:25.967969+0000","last_undegraded":"2024-09-12T18:13:25.967969+0000","last_fullsized":"2024-09-12T18:13:25.967969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:27.815530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968021+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:25.968021+0000","last_peered":"2024-09-12T18:13:25.968021+0000","last_clean":"2024-09-12T18:13:25.968021+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:25.968021+0000","last_undegraded":"2024-09-12T18:13:25.968021+0000","last_fullsized":"2024-09-12T18:13:25.968021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711259+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:25.711259+0000","last_peered":"2024-09-12T18:13:25.711259+0000","last_clean":"2024-09-12T18:13:25.711259+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:25.711259+0000","last_undegraded":"2024-09-12T18:13:25.711259+0000","last_fullsized":"2024-09-12T18:13:25.711259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710998+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:25.710998+0000","last_peered":"2024-09-12T18:13:25.710998+0000","last_clean":"2024-09-12T18:13:25.710998+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:25.710998+0000","last_undegraded":"2024-09-12T18:13:25.710998+0000","last_fullsized":"2024-09-12T18:13:25.710998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711349+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:25.711349+0000","last_peered":"2024-09-12T18:13:25.711349+0000","last_clean":"2024-09-12T18:13:25.711349+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:25.711349+0000","last_undegraded":"2024-09-12T18:13:25.711349+0000","last_fullsized":"2024-09-12T18:13:25.711349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971174+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:25.971174+0000","last_peered":"2024-09-12T18:13:25.971174+0000","last_clean":"2024-09-12T18:13:25.971174+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:25.971174+0000","last_undegraded":"2024-09-12T18:13:25.971174+0000","last_fullsized":"2024-09-12T18:13:25.971174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968579+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:25.968579+0000","last_peered":"2024-09-12T18:13:25.968579+0000","last_clean":"2024-09-12T18:13:25.968579+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:25.968579+0000","last_undegraded":"2024-09-12T18:13:25.968579+0000","last_fullsized":"2024-09-12T18:13:25.968579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713731+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:25.713731+0000","last_peered":"2024-09-12T18:13:25.713731+0000","last_clean":"2024-09-12T18:13:25.713731+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:25.713731+0000","last_undegraded":"2024-09-12T18:13:25.713731+0000","last_fullsized":"2024-09-12T18:13:25.713731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710058+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:25.710058+0000","last_peered":"2024-09-12T18:13:25.710058+0000","last_clean":"2024-09-12T18:13:25.710058+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:25.710058+0000","last_undegraded":"2024-09-12T18:13:25.710058+0000","last_fullsized":"2024-09-12T18:13:25.710058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713401+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:25.713401+0000","last_peered":"2024-09-12T18:13:25.713401+0000","last_clean":"2024-09-12T18:13:25.713401+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:25.713401+0000","last_undegraded":"2024-09-12T18:13:25.713401+0000","last_fullsized":"2024-09-12T18:13:25.713401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":656071,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":655436,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:31.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:32.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:32.110 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:32.128 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-12T18:13:30.336916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":704512,"data_stored":1375416,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.952470"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968456+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:25.968456+0000","last_peered":"2024-09-12T18:13:25.968456+0000","last_clean":"2024-09-12T18:13:25.968456+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:25.968456+0000","last_undegraded":"2024-09-12T18:13:25.968456+0000","last_fullsized":"2024-09-12T18:13:25.968456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968410+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:25.968410+0000","last_peered":"2024-09-12T18:13:25.968410+0000","last_clean":"2024-09-12T18:13:25.968410+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:25.968410+0000","last_undegraded":"2024-09-12T18:13:25.968410+0000","last_fullsized":"2024-09-12T18:13:25.968410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:28.043135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711574+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:25.711574+0000","last_peered":"2024-09-12T18:13:25.711574+0000","last_clean":"2024-09-12T18:13:25.711574+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:25.711574+0000","last_undegraded":"2024-09-12T18:13:25.711574+0000","last_fullsized":"2024-09-12T18:13:25.711574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710459+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:25.710459+0000","last_peered":"2024-09-12T18:13:25.710459+0000","last_clean":"2024-09-12T18:13:25.710459+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:25.710459+0000","last_undegraded":"2024-09-12T18:13:25.710459+0000","last_fullsized":"2024-09-12T18:13:25.710459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968395+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:25.968395+0000","last_peered":"2024-09-12T18:13:25.968395+0000","last_clean":"2024-09-12T18:13:25.968395+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:25.968395+0000","last_undegraded":"2024-09-12T18:13:25.968395+0000","last_fullsized":"2024-09-12T18:13:25.968395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710265+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:25.710265+0000","last_peered":"2024-09-12T18:13:25.710265+0000","last_clean":"2024-09-12T18:13:25.710265+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:25.710265+0000","last_undegraded":"2024-09-12T18:13:25.710265+0000","last_fullsized":"2024-09-12T18:13:25.710265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709989+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:25.709989+0000","last_peered":"2024-09-12T18:13:25.709989+0000","last_clean":"2024-09-12T18:13:25.709989+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:25.709989+0000","last_undegraded":"2024-09-12T18:13:25.709989+0000","last_fullsized":"2024-09-12T18:13:25.709989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709523+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:25.709523+0000","last_peered":"2024-09-12T18:13:25.709523+0000","last_clean":"2024-09-12T18:13:25.709523+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:25.709523+0000","last_undegraded":"2024-09-12T18:13:25.709523+0000","last_fullsized":"2024-09-12T18:13:25.709523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712644+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:25.712644+0000","last_peered":"2024-09-12T18:13:25.712644+0000","last_clean":"2024-09-12T18:13:25.712644+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:25.712644+0000","last_undegraded":"2024-09-12T18:13:25.712644+0000","last_fullsized":"2024-09-12T18:13:25.712644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967673+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:25.967673+0000","last_peered":"2024-09-12T18:13:25.967673+0000","last_clean":"2024-09-12T18:13:25.967673+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:25.967673+0000","last_undegraded":"2024-09-12T18:13:25.967673+0000","last_fullsized":"2024-09-12T18:13:25.967673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711590+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:25.711590+0000","last_peered":"2024-09-12T18:13:25.711590+0000","last_clean":"2024-09-12T18:13:25.711590+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:25.711590+0000","last_undegraded":"2024-09-12T18:13:25.711590+0000","last_fullsized":"2024-09-12T18:13:25.711590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966847+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:25.966847+0000","last_peered":"2024-09-12T18:13:25.966847+0000","last_clean":"2024-09-12T18:13:25.966847+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:25.966847+0000","last_undegraded":"2024-09-12T18:13:25.966847+0000","last_fullsized":"2024-09-12T18:13:25.966847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:11.642559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966591+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:25.966591+0000","last_peered":"2024-09-12T18:13:25.966591+0000","last_clean":"2024-09-12T18:13:25.966591+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:25.966591+0000","last_undegraded":"2024-09-12T18:13:25.966591+0000","last_fullsized":"2024-09-12T18:13:25.966591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:19.521219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710513+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:25.710513+0000","last_peered":"2024-09-12T18:13:25.710513+0000","last_clean":"2024-09-12T18:13:25.710513+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:25.710513+0000","last_undegraded":"2024-09-12T18:13:25.710513+0000","last_fullsized":"2024-09-12T18:13:25.710513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710072+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:25.710072+0000","last_peered":"2024-09-12T18:13:25.710072+0000","last_clean":"2024-09-12T18:13:25.710072+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:25.710072+0000","last_undegraded":"2024-09-12T18:13:25.710072+0000","last_fullsized":"2024-09-12T18:13:25.710072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709540+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:25.709540+0000","last_peered":"2024-09-12T18:13:25.709540+0000","last_clean":"2024-09-12T18:13:25.709540+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:25.709540+0000","last_undegraded":"2024-09-12T18:13:25.709540+0000","last_fullsized":"2024-09-12T18:13:25.709540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713717+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:25.713717+0000","last_peered":"2024-09-12T18:13:25.713717+0000","last_clean":"2024-09-12T18:13:25.713717+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:25.713717+0000","last_undegraded":"2024-09-12T18:13:25.713717+0000","last_fullsized":"2024-09-12T18:13:25.713717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.970982+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:25.970982+0000","last_peered":"2024-09-12T18:13:25.970982+0000","last_clean":"2024-09-12T18:13:25.970982+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:25.970982+0000","last_undegraded":"2024-09-12T18:13:25.970982+0000","last_fullsized":"2024-09-12T18:13:25.970982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712588+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:25.712588+0000","last_peered":"2024-09-12T18:13:25.712588+0000","last_clean":"2024-09-12T18:13:25.712588+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:25.712588+0000","last_undegraded":"2024-09-12T18:13:25.712588+0000","last_fullsized":"2024-09-12T18:13:25.712588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710743+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:25.710743+0000","last_peered":"2024-09-12T18:13:25.710743+0000","last_clean":"2024-09-12T18:13:25.710743+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:25.710743+0000","last_undegraded":"2024-09-12T18:13:25.710743+0000","last_fullsized":"2024-09-12T18:13:25.710743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711911+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:25.711911+0000","last_peered":"2024-09-12T18:13:25.711911+0000","last_clean":"2024-09-12T18:13:25.711911+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:25.711911+0000","last_undegraded":"2024-09-12T18:13:25.711911+0000","last_fullsized":"2024-09-12T18:13:25.711911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967391+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:25.967391+0000","last_peered":"2024-09-12T18:13:25.967391+0000","last_clean":"2024-09-12T18:13:25.967391+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:25.967391+0000","last_undegraded":"2024-09-12T18:13:25.967391+0000","last_fullsized":"2024-09-12T18:13:25.967391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711033+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:25.711033+0000","last_peered":"2024-09-12T18:13:25.711033+0000","last_clean":"2024-09-12T18:13:25.711033+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:25.711033+0000","last_undegraded":"2024-09-12T18:13:25.711033+0000","last_fullsized":"2024-09-12T18:13:25.711033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966200+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:25.966200+0000","last_peered":"2024-09-12T18:13:25.966200+0000","last_clean":"2024-09-12T18:13:25.966200+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:25.966200+0000","last_undegraded":"2024-09-12T18:13:25.966200+0000","last_fullsized":"2024-09-12T18:13:25.966200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:14.363786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969120+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:25.969120+0000","last_peered":"2024-09-12T18:13:25.969120+0000","last_clean":"2024-09-12T18:13:25.969120+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:25.969120+0000","last_undegraded":"2024-09-12T18:13:25.969120+0000","last_fullsized":"2024-09-12T18:13:25.969120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713398+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:25.713398+0000","last_peered":"2024-09-12T18:13:25.713398+0000","last_clean":"2024-09-12T18:13:25.713398+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:25.713398+0000","last_undegraded":"2024-09-12T18:13:25.713398+0000","last_fullsized":"2024-09-12T18:13:25.713398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711806+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:25.711806+0000","last_peered":"2024-09-12T18:13:25.711806+0000","last_clean":"2024-09-12T18:13:25.711806+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:25.711806+0000","last_undegraded":"2024-09-12T18:13:25.711806+0000","last_fullsized":"2024-09-12T18:13:25.711806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969248+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:25.969248+0000","last_peered":"2024-09-12T18:13:25.969248+0000","last_clean":"2024-09-12T18:13:25.969248+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:25.969248+0000","last_undegraded":"2024-09-12T18:13:25.969248+0000","last_fullsized":"2024-09-12T18:13:25.969248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:39.628972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712080+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:25.712080+0000","last_peered":"2024-09-12T18:13:25.712080+0000","last_clean":"2024-09-12T18:13:25.712080+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:25.712080+0000","last_undegraded":"2024-09-12T18:13:25.712080+0000","last_fullsized":"2024-09-12T18:13:25.712080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968152+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:25.968152+0000","last_peered":"2024-09-12T18:13:25.968152+0000","last_clean":"2024-09-12T18:13:25.968152+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:25.968152+0000","last_undegraded":"2024-09-12T18:13:25.968152+0000","last_fullsized":"2024-09-12T18:13:25.968152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711247+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:25.711247+0000","last_peered":"2024-09-12T18:13:25.711247+0000","last_clean":"2024-09-12T18:13:25.711247+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:25.711247+0000","last_undegraded":"2024-09-12T18:13:25.711247+0000","last_fullsized":"2024-09-12T18:13:25.711247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709806+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:25.709806+0000","last_peered":"2024-09-12T18:13:25.709806+0000","last_clean":"2024-09-12T18:13:25.709806+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:25.709806+0000","last_undegraded":"2024-09-12T18:13:25.709806+0000","last_fullsized":"2024-09-12T18:13:25.709806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969367+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:25.969367+0000","last_peered":"2024-09-12T18:13:25.969367+0000","last_clean":"2024-09-12T18:13:25.969367+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:25.969367+0000","last_undegraded":"2024-09-12T18:13:25.969367+0000","last_fullsized":"2024-09-12T18:13:25.969367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712179+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.712179+0000","last_peered":"2024-09-12T18:13:25.712179+0000","last_clean":"2024-09-12T18:13:25.712179+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:25.712179+0000","last_undegraded":"2024-09-12T18:13:25.712179+0000","last_fullsized":"2024-09-12T18:13:25.712179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969380+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:25.969380+0000","last_peered":"2024-09-12T18:13:25.969380+0000","last_clean":"2024-09-12T18:13:25.969380+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:25.969380+0000","last_undegraded":"2024-09-12T18:13:25.969380+0000","last_fullsized":"2024-09-12T18:13:25.969380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712112+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:25.712112+0000","last_peered":"2024-09-12T18:13:25.712112+0000","last_clean":"2024-09-12T18:13:25.712112+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:25.712112+0000","last_undegraded":"2024-09-12T18:13:25.712112+0000","last_fullsized":"2024-09-12T18:13:25.712112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713760+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:25.713760+0000","last_peered":"2024-09-12T18:13:25.713760+0000","last_clean":"2024-09-12T18:13:25.713760+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:25.713760+0000","last_undegraded":"2024-09-12T18:13:25.713760+0000","last_fullsized":"2024-09-12T18:13:25.713760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967657+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:25.967657+0000","last_peered":"2024-09-12T18:13:25.967657+0000","last_clean":"2024-09-12T18:13:25.967657+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:25.967657+0000","last_undegraded":"2024-09-12T18:13:25.967657+0000","last_fullsized":"2024-09-12T18:13:25.967657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712910+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:25.712910+0000","last_peered":"2024-09-12T18:13:25.712910+0000","last_clean":"2024-09-12T18:13:25.712910+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:25.712910+0000","last_undegraded":"2024-09-12T18:13:25.712910+0000","last_fullsized":"2024-09-12T18:13:25.712910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709830+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:25.709830+0000","last_peered":"2024-09-12T18:13:25.709830+0000","last_clean":"2024-09-12T18:13:25.709830+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:25.709830+0000","last_undegraded":"2024-09-12T18:13:25.709830+0000","last_fullsized":"2024-09-12T18:13:25.709830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711767+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:25.711767+0000","last_peered":"2024-09-12T18:13:25.711767+0000","last_clean":"2024-09-12T18:13:25.711767+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:25.711767+0000","last_undegraded":"2024-09-12T18:13:25.711767+0000","last_fullsized":"2024-09-12T18:13:25.711767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968373+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:25.968373+0000","last_peered":"2024-09-12T18:13:25.968373+0000","last_clean":"2024-09-12T18:13:25.968373+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:25.968373+0000","last_undegraded":"2024-09-12T18:13:25.968373+0000","last_fullsized":"2024-09-12T18:13:25.968373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971527+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:25.971527+0000","last_peered":"2024-09-12T18:13:25.971527+0000","last_clean":"2024-09-12T18:13:25.971527+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:25.971527+0000","last_undegraded":"2024-09-12T18:13:25.971527+0000","last_fullsized":"2024-09-12T18:13:25.971527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966713+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:25.966713+0000","last_peered":"2024-09-12T18:13:25.966713+0000","last_clean":"2024-09-12T18:13:25.966713+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:25.966713+0000","last_undegraded":"2024-09-12T18:13:25.966713+0000","last_fullsized":"2024-09-12T18:13:25.966713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712187+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:25.712187+0000","last_peered":"2024-09-12T18:13:25.712187+0000","last_clean":"2024-09-12T18:13:25.712187+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:25.712187+0000","last_undegraded":"2024-09-12T18:13:25.712187+0000","last_fullsized":"2024-09-12T18:13:25.712187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710755+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:25.710755+0000","last_peered":"2024-09-12T18:13:25.710755+0000","last_clean":"2024-09-12T18:13:25.710755+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:25.710755+0000","last_undegraded":"2024-09-12T18:13:25.710755+0000","last_fullsized":"2024-09-12T18:13:25.710755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711303+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:25.711303+0000","last_peered":"2024-09-12T18:13:25.711303+0000","last_clean":"2024-09-12T18:13:25.711303+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:25.711303+0000","last_undegraded":"2024-09-12T18:13:25.711303+0000","last_fullsized":"2024-09-12T18:13:25.711303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712146+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:25.712146+0000","last_peered":"2024-09-12T18:13:25.712146+0000","last_clean":"2024-09-12T18:13:25.712146+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:25.712146+0000","last_undegraded":"2024-09-12T18:13:25.712146+0000","last_fullsized":"2024-09-12T18:13:25.712146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712561+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:25.712561+0000","last_peered":"2024-09-12T18:13:25.712561+0000","last_clean":"2024-09-12T18:13:25.712561+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:25.712561+0000","last_undegraded":"2024-09-12T18:13:25.712561+0000","last_fullsized":"2024-09-12T18:13:25.712561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710880+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:25.710880+0000","last_peered":"2024-09-12T18:13:25.710880+0000","last_clean":"2024-09-12T18:13:25.710880+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:25.710880+0000","last_undegraded":"2024-09-12T18:13:25.710880+0000","last_fullsized":"2024-09-12T18:13:25.710880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711501+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:25.711501+0000","last_peered":"2024-09-12T18:13:25.711501+0000","last_clean":"2024-09-12T18:13:25.711501+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:25.711501+0000","last_undegraded":"2024-09-12T18:13:25.711501+0000","last_fullsized":"2024-09-12T18:13:25.711501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711977+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:25.711977+0000","last_peered":"2024-09-12T18:13:25.711977+0000","last_clean":"2024-09-12T18:13:25.711977+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:25.711977+0000","last_undegraded":"2024-09-12T18:13:25.711977+0000","last_fullsized":"2024-09-12T18:13:25.711977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968051+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.968051+0000","last_peered":"2024-09-12T18:13:25.968051+0000","last_clean":"2024-09-12T18:13:25.968051+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:25.968051+0000","last_undegraded":"2024-09-12T18:13:25.968051+0000","last_fullsized":"2024-09-12T18:13:25.968051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710918+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:25.710918+0000","last_peered":"2024-09-12T18:13:25.710918+0000","last_clean":"2024-09-12T18:13:25.710918+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:25.710918+0000","last_undegraded":"2024-09-12T18:13:25.710918+0000","last_fullsized":"2024-09-12T18:13:25.710918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968945+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:25.968945+0000","last_peered":"2024-09-12T18:13:25.968945+0000","last_clean":"2024-09-12T18:13:25.968945+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:25.968945+0000","last_undegraded":"2024-09-12T18:13:25.968945+0000","last_fullsized":"2024-09-12T18:13:25.968945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713085+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:25.713085+0000","last_peered":"2024-09-12T18:13:25.713085+0000","last_clean":"2024-09-12T18:13:25.713085+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:25.713085+0000","last_undegraded":"2024-09-12T18:13:25.713085+0000","last_fullsized":"2024-09-12T18:13:25.713085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710339+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:25.710339+0000","last_peered":"2024-09-12T18:13:25.710339+0000","last_clean":"2024-09-12T18:13:25.710339+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:25.710339+0000","last_undegraded":"2024-09-12T18:13:25.710339+0000","last_fullsized":"2024-09-12T18:13:25.710339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712791+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:25.712791+0000","last_peered":"2024-09-12T18:13:25.712791+0000","last_clean":"2024-09-12T18:13:25.712791+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:25.712791+0000","last_undegraded":"2024-09-12T18:13:25.712791+0000","last_fullsized":"2024-09-12T18:13:25.712791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712472+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:25.712472+0000","last_peered":"2024-09-12T18:13:25.712472+0000","last_clean":"2024-09-12T18:13:25.712472+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:25.712472+0000","last_undegraded":"2024-09-12T18:13:25.712472+0000","last_fullsized":"2024-09-12T18:13:25.712472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712072+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:25.712072+0000","last_peered":"2024-09-12T18:13:25.712072+0000","last_clean":"2024-09-12T18:13:25.712072+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:25.712072+0000","last_undegraded":"2024-09-12T18:13:25.712072+0000","last_fullsized":"2024-09-12T18:13:25.712072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710218+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:25.710218+0000","last_peered":"2024-09-12T18:13:25.710218+0000","last_clean":"2024-09-12T18:13:25.710218+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:25.710218+0000","last_undegraded":"2024-09-12T18:13:25.710218+0000","last_fullsized":"2024-09-12T18:13:25.710218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711705+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:25.711705+0000","last_peered":"2024-09-12T18:13:25.711705+0000","last_clean":"2024-09-12T18:13:25.711705+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:25.711705+0000","last_undegraded":"2024-09-12T18:13:25.711705+0000","last_fullsized":"2024-09-12T18:13:25.711705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969393+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:25.969393+0000","last_peered":"2024-09-12T18:13:25.969393+0000","last_clean":"2024-09-12T18:13:25.969393+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:25.969393+0000","last_undegraded":"2024-09-12T18:13:25.969393+0000","last_fullsized":"2024-09-12T18:13:25.969393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712097+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:25.712097+0000","last_peered":"2024-09-12T18:13:25.712097+0000","last_clean":"2024-09-12T18:13:25.712097+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:25.712097+0000","last_undegraded":"2024-09-12T18:13:25.712097+0000","last_fullsized":"2024-09-12T18:13:25.712097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969333+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:25.969333+0000","last_peered":"2024-09-12T18:13:25.969333+0000","last_clean":"2024-09-12T18:13:25.969333+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:25.969333+0000","last_undegraded":"2024-09-12T18:13:25.969333+0000","last_fullsized":"2024-09-12T18:13:25.969333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713169+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:25.713169+0000","last_peered":"2024-09-12T18:13:25.713169+0000","last_clean":"2024-09-12T18:13:25.713169+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:25.713169+0000","last_undegraded":"2024-09-12T18:13:25.713169+0000","last_fullsized":"2024-09-12T18:13:25.713169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711699+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:25.711699+0000","last_peered":"2024-09-12T18:13:25.711699+0000","last_clean":"2024-09-12T18:13:25.711699+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:25.711699+0000","last_undegraded":"2024-09-12T18:13:25.711699+0000","last_fullsized":"2024-09-12T18:13:25.711699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712590+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:25.712590+0000","last_peered":"2024-09-12T18:13:25.712590+0000","last_clean":"2024-09-12T18:13:25.712590+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:25.712590+0000","last_undegraded":"2024-09-12T18:13:25.712590+0000","last_fullsized":"2024-09-12T18:13:25.712590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712999+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:25.712999+0000","last_peered":"2024-09-12T18:13:25.712999+0000","last_clean":"2024-09-12T18:13:25.712999+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:25.712999+0000","last_undegraded":"2024-09-12T18:13:25.712999+0000","last_fullsized":"2024-09-12T18:13:25.712999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712620+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:25.712620+0000","last_peered":"2024-09-12T18:13:25.712620+0000","last_clean":"2024-09-12T18:13:25.712620+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:25.712620+0000","last_undegraded":"2024-09-12T18:13:25.712620+0000","last_fullsized":"2024-09-12T18:13:25.712620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713380+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:25.713380+0000","last_peered":"2024-09-12T18:13:25.713380+0000","last_clean":"2024-09-12T18:13:25.713380+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:25.713380+0000","last_undegraded":"2024-09-12T18:13:25.713380+0000","last_fullsized":"2024-09-12T18:13:25.713380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967087+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:25.967087+0000","last_peered":"2024-09-12T18:13:25.967087+0000","last_clean":"2024-09-12T18:13:25.967087+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:25.967087+0000","last_undegraded":"2024-09-12T18:13:25.967087+0000","last_fullsized":"2024-09-12T18:13:25.967087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:08.786394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713264+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:25.713264+0000","last_peered":"2024-09-12T18:13:25.713264+0000","last_clean":"2024-09-12T18:13:25.713264+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:25.713264+0000","last_undegraded":"2024-09-12T18:13:25.713264+0000","last_fullsized":"2024-09-12T18:13:25.713264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.965581+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:25.965581+0000","last_peered":"2024-09-12T18:13:25.965581+0000","last_clean":"2024-09-12T18:13:25.965581+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:25.965581+0000","last_undegraded":"2024-09-12T18:13:25.965581+0000","last_fullsized":"2024-09-12T18:13:25.965581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967306+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:25.967306+0000","last_peered":"2024-09-12T18:13:25.967306+0000","last_clean":"2024-09-12T18:13:25.967306+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:25.967306+0000","last_undegraded":"2024-09-12T18:13:25.967306+0000","last_fullsized":"2024-09-12T18:13:25.967306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:03.114396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713861+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:25.713861+0000","last_peered":"2024-09-12T18:13:25.713861+0000","last_clean":"2024-09-12T18:13:25.713861+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:25.713861+0000","last_undegraded":"2024-09-12T18:13:25.713861+0000","last_fullsized":"2024-09-12T18:13:25.713861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.714052+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:25.714052+0000","last_peered":"2024-09-12T18:13:25.714052+0000","last_clean":"2024-09-12T18:13:25.714052+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:25.714052+0000","last_undegraded":"2024-09-12T18:13:25.714052+0000","last_fullsized":"2024-09-12T18:13:25.714052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711411+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:25.711411+0000","last_peered":"2024-09-12T18:13:25.711411+0000","last_clean":"2024-09-12T18:13:25.711411+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:25.711411+0000","last_undegraded":"2024-09-12T18:13:25.711411+0000","last_fullsized":"2024-09-12T18:13:25.711411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713926+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:25.713926+0000","last_peered":"2024-09-12T18:13:25.713926+0000","last_clean":"2024-09-12T18:13:25.713926+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:25.713926+0000","last_undegraded":"2024-09-12T18:13:25.713926+0000","last_fullsized":"2024-09-12T18:13:25.713926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712009+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:25.712009+0000","last_peered":"2024-09-12T18:13:25.712009+0000","last_clean":"2024-09-12T18:13:25.712009+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:25.712009+0000","last_undegraded":"2024-09-12T18:13:25.712009+0000","last_fullsized":"2024-09-12T18:13:25.712009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967422+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:25.967422+0000","last_peered":"2024-09-12T18:13:25.967422+0000","last_clean":"2024-09-12T18:13:25.967422+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:25.967422+0000","last_undegraded":"2024-09-12T18:13:25.967422+0000","last_fullsized":"2024-09-12T18:13:25.967422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:51.724774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711400+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:25.711400+0000","last_peered":"2024-09-12T18:13:25.711400+0000","last_clean":"2024-09-12T18:13:25.711400+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:25.711400+0000","last_undegraded":"2024-09-12T18:13:25.711400+0000","last_fullsized":"2024-09-12T18:13:25.711400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711255+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:25.711255+0000","last_peered":"2024-09-12T18:13:25.711255+0000","last_clean":"2024-09-12T18:13:25.711255+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:25.711255+0000","last_undegraded":"2024-09-12T18:13:25.711255+0000","last_fullsized":"2024-09-12T18:13:25.711255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711534+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:25.711534+0000","last_peered":"2024-09-12T18:13:25.711534+0000","last_clean":"2024-09-12T18:13:25.711534+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:25.711534+0000","last_undegraded":"2024-09-12T18:13:25.711534+0000","last_fullsized":"2024-09-12T18:13:25.711534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971815+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:25.971815+0000","last_peered":"2024-09-12T18:13:25.971815+0000","last_clean":"2024-09-12T18:13:25.971815+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:25.971815+0000","last_undegraded":"2024-09-12T18:13:25.971815+0000","last_fullsized":"2024-09-12T18:13:25.971815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711391+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:25.711391+0000","last_peered":"2024-09-12T18:13:25.711391+0000","last_clean":"2024-09-12T18:13:25.711391+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:25.711391+0000","last_undegraded":"2024-09-12T18:13:25.711391+0000","last_fullsized":"2024-09-12T18:13:25.711391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711290+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:25.711290+0000","last_peered":"2024-09-12T18:13:25.711290+0000","last_clean":"2024-09-12T18:13:25.711290+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:25.711290+0000","last_undegraded":"2024-09-12T18:13:25.711290+0000","last_fullsized":"2024-09-12T18:13:25.711290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713569+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:25.713569+0000","last_peered":"2024-09-12T18:13:25.713569+0000","last_clean":"2024-09-12T18:13:25.713569+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:25.713569+0000","last_undegraded":"2024-09-12T18:13:25.713569+0000","last_fullsized":"2024-09-12T18:13:25.713569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711485+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:25.711485+0000","last_peered":"2024-09-12T18:13:25.711485+0000","last_clean":"2024-09-12T18:13:25.711485+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:25.711485+0000","last_undegraded":"2024-09-12T18:13:25.711485+0000","last_fullsized":"2024-09-12T18:13:25.711485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971298+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:25.971298+0000","last_peered":"2024-09-12T18:13:25.971298+0000","last_clean":"2024-09-12T18:13:25.971298+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:25.971298+0000","last_undegraded":"2024-09-12T18:13:25.971298+0000","last_fullsized":"2024-09-12T18:13:25.971298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711703+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:25.711703+0000","last_peered":"2024-09-12T18:13:25.711703+0000","last_clean":"2024-09-12T18:13:25.711703+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:25.711703+0000","last_undegraded":"2024-09-12T18:13:25.711703+0000","last_fullsized":"2024-09-12T18:13:25.711703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713449+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:25.713449+0000","last_peered":"2024-09-12T18:13:25.713449+0000","last_clean":"2024-09-12T18:13:25.713449+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:25.713449+0000","last_undegraded":"2024-09-12T18:13:25.713449+0000","last_fullsized":"2024-09-12T18:13:25.713449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711550+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:25.711550+0000","last_peered":"2024-09-12T18:13:25.711550+0000","last_clean":"2024-09-12T18:13:25.711550+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:25.711550+0000","last_undegraded":"2024-09-12T18:13:25.711550+0000","last_fullsized":"2024-09-12T18:13:25.711550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971442+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:25.971442+0000","last_peered":"2024-09-12T18:13:25.971442+0000","last_clean":"2024-09-12T18:13:25.971442+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:25.971442+0000","last_undegraded":"2024-09-12T18:13:25.971442+0000","last_fullsized":"2024-09-12T18:13:25.971442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968718+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:25.968718+0000","last_peered":"2024-09-12T18:13:25.968718+0000","last_clean":"2024-09-12T18:13:25.968718+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:25.968718+0000","last_undegraded":"2024-09-12T18:13:25.968718+0000","last_fullsized":"2024-09-12T18:13:25.968718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967969+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:25.967969+0000","last_peered":"2024-09-12T18:13:25.967969+0000","last_clean":"2024-09-12T18:13:25.967969+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:25.967969+0000","last_undegraded":"2024-09-12T18:13:25.967969+0000","last_fullsized":"2024-09-12T18:13:25.967969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:27.815530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968021+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:25.968021+0000","last_peered":"2024-09-12T18:13:25.968021+0000","last_clean":"2024-09-12T18:13:25.968021+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:25.968021+0000","last_undegraded":"2024-09-12T18:13:25.968021+0000","last_fullsized":"2024-09-12T18:13:25.968021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711259+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:25.711259+0000","last_peered":"2024-09-12T18:13:25.711259+0000","last_clean":"2024-09-12T18:13:25.711259+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:25.711259+0000","last_undegraded":"2024-09-12T18:13:25.711259+0000","last_fullsized":"2024-09-12T18:13:25.711259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710998+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:25.710998+0000","last_peered":"2024-09-12T18:13:25.710998+0000","last_clean":"2024-09-12T18:13:25.710998+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:25.710998+0000","last_undegraded":"2024-09-12T18:13:25.710998+0000","last_fullsized":"2024-09-12T18:13:25.710998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711349+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:25.711349+0000","last_peered":"2024-09-12T18:13:25.711349+0000","last_clean":"2024-09-12T18:13:25.711349+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:25.711349+0000","last_undegraded":"2024-09-12T18:13:25.711349+0000","last_fullsized":"2024-09-12T18:13:25.711349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971174+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:25.971174+0000","last_peered":"2024-09-12T18:13:25.971174+0000","last_clean":"2024-09-12T18:13:25.971174+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:25.971174+0000","last_undegraded":"2024-09-12T18:13:25.971174+0000","last_fullsized":"2024-09-12T18:13:25.971174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968579+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:25.968579+0000","last_peered":"2024-09-12T18:13:25.968579+0000","last_clean":"2024-09-12T18:13:25.968579+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:25.968579+0000","last_undegraded":"2024-09-12T18:13:25.968579+0000","last_fullsized":"2024-09-12T18:13:25.968579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713731+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:25.713731+0000","last_peered":"2024-09-12T18:13:25.713731+0000","last_clean":"2024-09-12T18:13:25.713731+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:25.713731+0000","last_undegraded":"2024-09-12T18:13:25.713731+0000","last_fullsized":"2024-09-12T18:13:25.713731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710058+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:25.710058+0000","last_peered":"2024-09-12T18:13:25.710058+0000","last_clean":"2024-09-12T18:13:25.710058+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:25.710058+0000","last_undegraded":"2024-09-12T18:13:25.710058+0000","last_fullsized":"2024-09-12T18:13:25.710058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713401+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:25.713401+0000","last_peered":"2024-09-12T18:13:25.713401+0000","last_clean":"2024-09-12T18:13:25.713401+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:25.713401+0000","last_undegraded":"2024-09-12T18:13:25.713401+0000","last_fullsized":"2024-09-12T18:13:25.713401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":656071,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":655436,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:32.133 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:13:32.134 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T18:13:32.134 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T18:13:32.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T18:13:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:32.512 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T18:13:32.531 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T18:13:32.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:13:32.882 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:32.883 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"btime":"2024-09-12T18:13:26:704705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:13:22.766125+0000","modified":"2024-09-12T18:13:25.788129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4214,"qdb_cluster":[4214]},"id":1}]} 2024-09-12T18:13:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2024-09-12T18:13:32.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:13:33.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:33.241 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"btime":"2024-09-12T18:13:26:704705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:13:22.766125+0000","modified":"2024-09-12T18:13:25.788129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4214,"qdb_cluster":[4214]},"id":1}]} 2024-09-12T18:13:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2024-09-12T18:13:33.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:13:33.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:33.549 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:13:25.702443+0000","last_up_change":"2024-09-12T18:13:10.269506+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6801","nonce":1368744816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6803","nonce":1368744816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6807","nonce":1368744816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1368744816},{"type":"v1","addr":"172.21.15.129:6805","nonce":1368744816}]},"public_addr":"172.21.15.129:6801/1368744816","cluster_addr":"172.21.15.129:6803/1368744816","heartbeat_back_addr":"172.21.15.129:6807/1368744816","heartbeat_front_addr":"172.21.15.129:6805/1368744816","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:13:33.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:13:33.911 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:33.911 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"btime":"2024-09-12T18:13:26:704705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:13:22.766125+0000","modified":"2024-09-12T18:13:25.788129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4214,"qdb_cluster":[4214]},"id":1}]} 2024-09-12T18:13:33.912 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2024-09-12T18:13:34.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T18:13:22.766125+0000', 'modified': '2024-09-12T18:13:25.788129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4214': {'gid': 4214, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.62:6803/4162831730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6802', 'nonce': 4162831730}, {'type': 'v1', 'addr': '172.21.15.62:6803', 'nonce': 4162831730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4214, 'qdb_cluster': [4214]} 2024-09-12T18:13:34.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T18:13:34.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T18:13:34.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T18:13:34.170+0000 7f6581ffb640 0 client.4396 ms_handle_reset on v2:172.21.15.62:6802/4162831730 2024-09-12T18:13:34.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T18:13:34.194+0000 7f6581ffb640 0 client.4409 ms_handle_reset on v2:172.21.15.62:6802/4162831730 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4214, 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 10.814821521000001, 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 6, 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 20, 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 20, 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 14.723948244000001 2024-09-12T18:13:34.198 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:13:34.213 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T18:13:34.224 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T18:13:34.225 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-12T18:13:34.225 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T18:13:34.225 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T18:13:34.225 DEBUG:teuthology.orchestra.run.smithi062:> sync 2024-09-12T18:13:34.533 DEBUG:teuthology.orchestra.run.smithi129:> sync 2024-09-12T18:13:34.732 DEBUG:teuthology.orchestra.run.smithi151:> sync 2024-09-12T18:13:34.787 DEBUG:teuthology.orchestra.run.smithi176:> sync 2024-09-12T18:13:34.847 DEBUG:tasks.thrashosds:checking console status of smithi062 2024-09-12T18:13:34.847 DEBUG:teuthology.orchestra.console.smithi062:Waiting for login prompt 2024-09-12T18:13:34.847 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi062 2024-09-12T18:13:34.925 DEBUG:teuthology.orchestra.console.smithi062:expect before: [Enter `^Ec?' for help] 2024-09-12T18:13:34.926 DEBUG:teuthology.orchestra.console.smithi062:expect after: smithi062 login: 2024-09-12T18:13:34.977 DEBUG:teuthology.orchestra.console.smithi062:console disconnect output: [Enter `^Ec?' for help] smithi062 login: [disconnect] 2024-09-12T18:13:35.079 DEBUG:tasks.thrashosds:checking console status of smithi129 2024-09-12T18:13:35.079 DEBUG:teuthology.orchestra.console.smithi129:Waiting for login prompt 2024-09-12T18:13:35.079 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi129 2024-09-12T18:13:35.177 DEBUG:teuthology.orchestra.console.smithi129:expect before: [Enter `^Ec?' for help] 2024-09-12T18:13:35.178 DEBUG:teuthology.orchestra.console.smithi129:expect after: smithi129 login: 2024-09-12T18:13:35.230 DEBUG:teuthology.orchestra.console.smithi129:console disconnect output: [Enter `^Ec?' for help] smithi129 login: [disconnect] 2024-09-12T18:13:35.331 DEBUG:tasks.thrashosds:checking console status of smithi151 2024-09-12T18:13:35.331 DEBUG:teuthology.orchestra.console.smithi151:Waiting for login prompt 2024-09-12T18:13:35.331 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi151 2024-09-12T18:13:35.464 DEBUG:teuthology.orchestra.console.smithi151:expect before: [Enter `^Ec?' for help] 2024-09-12T18:13:35.465 DEBUG:teuthology.orchestra.console.smithi151:expect after: smithi151 login: 2024-09-12T18:13:35.517 DEBUG:teuthology.orchestra.console.smithi151:console disconnect output: [Enter `^Ec?' for help] smithi151 login: [disconnect] 2024-09-12T18:13:35.618 DEBUG:tasks.thrashosds:checking console status of smithi176 2024-09-12T18:13:35.618 DEBUG:teuthology.orchestra.console.smithi176:Waiting for login prompt 2024-09-12T18:13:35.619 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi176 2024-09-12T18:13:35.774 DEBUG:teuthology.orchestra.console.smithi176:expect before: [Enter `^Ec?' for help] 2024-09-12T18:13:35.774 DEBUG:teuthology.orchestra.console.smithi176:expect after: smithi176 login: 2024-09-12T18:13:35.826 DEBUG:teuthology.orchestra.console.smithi176:console disconnect output: [Enter `^Ec?' for help] smithi176 login: [disconnect] 2024-09-12T18:13:35.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T18:13:36.282 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T18:13:36.282 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:13:36.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:36.609 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T18:13:36.339079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":704512,"data_stored":1375416,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.632820"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968456+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:25.968456+0000","last_peered":"2024-09-12T18:13:25.968456+0000","last_clean":"2024-09-12T18:13:25.968456+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:25.968456+0000","last_undegraded":"2024-09-12T18:13:25.968456+0000","last_fullsized":"2024-09-12T18:13:25.968456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968410+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:25.968410+0000","last_peered":"2024-09-12T18:13:25.968410+0000","last_clean":"2024-09-12T18:13:25.968410+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:25.968410+0000","last_undegraded":"2024-09-12T18:13:25.968410+0000","last_fullsized":"2024-09-12T18:13:25.968410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:28.043135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711574+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:25.711574+0000","last_peered":"2024-09-12T18:13:25.711574+0000","last_clean":"2024-09-12T18:13:25.711574+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:25.711574+0000","last_undegraded":"2024-09-12T18:13:25.711574+0000","last_fullsized":"2024-09-12T18:13:25.711574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710459+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:25.710459+0000","last_peered":"2024-09-12T18:13:25.710459+0000","last_clean":"2024-09-12T18:13:25.710459+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:25.710459+0000","last_undegraded":"2024-09-12T18:13:25.710459+0000","last_fullsized":"2024-09-12T18:13:25.710459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968395+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:25.968395+0000","last_peered":"2024-09-12T18:13:25.968395+0000","last_clean":"2024-09-12T18:13:25.968395+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:25.968395+0000","last_undegraded":"2024-09-12T18:13:25.968395+0000","last_fullsized":"2024-09-12T18:13:25.968395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710265+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:25.710265+0000","last_peered":"2024-09-12T18:13:25.710265+0000","last_clean":"2024-09-12T18:13:25.710265+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:25.710265+0000","last_undegraded":"2024-09-12T18:13:25.710265+0000","last_fullsized":"2024-09-12T18:13:25.710265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709989+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:25.709989+0000","last_peered":"2024-09-12T18:13:25.709989+0000","last_clean":"2024-09-12T18:13:25.709989+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:25.709989+0000","last_undegraded":"2024-09-12T18:13:25.709989+0000","last_fullsized":"2024-09-12T18:13:25.709989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709523+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:25.709523+0000","last_peered":"2024-09-12T18:13:25.709523+0000","last_clean":"2024-09-12T18:13:25.709523+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:25.709523+0000","last_undegraded":"2024-09-12T18:13:25.709523+0000","last_fullsized":"2024-09-12T18:13:25.709523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712644+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:25.712644+0000","last_peered":"2024-09-12T18:13:25.712644+0000","last_clean":"2024-09-12T18:13:25.712644+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:25.712644+0000","last_undegraded":"2024-09-12T18:13:25.712644+0000","last_fullsized":"2024-09-12T18:13:25.712644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967673+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:25.967673+0000","last_peered":"2024-09-12T18:13:25.967673+0000","last_clean":"2024-09-12T18:13:25.967673+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:25.967673+0000","last_undegraded":"2024-09-12T18:13:25.967673+0000","last_fullsized":"2024-09-12T18:13:25.967673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711590+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:25.711590+0000","last_peered":"2024-09-12T18:13:25.711590+0000","last_clean":"2024-09-12T18:13:25.711590+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:25.711590+0000","last_undegraded":"2024-09-12T18:13:25.711590+0000","last_fullsized":"2024-09-12T18:13:25.711590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966847+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:25.966847+0000","last_peered":"2024-09-12T18:13:25.966847+0000","last_clean":"2024-09-12T18:13:25.966847+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:25.966847+0000","last_undegraded":"2024-09-12T18:13:25.966847+0000","last_fullsized":"2024-09-12T18:13:25.966847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:11.642559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966591+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:25.966591+0000","last_peered":"2024-09-12T18:13:25.966591+0000","last_clean":"2024-09-12T18:13:25.966591+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:25.966591+0000","last_undegraded":"2024-09-12T18:13:25.966591+0000","last_fullsized":"2024-09-12T18:13:25.966591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:19.521219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710513+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:25.710513+0000","last_peered":"2024-09-12T18:13:25.710513+0000","last_clean":"2024-09-12T18:13:25.710513+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:25.710513+0000","last_undegraded":"2024-09-12T18:13:25.710513+0000","last_fullsized":"2024-09-12T18:13:25.710513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710072+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:25.710072+0000","last_peered":"2024-09-12T18:13:25.710072+0000","last_clean":"2024-09-12T18:13:25.710072+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:25.710072+0000","last_undegraded":"2024-09-12T18:13:25.710072+0000","last_fullsized":"2024-09-12T18:13:25.710072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709540+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:25.709540+0000","last_peered":"2024-09-12T18:13:25.709540+0000","last_clean":"2024-09-12T18:13:25.709540+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:25.709540+0000","last_undegraded":"2024-09-12T18:13:25.709540+0000","last_fullsized":"2024-09-12T18:13:25.709540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713717+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:25.713717+0000","last_peered":"2024-09-12T18:13:25.713717+0000","last_clean":"2024-09-12T18:13:25.713717+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:25.713717+0000","last_undegraded":"2024-09-12T18:13:25.713717+0000","last_fullsized":"2024-09-12T18:13:25.713717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.970982+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:25.970982+0000","last_peered":"2024-09-12T18:13:25.970982+0000","last_clean":"2024-09-12T18:13:25.970982+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:25.970982+0000","last_undegraded":"2024-09-12T18:13:25.970982+0000","last_fullsized":"2024-09-12T18:13:25.970982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712588+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:25.712588+0000","last_peered":"2024-09-12T18:13:25.712588+0000","last_clean":"2024-09-12T18:13:25.712588+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:25.712588+0000","last_undegraded":"2024-09-12T18:13:25.712588+0000","last_fullsized":"2024-09-12T18:13:25.712588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710743+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:25.710743+0000","last_peered":"2024-09-12T18:13:25.710743+0000","last_clean":"2024-09-12T18:13:25.710743+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:25.710743+0000","last_undegraded":"2024-09-12T18:13:25.710743+0000","last_fullsized":"2024-09-12T18:13:25.710743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711911+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:25.711911+0000","last_peered":"2024-09-12T18:13:25.711911+0000","last_clean":"2024-09-12T18:13:25.711911+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:25.711911+0000","last_undegraded":"2024-09-12T18:13:25.711911+0000","last_fullsized":"2024-09-12T18:13:25.711911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967391+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:25.967391+0000","last_peered":"2024-09-12T18:13:25.967391+0000","last_clean":"2024-09-12T18:13:25.967391+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:25.967391+0000","last_undegraded":"2024-09-12T18:13:25.967391+0000","last_fullsized":"2024-09-12T18:13:25.967391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711033+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:25.711033+0000","last_peered":"2024-09-12T18:13:25.711033+0000","last_clean":"2024-09-12T18:13:25.711033+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:25.711033+0000","last_undegraded":"2024-09-12T18:13:25.711033+0000","last_fullsized":"2024-09-12T18:13:25.711033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966200+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:25.966200+0000","last_peered":"2024-09-12T18:13:25.966200+0000","last_clean":"2024-09-12T18:13:25.966200+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:25.966200+0000","last_undegraded":"2024-09-12T18:13:25.966200+0000","last_fullsized":"2024-09-12T18:13:25.966200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:14.363786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969120+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:25.969120+0000","last_peered":"2024-09-12T18:13:25.969120+0000","last_clean":"2024-09-12T18:13:25.969120+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:25.969120+0000","last_undegraded":"2024-09-12T18:13:25.969120+0000","last_fullsized":"2024-09-12T18:13:25.969120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713398+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:25.713398+0000","last_peered":"2024-09-12T18:13:25.713398+0000","last_clean":"2024-09-12T18:13:25.713398+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:25.713398+0000","last_undegraded":"2024-09-12T18:13:25.713398+0000","last_fullsized":"2024-09-12T18:13:25.713398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711806+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:25.711806+0000","last_peered":"2024-09-12T18:13:25.711806+0000","last_clean":"2024-09-12T18:13:25.711806+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:25.711806+0000","last_undegraded":"2024-09-12T18:13:25.711806+0000","last_fullsized":"2024-09-12T18:13:25.711806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969248+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:25.969248+0000","last_peered":"2024-09-12T18:13:25.969248+0000","last_clean":"2024-09-12T18:13:25.969248+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:25.969248+0000","last_undegraded":"2024-09-12T18:13:25.969248+0000","last_fullsized":"2024-09-12T18:13:25.969248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:39.628972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712080+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:25.712080+0000","last_peered":"2024-09-12T18:13:25.712080+0000","last_clean":"2024-09-12T18:13:25.712080+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:25.712080+0000","last_undegraded":"2024-09-12T18:13:25.712080+0000","last_fullsized":"2024-09-12T18:13:25.712080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968152+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:25.968152+0000","last_peered":"2024-09-12T18:13:25.968152+0000","last_clean":"2024-09-12T18:13:25.968152+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:25.968152+0000","last_undegraded":"2024-09-12T18:13:25.968152+0000","last_fullsized":"2024-09-12T18:13:25.968152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711247+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:25.711247+0000","last_peered":"2024-09-12T18:13:25.711247+0000","last_clean":"2024-09-12T18:13:25.711247+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:25.711247+0000","last_undegraded":"2024-09-12T18:13:25.711247+0000","last_fullsized":"2024-09-12T18:13:25.711247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709806+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:25.709806+0000","last_peered":"2024-09-12T18:13:25.709806+0000","last_clean":"2024-09-12T18:13:25.709806+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:25.709806+0000","last_undegraded":"2024-09-12T18:13:25.709806+0000","last_fullsized":"2024-09-12T18:13:25.709806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969367+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:25.969367+0000","last_peered":"2024-09-12T18:13:25.969367+0000","last_clean":"2024-09-12T18:13:25.969367+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:25.969367+0000","last_undegraded":"2024-09-12T18:13:25.969367+0000","last_fullsized":"2024-09-12T18:13:25.969367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712179+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.712179+0000","last_peered":"2024-09-12T18:13:25.712179+0000","last_clean":"2024-09-12T18:13:25.712179+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:25.712179+0000","last_undegraded":"2024-09-12T18:13:25.712179+0000","last_fullsized":"2024-09-12T18:13:25.712179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969380+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:25.969380+0000","last_peered":"2024-09-12T18:13:25.969380+0000","last_clean":"2024-09-12T18:13:25.969380+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:25.969380+0000","last_undegraded":"2024-09-12T18:13:25.969380+0000","last_fullsized":"2024-09-12T18:13:25.969380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712112+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:25.712112+0000","last_peered":"2024-09-12T18:13:25.712112+0000","last_clean":"2024-09-12T18:13:25.712112+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:25.712112+0000","last_undegraded":"2024-09-12T18:13:25.712112+0000","last_fullsized":"2024-09-12T18:13:25.712112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713760+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:25.713760+0000","last_peered":"2024-09-12T18:13:25.713760+0000","last_clean":"2024-09-12T18:13:25.713760+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:25.713760+0000","last_undegraded":"2024-09-12T18:13:25.713760+0000","last_fullsized":"2024-09-12T18:13:25.713760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967657+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:25.967657+0000","last_peered":"2024-09-12T18:13:25.967657+0000","last_clean":"2024-09-12T18:13:25.967657+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:25.967657+0000","last_undegraded":"2024-09-12T18:13:25.967657+0000","last_fullsized":"2024-09-12T18:13:25.967657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712910+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:25.712910+0000","last_peered":"2024-09-12T18:13:25.712910+0000","last_clean":"2024-09-12T18:13:25.712910+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:25.712910+0000","last_undegraded":"2024-09-12T18:13:25.712910+0000","last_fullsized":"2024-09-12T18:13:25.712910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709830+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:25.709830+0000","last_peered":"2024-09-12T18:13:25.709830+0000","last_clean":"2024-09-12T18:13:25.709830+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:25.709830+0000","last_undegraded":"2024-09-12T18:13:25.709830+0000","last_fullsized":"2024-09-12T18:13:25.709830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711767+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:25.711767+0000","last_peered":"2024-09-12T18:13:25.711767+0000","last_clean":"2024-09-12T18:13:25.711767+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:25.711767+0000","last_undegraded":"2024-09-12T18:13:25.711767+0000","last_fullsized":"2024-09-12T18:13:25.711767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968373+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:25.968373+0000","last_peered":"2024-09-12T18:13:25.968373+0000","last_clean":"2024-09-12T18:13:25.968373+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:25.968373+0000","last_undegraded":"2024-09-12T18:13:25.968373+0000","last_fullsized":"2024-09-12T18:13:25.968373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971527+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:25.971527+0000","last_peered":"2024-09-12T18:13:25.971527+0000","last_clean":"2024-09-12T18:13:25.971527+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:25.971527+0000","last_undegraded":"2024-09-12T18:13:25.971527+0000","last_fullsized":"2024-09-12T18:13:25.971527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966713+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:25.966713+0000","last_peered":"2024-09-12T18:13:25.966713+0000","last_clean":"2024-09-12T18:13:25.966713+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:25.966713+0000","last_undegraded":"2024-09-12T18:13:25.966713+0000","last_fullsized":"2024-09-12T18:13:25.966713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712187+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:25.712187+0000","last_peered":"2024-09-12T18:13:25.712187+0000","last_clean":"2024-09-12T18:13:25.712187+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:25.712187+0000","last_undegraded":"2024-09-12T18:13:25.712187+0000","last_fullsized":"2024-09-12T18:13:25.712187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710755+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:25.710755+0000","last_peered":"2024-09-12T18:13:25.710755+0000","last_clean":"2024-09-12T18:13:25.710755+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:25.710755+0000","last_undegraded":"2024-09-12T18:13:25.710755+0000","last_fullsized":"2024-09-12T18:13:25.710755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711303+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:25.711303+0000","last_peered":"2024-09-12T18:13:25.711303+0000","last_clean":"2024-09-12T18:13:25.711303+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:25.711303+0000","last_undegraded":"2024-09-12T18:13:25.711303+0000","last_fullsized":"2024-09-12T18:13:25.711303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712146+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:25.712146+0000","last_peered":"2024-09-12T18:13:25.712146+0000","last_clean":"2024-09-12T18:13:25.712146+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:25.712146+0000","last_undegraded":"2024-09-12T18:13:25.712146+0000","last_fullsized":"2024-09-12T18:13:25.712146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712561+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:25.712561+0000","last_peered":"2024-09-12T18:13:25.712561+0000","last_clean":"2024-09-12T18:13:25.712561+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:25.712561+0000","last_undegraded":"2024-09-12T18:13:25.712561+0000","last_fullsized":"2024-09-12T18:13:25.712561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710880+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:25.710880+0000","last_peered":"2024-09-12T18:13:25.710880+0000","last_clean":"2024-09-12T18:13:25.710880+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:25.710880+0000","last_undegraded":"2024-09-12T18:13:25.710880+0000","last_fullsized":"2024-09-12T18:13:25.710880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711501+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:25.711501+0000","last_peered":"2024-09-12T18:13:25.711501+0000","last_clean":"2024-09-12T18:13:25.711501+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:25.711501+0000","last_undegraded":"2024-09-12T18:13:25.711501+0000","last_fullsized":"2024-09-12T18:13:25.711501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711977+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:25.711977+0000","last_peered":"2024-09-12T18:13:25.711977+0000","last_clean":"2024-09-12T18:13:25.711977+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:25.711977+0000","last_undegraded":"2024-09-12T18:13:25.711977+0000","last_fullsized":"2024-09-12T18:13:25.711977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968051+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.968051+0000","last_peered":"2024-09-12T18:13:25.968051+0000","last_clean":"2024-09-12T18:13:25.968051+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:25.968051+0000","last_undegraded":"2024-09-12T18:13:25.968051+0000","last_fullsized":"2024-09-12T18:13:25.968051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710918+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:25.710918+0000","last_peered":"2024-09-12T18:13:25.710918+0000","last_clean":"2024-09-12T18:13:25.710918+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:25.710918+0000","last_undegraded":"2024-09-12T18:13:25.710918+0000","last_fullsized":"2024-09-12T18:13:25.710918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968945+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:25.968945+0000","last_peered":"2024-09-12T18:13:25.968945+0000","last_clean":"2024-09-12T18:13:25.968945+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:25.968945+0000","last_undegraded":"2024-09-12T18:13:25.968945+0000","last_fullsized":"2024-09-12T18:13:25.968945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713085+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:25.713085+0000","last_peered":"2024-09-12T18:13:25.713085+0000","last_clean":"2024-09-12T18:13:25.713085+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:25.713085+0000","last_undegraded":"2024-09-12T18:13:25.713085+0000","last_fullsized":"2024-09-12T18:13:25.713085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710339+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:25.710339+0000","last_peered":"2024-09-12T18:13:25.710339+0000","last_clean":"2024-09-12T18:13:25.710339+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:25.710339+0000","last_undegraded":"2024-09-12T18:13:25.710339+0000","last_fullsized":"2024-09-12T18:13:25.710339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712791+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:25.712791+0000","last_peered":"2024-09-12T18:13:25.712791+0000","last_clean":"2024-09-12T18:13:25.712791+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:25.712791+0000","last_undegraded":"2024-09-12T18:13:25.712791+0000","last_fullsized":"2024-09-12T18:13:25.712791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712472+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:25.712472+0000","last_peered":"2024-09-12T18:13:25.712472+0000","last_clean":"2024-09-12T18:13:25.712472+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:25.712472+0000","last_undegraded":"2024-09-12T18:13:25.712472+0000","last_fullsized":"2024-09-12T18:13:25.712472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712072+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:25.712072+0000","last_peered":"2024-09-12T18:13:25.712072+0000","last_clean":"2024-09-12T18:13:25.712072+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:25.712072+0000","last_undegraded":"2024-09-12T18:13:25.712072+0000","last_fullsized":"2024-09-12T18:13:25.712072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710218+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:25.710218+0000","last_peered":"2024-09-12T18:13:25.710218+0000","last_clean":"2024-09-12T18:13:25.710218+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:25.710218+0000","last_undegraded":"2024-09-12T18:13:25.710218+0000","last_fullsized":"2024-09-12T18:13:25.710218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711705+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:25.711705+0000","last_peered":"2024-09-12T18:13:25.711705+0000","last_clean":"2024-09-12T18:13:25.711705+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:25.711705+0000","last_undegraded":"2024-09-12T18:13:25.711705+0000","last_fullsized":"2024-09-12T18:13:25.711705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969393+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:25.969393+0000","last_peered":"2024-09-12T18:13:25.969393+0000","last_clean":"2024-09-12T18:13:25.969393+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:25.969393+0000","last_undegraded":"2024-09-12T18:13:25.969393+0000","last_fullsized":"2024-09-12T18:13:25.969393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712097+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:25.712097+0000","last_peered":"2024-09-12T18:13:25.712097+0000","last_clean":"2024-09-12T18:13:25.712097+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:25.712097+0000","last_undegraded":"2024-09-12T18:13:25.712097+0000","last_fullsized":"2024-09-12T18:13:25.712097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969333+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:25.969333+0000","last_peered":"2024-09-12T18:13:25.969333+0000","last_clean":"2024-09-12T18:13:25.969333+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:25.969333+0000","last_undegraded":"2024-09-12T18:13:25.969333+0000","last_fullsized":"2024-09-12T18:13:25.969333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713169+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:25.713169+0000","last_peered":"2024-09-12T18:13:25.713169+0000","last_clean":"2024-09-12T18:13:25.713169+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:25.713169+0000","last_undegraded":"2024-09-12T18:13:25.713169+0000","last_fullsized":"2024-09-12T18:13:25.713169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711699+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:25.711699+0000","last_peered":"2024-09-12T18:13:25.711699+0000","last_clean":"2024-09-12T18:13:25.711699+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:25.711699+0000","last_undegraded":"2024-09-12T18:13:25.711699+0000","last_fullsized":"2024-09-12T18:13:25.711699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712590+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:25.712590+0000","last_peered":"2024-09-12T18:13:25.712590+0000","last_clean":"2024-09-12T18:13:25.712590+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:25.712590+0000","last_undegraded":"2024-09-12T18:13:25.712590+0000","last_fullsized":"2024-09-12T18:13:25.712590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712999+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:25.712999+0000","last_peered":"2024-09-12T18:13:25.712999+0000","last_clean":"2024-09-12T18:13:25.712999+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:25.712999+0000","last_undegraded":"2024-09-12T18:13:25.712999+0000","last_fullsized":"2024-09-12T18:13:25.712999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712620+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:25.712620+0000","last_peered":"2024-09-12T18:13:25.712620+0000","last_clean":"2024-09-12T18:13:25.712620+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:25.712620+0000","last_undegraded":"2024-09-12T18:13:25.712620+0000","last_fullsized":"2024-09-12T18:13:25.712620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713380+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:25.713380+0000","last_peered":"2024-09-12T18:13:25.713380+0000","last_clean":"2024-09-12T18:13:25.713380+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:25.713380+0000","last_undegraded":"2024-09-12T18:13:25.713380+0000","last_fullsized":"2024-09-12T18:13:25.713380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967087+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:25.967087+0000","last_peered":"2024-09-12T18:13:25.967087+0000","last_clean":"2024-09-12T18:13:25.967087+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:25.967087+0000","last_undegraded":"2024-09-12T18:13:25.967087+0000","last_fullsized":"2024-09-12T18:13:25.967087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:08.786394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713264+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:25.713264+0000","last_peered":"2024-09-12T18:13:25.713264+0000","last_clean":"2024-09-12T18:13:25.713264+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:25.713264+0000","last_undegraded":"2024-09-12T18:13:25.713264+0000","last_fullsized":"2024-09-12T18:13:25.713264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.965581+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:25.965581+0000","last_peered":"2024-09-12T18:13:25.965581+0000","last_clean":"2024-09-12T18:13:25.965581+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:25.965581+0000","last_undegraded":"2024-09-12T18:13:25.965581+0000","last_fullsized":"2024-09-12T18:13:25.965581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967306+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:25.967306+0000","last_peered":"2024-09-12T18:13:25.967306+0000","last_clean":"2024-09-12T18:13:25.967306+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:25.967306+0000","last_undegraded":"2024-09-12T18:13:25.967306+0000","last_fullsized":"2024-09-12T18:13:25.967306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:03.114396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713861+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:25.713861+0000","last_peered":"2024-09-12T18:13:25.713861+0000","last_clean":"2024-09-12T18:13:25.713861+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:25.713861+0000","last_undegraded":"2024-09-12T18:13:25.713861+0000","last_fullsized":"2024-09-12T18:13:25.713861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.714052+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:25.714052+0000","last_peered":"2024-09-12T18:13:25.714052+0000","last_clean":"2024-09-12T18:13:25.714052+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:25.714052+0000","last_undegraded":"2024-09-12T18:13:25.714052+0000","last_fullsized":"2024-09-12T18:13:25.714052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711411+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:25.711411+0000","last_peered":"2024-09-12T18:13:25.711411+0000","last_clean":"2024-09-12T18:13:25.711411+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:25.711411+0000","last_undegraded":"2024-09-12T18:13:25.711411+0000","last_fullsized":"2024-09-12T18:13:25.711411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713926+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:25.713926+0000","last_peered":"2024-09-12T18:13:25.713926+0000","last_clean":"2024-09-12T18:13:25.713926+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:25.713926+0000","last_undegraded":"2024-09-12T18:13:25.713926+0000","last_fullsized":"2024-09-12T18:13:25.713926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712009+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:25.712009+0000","last_peered":"2024-09-12T18:13:25.712009+0000","last_clean":"2024-09-12T18:13:25.712009+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:25.712009+0000","last_undegraded":"2024-09-12T18:13:25.712009+0000","last_fullsized":"2024-09-12T18:13:25.712009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967422+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:25.967422+0000","last_peered":"2024-09-12T18:13:25.967422+0000","last_clean":"2024-09-12T18:13:25.967422+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:25.967422+0000","last_undegraded":"2024-09-12T18:13:25.967422+0000","last_fullsized":"2024-09-12T18:13:25.967422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:51.724774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711400+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:25.711400+0000","last_peered":"2024-09-12T18:13:25.711400+0000","last_clean":"2024-09-12T18:13:25.711400+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:25.711400+0000","last_undegraded":"2024-09-12T18:13:25.711400+0000","last_fullsized":"2024-09-12T18:13:25.711400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711255+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:25.711255+0000","last_peered":"2024-09-12T18:13:25.711255+0000","last_clean":"2024-09-12T18:13:25.711255+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:25.711255+0000","last_undegraded":"2024-09-12T18:13:25.711255+0000","last_fullsized":"2024-09-12T18:13:25.711255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711534+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:25.711534+0000","last_peered":"2024-09-12T18:13:25.711534+0000","last_clean":"2024-09-12T18:13:25.711534+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:25.711534+0000","last_undegraded":"2024-09-12T18:13:25.711534+0000","last_fullsized":"2024-09-12T18:13:25.711534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971815+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:25.971815+0000","last_peered":"2024-09-12T18:13:25.971815+0000","last_clean":"2024-09-12T18:13:25.971815+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:25.971815+0000","last_undegraded":"2024-09-12T18:13:25.971815+0000","last_fullsized":"2024-09-12T18:13:25.971815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711391+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:25.711391+0000","last_peered":"2024-09-12T18:13:25.711391+0000","last_clean":"2024-09-12T18:13:25.711391+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:25.711391+0000","last_undegraded":"2024-09-12T18:13:25.711391+0000","last_fullsized":"2024-09-12T18:13:25.711391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711290+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:25.711290+0000","last_peered":"2024-09-12T18:13:25.711290+0000","last_clean":"2024-09-12T18:13:25.711290+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:25.711290+0000","last_undegraded":"2024-09-12T18:13:25.711290+0000","last_fullsized":"2024-09-12T18:13:25.711290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713569+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:25.713569+0000","last_peered":"2024-09-12T18:13:25.713569+0000","last_clean":"2024-09-12T18:13:25.713569+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:25.713569+0000","last_undegraded":"2024-09-12T18:13:25.713569+0000","last_fullsized":"2024-09-12T18:13:25.713569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711485+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:25.711485+0000","last_peered":"2024-09-12T18:13:25.711485+0000","last_clean":"2024-09-12T18:13:25.711485+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:25.711485+0000","last_undegraded":"2024-09-12T18:13:25.711485+0000","last_fullsized":"2024-09-12T18:13:25.711485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971298+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:25.971298+0000","last_peered":"2024-09-12T18:13:25.971298+0000","last_clean":"2024-09-12T18:13:25.971298+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:25.971298+0000","last_undegraded":"2024-09-12T18:13:25.971298+0000","last_fullsized":"2024-09-12T18:13:25.971298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711703+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:25.711703+0000","last_peered":"2024-09-12T18:13:25.711703+0000","last_clean":"2024-09-12T18:13:25.711703+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:25.711703+0000","last_undegraded":"2024-09-12T18:13:25.711703+0000","last_fullsized":"2024-09-12T18:13:25.711703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713449+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:25.713449+0000","last_peered":"2024-09-12T18:13:25.713449+0000","last_clean":"2024-09-12T18:13:25.713449+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:25.713449+0000","last_undegraded":"2024-09-12T18:13:25.713449+0000","last_fullsized":"2024-09-12T18:13:25.713449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711550+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:25.711550+0000","last_peered":"2024-09-12T18:13:25.711550+0000","last_clean":"2024-09-12T18:13:25.711550+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:25.711550+0000","last_undegraded":"2024-09-12T18:13:25.711550+0000","last_fullsized":"2024-09-12T18:13:25.711550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971442+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:25.971442+0000","last_peered":"2024-09-12T18:13:25.971442+0000","last_clean":"2024-09-12T18:13:25.971442+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:25.971442+0000","last_undegraded":"2024-09-12T18:13:25.971442+0000","last_fullsized":"2024-09-12T18:13:25.971442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968718+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:25.968718+0000","last_peered":"2024-09-12T18:13:25.968718+0000","last_clean":"2024-09-12T18:13:25.968718+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:25.968718+0000","last_undegraded":"2024-09-12T18:13:25.968718+0000","last_fullsized":"2024-09-12T18:13:25.968718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967969+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:25.967969+0000","last_peered":"2024-09-12T18:13:25.967969+0000","last_clean":"2024-09-12T18:13:25.967969+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:25.967969+0000","last_undegraded":"2024-09-12T18:13:25.967969+0000","last_fullsized":"2024-09-12T18:13:25.967969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:27.815530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968021+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:25.968021+0000","last_peered":"2024-09-12T18:13:25.968021+0000","last_clean":"2024-09-12T18:13:25.968021+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:25.968021+0000","last_undegraded":"2024-09-12T18:13:25.968021+0000","last_fullsized":"2024-09-12T18:13:25.968021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711259+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:25.711259+0000","last_peered":"2024-09-12T18:13:25.711259+0000","last_clean":"2024-09-12T18:13:25.711259+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:25.711259+0000","last_undegraded":"2024-09-12T18:13:25.711259+0000","last_fullsized":"2024-09-12T18:13:25.711259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710998+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:25.710998+0000","last_peered":"2024-09-12T18:13:25.710998+0000","last_clean":"2024-09-12T18:13:25.710998+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:25.710998+0000","last_undegraded":"2024-09-12T18:13:25.710998+0000","last_fullsized":"2024-09-12T18:13:25.710998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711349+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:25.711349+0000","last_peered":"2024-09-12T18:13:25.711349+0000","last_clean":"2024-09-12T18:13:25.711349+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:25.711349+0000","last_undegraded":"2024-09-12T18:13:25.711349+0000","last_fullsized":"2024-09-12T18:13:25.711349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971174+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:25.971174+0000","last_peered":"2024-09-12T18:13:25.971174+0000","last_clean":"2024-09-12T18:13:25.971174+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:25.971174+0000","last_undegraded":"2024-09-12T18:13:25.971174+0000","last_fullsized":"2024-09-12T18:13:25.971174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968579+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:25.968579+0000","last_peered":"2024-09-12T18:13:25.968579+0000","last_clean":"2024-09-12T18:13:25.968579+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:25.968579+0000","last_undegraded":"2024-09-12T18:13:25.968579+0000","last_fullsized":"2024-09-12T18:13:25.968579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713731+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:25.713731+0000","last_peered":"2024-09-12T18:13:25.713731+0000","last_clean":"2024-09-12T18:13:25.713731+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:25.713731+0000","last_undegraded":"2024-09-12T18:13:25.713731+0000","last_fullsized":"2024-09-12T18:13:25.713731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710058+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:25.710058+0000","last_peered":"2024-09-12T18:13:25.710058+0000","last_clean":"2024-09-12T18:13:25.710058+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:25.710058+0000","last_undegraded":"2024-09-12T18:13:25.710058+0000","last_fullsized":"2024-09-12T18:13:25.710058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713401+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:25.713401+0000","last_peered":"2024-09-12T18:13:25.713401+0000","last_clean":"2024-09-12T18:13:25.713401+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:25.713401+0000","last_undegraded":"2024-09-12T18:13:25.713401+0000","last_fullsized":"2024-09-12T18:13:25.713401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":656071,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":655436,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:36.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:36.965 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:36.983 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T18:13:36.339079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90104,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025416,"statfs":{"total":289910292480,"available":289818025984,"internally_reserved":0,"allocated":704512,"data_stored":1375416,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.632820"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968456+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:25.968456+0000","last_peered":"2024-09-12T18:13:25.968456+0000","last_clean":"2024-09-12T18:13:25.968456+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:25.968456+0000","last_undegraded":"2024-09-12T18:13:25.968456+0000","last_fullsized":"2024-09-12T18:13:25.968456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968410+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:25.968410+0000","last_peered":"2024-09-12T18:13:25.968410+0000","last_clean":"2024-09-12T18:13:25.968410+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:25.968410+0000","last_undegraded":"2024-09-12T18:13:25.968410+0000","last_fullsized":"2024-09-12T18:13:25.968410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:28.043135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711574+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:25.711574+0000","last_peered":"2024-09-12T18:13:25.711574+0000","last_clean":"2024-09-12T18:13:25.711574+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:25.711574+0000","last_undegraded":"2024-09-12T18:13:25.711574+0000","last_fullsized":"2024-09-12T18:13:25.711574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710459+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:25.710459+0000","last_peered":"2024-09-12T18:13:25.710459+0000","last_clean":"2024-09-12T18:13:25.710459+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:25.710459+0000","last_undegraded":"2024-09-12T18:13:25.710459+0000","last_fullsized":"2024-09-12T18:13:25.710459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968395+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:25.968395+0000","last_peered":"2024-09-12T18:13:25.968395+0000","last_clean":"2024-09-12T18:13:25.968395+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:25.968395+0000","last_undegraded":"2024-09-12T18:13:25.968395+0000","last_fullsized":"2024-09-12T18:13:25.968395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710265+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:25.710265+0000","last_peered":"2024-09-12T18:13:25.710265+0000","last_clean":"2024-09-12T18:13:25.710265+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:25.710265+0000","last_undegraded":"2024-09-12T18:13:25.710265+0000","last_fullsized":"2024-09-12T18:13:25.710265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709989+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:25.709989+0000","last_peered":"2024-09-12T18:13:25.709989+0000","last_clean":"2024-09-12T18:13:25.709989+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:25.709989+0000","last_undegraded":"2024-09-12T18:13:25.709989+0000","last_fullsized":"2024-09-12T18:13:25.709989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709523+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:25.709523+0000","last_peered":"2024-09-12T18:13:25.709523+0000","last_clean":"2024-09-12T18:13:25.709523+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:25.709523+0000","last_undegraded":"2024-09-12T18:13:25.709523+0000","last_fullsized":"2024-09-12T18:13:25.709523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712644+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:25.712644+0000","last_peered":"2024-09-12T18:13:25.712644+0000","last_clean":"2024-09-12T18:13:25.712644+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:25.712644+0000","last_undegraded":"2024-09-12T18:13:25.712644+0000","last_fullsized":"2024-09-12T18:13:25.712644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967673+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:25.967673+0000","last_peered":"2024-09-12T18:13:25.967673+0000","last_clean":"2024-09-12T18:13:25.967673+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:25.967673+0000","last_undegraded":"2024-09-12T18:13:25.967673+0000","last_fullsized":"2024-09-12T18:13:25.967673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711590+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:25.711590+0000","last_peered":"2024-09-12T18:13:25.711590+0000","last_clean":"2024-09-12T18:13:25.711590+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:25.711590+0000","last_undegraded":"2024-09-12T18:13:25.711590+0000","last_fullsized":"2024-09-12T18:13:25.711590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966847+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:25.966847+0000","last_peered":"2024-09-12T18:13:25.966847+0000","last_clean":"2024-09-12T18:13:25.966847+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:25.966847+0000","last_undegraded":"2024-09-12T18:13:25.966847+0000","last_fullsized":"2024-09-12T18:13:25.966847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:11.642559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966591+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:25.966591+0000","last_peered":"2024-09-12T18:13:25.966591+0000","last_clean":"2024-09-12T18:13:25.966591+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:25.966591+0000","last_undegraded":"2024-09-12T18:13:25.966591+0000","last_fullsized":"2024-09-12T18:13:25.966591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:19.521219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710513+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:25.710513+0000","last_peered":"2024-09-12T18:13:25.710513+0000","last_clean":"2024-09-12T18:13:25.710513+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:25.710513+0000","last_undegraded":"2024-09-12T18:13:25.710513+0000","last_fullsized":"2024-09-12T18:13:25.710513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710072+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:25.710072+0000","last_peered":"2024-09-12T18:13:25.710072+0000","last_clean":"2024-09-12T18:13:25.710072+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:25.710072+0000","last_undegraded":"2024-09-12T18:13:25.710072+0000","last_fullsized":"2024-09-12T18:13:25.710072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709540+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:25.709540+0000","last_peered":"2024-09-12T18:13:25.709540+0000","last_clean":"2024-09-12T18:13:25.709540+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:25.709540+0000","last_undegraded":"2024-09-12T18:13:25.709540+0000","last_fullsized":"2024-09-12T18:13:25.709540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713717+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:25.713717+0000","last_peered":"2024-09-12T18:13:25.713717+0000","last_clean":"2024-09-12T18:13:25.713717+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:25.713717+0000","last_undegraded":"2024-09-12T18:13:25.713717+0000","last_fullsized":"2024-09-12T18:13:25.713717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.970982+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:25.970982+0000","last_peered":"2024-09-12T18:13:25.970982+0000","last_clean":"2024-09-12T18:13:25.970982+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:25.970982+0000","last_undegraded":"2024-09-12T18:13:25.970982+0000","last_fullsized":"2024-09-12T18:13:25.970982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712588+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:25.712588+0000","last_peered":"2024-09-12T18:13:25.712588+0000","last_clean":"2024-09-12T18:13:25.712588+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:25.712588+0000","last_undegraded":"2024-09-12T18:13:25.712588+0000","last_fullsized":"2024-09-12T18:13:25.712588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710743+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:25.710743+0000","last_peered":"2024-09-12T18:13:25.710743+0000","last_clean":"2024-09-12T18:13:25.710743+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:25.710743+0000","last_undegraded":"2024-09-12T18:13:25.710743+0000","last_fullsized":"2024-09-12T18:13:25.710743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711911+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:25.711911+0000","last_peered":"2024-09-12T18:13:25.711911+0000","last_clean":"2024-09-12T18:13:25.711911+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:25.711911+0000","last_undegraded":"2024-09-12T18:13:25.711911+0000","last_fullsized":"2024-09-12T18:13:25.711911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967391+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:25.967391+0000","last_peered":"2024-09-12T18:13:25.967391+0000","last_clean":"2024-09-12T18:13:25.967391+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:25.967391+0000","last_undegraded":"2024-09-12T18:13:25.967391+0000","last_fullsized":"2024-09-12T18:13:25.967391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711033+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:25.711033+0000","last_peered":"2024-09-12T18:13:25.711033+0000","last_clean":"2024-09-12T18:13:25.711033+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:25.711033+0000","last_undegraded":"2024-09-12T18:13:25.711033+0000","last_fullsized":"2024-09-12T18:13:25.711033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966200+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:25.966200+0000","last_peered":"2024-09-12T18:13:25.966200+0000","last_clean":"2024-09-12T18:13:25.966200+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:25.966200+0000","last_undegraded":"2024-09-12T18:13:25.966200+0000","last_fullsized":"2024-09-12T18:13:25.966200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:14.363786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969120+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:25.969120+0000","last_peered":"2024-09-12T18:13:25.969120+0000","last_clean":"2024-09-12T18:13:25.969120+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:25.969120+0000","last_undegraded":"2024-09-12T18:13:25.969120+0000","last_fullsized":"2024-09-12T18:13:25.969120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713398+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:25.713398+0000","last_peered":"2024-09-12T18:13:25.713398+0000","last_clean":"2024-09-12T18:13:25.713398+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:25.713398+0000","last_undegraded":"2024-09-12T18:13:25.713398+0000","last_fullsized":"2024-09-12T18:13:25.713398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711806+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:25.711806+0000","last_peered":"2024-09-12T18:13:25.711806+0000","last_clean":"2024-09-12T18:13:25.711806+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:25.711806+0000","last_undegraded":"2024-09-12T18:13:25.711806+0000","last_fullsized":"2024-09-12T18:13:25.711806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969248+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:25.969248+0000","last_peered":"2024-09-12T18:13:25.969248+0000","last_clean":"2024-09-12T18:13:25.969248+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:25.969248+0000","last_undegraded":"2024-09-12T18:13:25.969248+0000","last_fullsized":"2024-09-12T18:13:25.969248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:39.628972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712080+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:25.712080+0000","last_peered":"2024-09-12T18:13:25.712080+0000","last_clean":"2024-09-12T18:13:25.712080+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:25.712080+0000","last_undegraded":"2024-09-12T18:13:25.712080+0000","last_fullsized":"2024-09-12T18:13:25.712080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968152+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:25.968152+0000","last_peered":"2024-09-12T18:13:25.968152+0000","last_clean":"2024-09-12T18:13:25.968152+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:25.968152+0000","last_undegraded":"2024-09-12T18:13:25.968152+0000","last_fullsized":"2024-09-12T18:13:25.968152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711247+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:25.711247+0000","last_peered":"2024-09-12T18:13:25.711247+0000","last_clean":"2024-09-12T18:13:25.711247+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:25.711247+0000","last_undegraded":"2024-09-12T18:13:25.711247+0000","last_fullsized":"2024-09-12T18:13:25.711247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709806+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:25.709806+0000","last_peered":"2024-09-12T18:13:25.709806+0000","last_clean":"2024-09-12T18:13:25.709806+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:25.709806+0000","last_undegraded":"2024-09-12T18:13:25.709806+0000","last_fullsized":"2024-09-12T18:13:25.709806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969367+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:25.969367+0000","last_peered":"2024-09-12T18:13:25.969367+0000","last_clean":"2024-09-12T18:13:25.969367+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:25.969367+0000","last_undegraded":"2024-09-12T18:13:25.969367+0000","last_fullsized":"2024-09-12T18:13:25.969367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712179+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.712179+0000","last_peered":"2024-09-12T18:13:25.712179+0000","last_clean":"2024-09-12T18:13:25.712179+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:25.712179+0000","last_undegraded":"2024-09-12T18:13:25.712179+0000","last_fullsized":"2024-09-12T18:13:25.712179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969380+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:25.969380+0000","last_peered":"2024-09-12T18:13:25.969380+0000","last_clean":"2024-09-12T18:13:25.969380+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:25.969380+0000","last_undegraded":"2024-09-12T18:13:25.969380+0000","last_fullsized":"2024-09-12T18:13:25.969380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712112+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:25.712112+0000","last_peered":"2024-09-12T18:13:25.712112+0000","last_clean":"2024-09-12T18:13:25.712112+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:25.712112+0000","last_undegraded":"2024-09-12T18:13:25.712112+0000","last_fullsized":"2024-09-12T18:13:25.712112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713760+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:25.713760+0000","last_peered":"2024-09-12T18:13:25.713760+0000","last_clean":"2024-09-12T18:13:25.713760+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:25.713760+0000","last_undegraded":"2024-09-12T18:13:25.713760+0000","last_fullsized":"2024-09-12T18:13:25.713760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967657+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:25.967657+0000","last_peered":"2024-09-12T18:13:25.967657+0000","last_clean":"2024-09-12T18:13:25.967657+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:25.967657+0000","last_undegraded":"2024-09-12T18:13:25.967657+0000","last_fullsized":"2024-09-12T18:13:25.967657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712910+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:25.712910+0000","last_peered":"2024-09-12T18:13:25.712910+0000","last_clean":"2024-09-12T18:13:25.712910+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:25.712910+0000","last_undegraded":"2024-09-12T18:13:25.712910+0000","last_fullsized":"2024-09-12T18:13:25.712910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.709830+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:25.709830+0000","last_peered":"2024-09-12T18:13:25.709830+0000","last_clean":"2024-09-12T18:13:25.709830+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:25.709830+0000","last_undegraded":"2024-09-12T18:13:25.709830+0000","last_fullsized":"2024-09-12T18:13:25.709830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711767+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:25.711767+0000","last_peered":"2024-09-12T18:13:25.711767+0000","last_clean":"2024-09-12T18:13:25.711767+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:25.711767+0000","last_undegraded":"2024-09-12T18:13:25.711767+0000","last_fullsized":"2024-09-12T18:13:25.711767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968373+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:25.968373+0000","last_peered":"2024-09-12T18:13:25.968373+0000","last_clean":"2024-09-12T18:13:25.968373+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:25.968373+0000","last_undegraded":"2024-09-12T18:13:25.968373+0000","last_fullsized":"2024-09-12T18:13:25.968373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971527+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:25.971527+0000","last_peered":"2024-09-12T18:13:25.971527+0000","last_clean":"2024-09-12T18:13:25.971527+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:25.971527+0000","last_undegraded":"2024-09-12T18:13:25.971527+0000","last_fullsized":"2024-09-12T18:13:25.971527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.966713+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:25.966713+0000","last_peered":"2024-09-12T18:13:25.966713+0000","last_clean":"2024-09-12T18:13:25.966713+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:25.966713+0000","last_undegraded":"2024-09-12T18:13:25.966713+0000","last_fullsized":"2024-09-12T18:13:25.966713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712187+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:25.712187+0000","last_peered":"2024-09-12T18:13:25.712187+0000","last_clean":"2024-09-12T18:13:25.712187+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:25.712187+0000","last_undegraded":"2024-09-12T18:13:25.712187+0000","last_fullsized":"2024-09-12T18:13:25.712187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710755+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:25.710755+0000","last_peered":"2024-09-12T18:13:25.710755+0000","last_clean":"2024-09-12T18:13:25.710755+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:25.710755+0000","last_undegraded":"2024-09-12T18:13:25.710755+0000","last_fullsized":"2024-09-12T18:13:25.710755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711303+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:25.711303+0000","last_peered":"2024-09-12T18:13:25.711303+0000","last_clean":"2024-09-12T18:13:25.711303+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:25.711303+0000","last_undegraded":"2024-09-12T18:13:25.711303+0000","last_fullsized":"2024-09-12T18:13:25.711303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712146+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:25.712146+0000","last_peered":"2024-09-12T18:13:25.712146+0000","last_clean":"2024-09-12T18:13:25.712146+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:25.712146+0000","last_undegraded":"2024-09-12T18:13:25.712146+0000","last_fullsized":"2024-09-12T18:13:25.712146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712561+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:25.712561+0000","last_peered":"2024-09-12T18:13:25.712561+0000","last_clean":"2024-09-12T18:13:25.712561+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:25.712561+0000","last_undegraded":"2024-09-12T18:13:25.712561+0000","last_fullsized":"2024-09-12T18:13:25.712561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710880+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:25.710880+0000","last_peered":"2024-09-12T18:13:25.710880+0000","last_clean":"2024-09-12T18:13:25.710880+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:25.710880+0000","last_undegraded":"2024-09-12T18:13:25.710880+0000","last_fullsized":"2024-09-12T18:13:25.710880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711501+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:25.711501+0000","last_peered":"2024-09-12T18:13:25.711501+0000","last_clean":"2024-09-12T18:13:25.711501+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:25.711501+0000","last_undegraded":"2024-09-12T18:13:25.711501+0000","last_fullsized":"2024-09-12T18:13:25.711501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711977+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:25.711977+0000","last_peered":"2024-09-12T18:13:25.711977+0000","last_clean":"2024-09-12T18:13:25.711977+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:25.711977+0000","last_undegraded":"2024-09-12T18:13:25.711977+0000","last_fullsized":"2024-09-12T18:13:25.711977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968051+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:25.968051+0000","last_peered":"2024-09-12T18:13:25.968051+0000","last_clean":"2024-09-12T18:13:25.968051+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:25.968051+0000","last_undegraded":"2024-09-12T18:13:25.968051+0000","last_fullsized":"2024-09-12T18:13:25.968051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710918+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:25.710918+0000","last_peered":"2024-09-12T18:13:25.710918+0000","last_clean":"2024-09-12T18:13:25.710918+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:25.710918+0000","last_undegraded":"2024-09-12T18:13:25.710918+0000","last_fullsized":"2024-09-12T18:13:25.710918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968945+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:25.968945+0000","last_peered":"2024-09-12T18:13:25.968945+0000","last_clean":"2024-09-12T18:13:25.968945+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:25.968945+0000","last_undegraded":"2024-09-12T18:13:25.968945+0000","last_fullsized":"2024-09-12T18:13:25.968945+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713085+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:25.713085+0000","last_peered":"2024-09-12T18:13:25.713085+0000","last_clean":"2024-09-12T18:13:25.713085+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:25.713085+0000","last_undegraded":"2024-09-12T18:13:25.713085+0000","last_fullsized":"2024-09-12T18:13:25.713085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710339+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:25.710339+0000","last_peered":"2024-09-12T18:13:25.710339+0000","last_clean":"2024-09-12T18:13:25.710339+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:25.710339+0000","last_undegraded":"2024-09-12T18:13:25.710339+0000","last_fullsized":"2024-09-12T18:13:25.710339+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712791+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:25.712791+0000","last_peered":"2024-09-12T18:13:25.712791+0000","last_clean":"2024-09-12T18:13:25.712791+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:25.712791+0000","last_undegraded":"2024-09-12T18:13:25.712791+0000","last_fullsized":"2024-09-12T18:13:25.712791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712472+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:25.712472+0000","last_peered":"2024-09-12T18:13:25.712472+0000","last_clean":"2024-09-12T18:13:25.712472+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:25.712472+0000","last_undegraded":"2024-09-12T18:13:25.712472+0000","last_fullsized":"2024-09-12T18:13:25.712472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712072+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:25.712072+0000","last_peered":"2024-09-12T18:13:25.712072+0000","last_clean":"2024-09-12T18:13:25.712072+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:25.712072+0000","last_undegraded":"2024-09-12T18:13:25.712072+0000","last_fullsized":"2024-09-12T18:13:25.712072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710218+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:25.710218+0000","last_peered":"2024-09-12T18:13:25.710218+0000","last_clean":"2024-09-12T18:13:25.710218+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:25.710218+0000","last_undegraded":"2024-09-12T18:13:25.710218+0000","last_fullsized":"2024-09-12T18:13:25.710218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711705+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:25.711705+0000","last_peered":"2024-09-12T18:13:25.711705+0000","last_clean":"2024-09-12T18:13:25.711705+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:25.711705+0000","last_undegraded":"2024-09-12T18:13:25.711705+0000","last_fullsized":"2024-09-12T18:13:25.711705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969393+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:25.969393+0000","last_peered":"2024-09-12T18:13:25.969393+0000","last_clean":"2024-09-12T18:13:25.969393+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:25.969393+0000","last_undegraded":"2024-09-12T18:13:25.969393+0000","last_fullsized":"2024-09-12T18:13:25.969393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712097+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:25.712097+0000","last_peered":"2024-09-12T18:13:25.712097+0000","last_clean":"2024-09-12T18:13:25.712097+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:25.712097+0000","last_undegraded":"2024-09-12T18:13:25.712097+0000","last_fullsized":"2024-09-12T18:13:25.712097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.969333+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:25.969333+0000","last_peered":"2024-09-12T18:13:25.969333+0000","last_clean":"2024-09-12T18:13:25.969333+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:25.969333+0000","last_undegraded":"2024-09-12T18:13:25.969333+0000","last_fullsized":"2024-09-12T18:13:25.969333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713169+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:25.713169+0000","last_peered":"2024-09-12T18:13:25.713169+0000","last_clean":"2024-09-12T18:13:25.713169+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:25.713169+0000","last_undegraded":"2024-09-12T18:13:25.713169+0000","last_fullsized":"2024-09-12T18:13:25.713169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711699+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:25.711699+0000","last_peered":"2024-09-12T18:13:25.711699+0000","last_clean":"2024-09-12T18:13:25.711699+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:25.711699+0000","last_undegraded":"2024-09-12T18:13:25.711699+0000","last_fullsized":"2024-09-12T18:13:25.711699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712590+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:25.712590+0000","last_peered":"2024-09-12T18:13:25.712590+0000","last_clean":"2024-09-12T18:13:25.712590+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:25.712590+0000","last_undegraded":"2024-09-12T18:13:25.712590+0000","last_fullsized":"2024-09-12T18:13:25.712590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712999+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:25.712999+0000","last_peered":"2024-09-12T18:13:25.712999+0000","last_clean":"2024-09-12T18:13:25.712999+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:25.712999+0000","last_undegraded":"2024-09-12T18:13:25.712999+0000","last_fullsized":"2024-09-12T18:13:25.712999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712620+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:25.712620+0000","last_peered":"2024-09-12T18:13:25.712620+0000","last_clean":"2024-09-12T18:13:25.712620+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:25.712620+0000","last_undegraded":"2024-09-12T18:13:25.712620+0000","last_fullsized":"2024-09-12T18:13:25.712620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713380+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:25.713380+0000","last_peered":"2024-09-12T18:13:25.713380+0000","last_clean":"2024-09-12T18:13:25.713380+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:25.713380+0000","last_undegraded":"2024-09-12T18:13:25.713380+0000","last_fullsized":"2024-09-12T18:13:25.713380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967087+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:25.967087+0000","last_peered":"2024-09-12T18:13:25.967087+0000","last_clean":"2024-09-12T18:13:25.967087+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:25.967087+0000","last_undegraded":"2024-09-12T18:13:25.967087+0000","last_fullsized":"2024-09-12T18:13:25.967087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:08.786394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713264+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:25.713264+0000","last_peered":"2024-09-12T18:13:25.713264+0000","last_clean":"2024-09-12T18:13:25.713264+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:25.713264+0000","last_undegraded":"2024-09-12T18:13:25.713264+0000","last_fullsized":"2024-09-12T18:13:25.713264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.965581+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:25.965581+0000","last_peered":"2024-09-12T18:13:25.965581+0000","last_clean":"2024-09-12T18:13:25.965581+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:25.965581+0000","last_undegraded":"2024-09-12T18:13:25.965581+0000","last_fullsized":"2024-09-12T18:13:25.965581+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967306+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:25.967306+0000","last_peered":"2024-09-12T18:13:25.967306+0000","last_clean":"2024-09-12T18:13:25.967306+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:25.967306+0000","last_undegraded":"2024-09-12T18:13:25.967306+0000","last_fullsized":"2024-09-12T18:13:25.967306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:03.114396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713861+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:25.713861+0000","last_peered":"2024-09-12T18:13:25.713861+0000","last_clean":"2024-09-12T18:13:25.713861+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:25.713861+0000","last_undegraded":"2024-09-12T18:13:25.713861+0000","last_fullsized":"2024-09-12T18:13:25.713861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.714052+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:25.714052+0000","last_peered":"2024-09-12T18:13:25.714052+0000","last_clean":"2024-09-12T18:13:25.714052+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:25.714052+0000","last_undegraded":"2024-09-12T18:13:25.714052+0000","last_fullsized":"2024-09-12T18:13:25.714052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711411+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:25.711411+0000","last_peered":"2024-09-12T18:13:25.711411+0000","last_clean":"2024-09-12T18:13:25.711411+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:25.711411+0000","last_undegraded":"2024-09-12T18:13:25.711411+0000","last_fullsized":"2024-09-12T18:13:25.711411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713926+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:25.713926+0000","last_peered":"2024-09-12T18:13:25.713926+0000","last_clean":"2024-09-12T18:13:25.713926+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:25.713926+0000","last_undegraded":"2024-09-12T18:13:25.713926+0000","last_fullsized":"2024-09-12T18:13:25.713926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.712009+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:25.712009+0000","last_peered":"2024-09-12T18:13:25.712009+0000","last_clean":"2024-09-12T18:13:25.712009+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:25.712009+0000","last_undegraded":"2024-09-12T18:13:25.712009+0000","last_fullsized":"2024-09-12T18:13:25.712009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967422+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:25.967422+0000","last_peered":"2024-09-12T18:13:25.967422+0000","last_clean":"2024-09-12T18:13:25.967422+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:25.967422+0000","last_undegraded":"2024-09-12T18:13:25.967422+0000","last_fullsized":"2024-09-12T18:13:25.967422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:51.724774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711400+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:25.711400+0000","last_peered":"2024-09-12T18:13:25.711400+0000","last_clean":"2024-09-12T18:13:25.711400+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:25.711400+0000","last_undegraded":"2024-09-12T18:13:25.711400+0000","last_fullsized":"2024-09-12T18:13:25.711400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711255+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:25.711255+0000","last_peered":"2024-09-12T18:13:25.711255+0000","last_clean":"2024-09-12T18:13:25.711255+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:25.711255+0000","last_undegraded":"2024-09-12T18:13:25.711255+0000","last_fullsized":"2024-09-12T18:13:25.711255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711534+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:25.711534+0000","last_peered":"2024-09-12T18:13:25.711534+0000","last_clean":"2024-09-12T18:13:25.711534+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:25.711534+0000","last_undegraded":"2024-09-12T18:13:25.711534+0000","last_fullsized":"2024-09-12T18:13:25.711534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971815+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:25.971815+0000","last_peered":"2024-09-12T18:13:25.971815+0000","last_clean":"2024-09-12T18:13:25.971815+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:25.971815+0000","last_undegraded":"2024-09-12T18:13:25.971815+0000","last_fullsized":"2024-09-12T18:13:25.971815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711391+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:25.711391+0000","last_peered":"2024-09-12T18:13:25.711391+0000","last_clean":"2024-09-12T18:13:25.711391+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:25.711391+0000","last_undegraded":"2024-09-12T18:13:25.711391+0000","last_fullsized":"2024-09-12T18:13:25.711391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711290+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:25.711290+0000","last_peered":"2024-09-12T18:13:25.711290+0000","last_clean":"2024-09-12T18:13:25.711290+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:25.711290+0000","last_undegraded":"2024-09-12T18:13:25.711290+0000","last_fullsized":"2024-09-12T18:13:25.711290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713569+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:25.713569+0000","last_peered":"2024-09-12T18:13:25.713569+0000","last_clean":"2024-09-12T18:13:25.713569+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:25.713569+0000","last_undegraded":"2024-09-12T18:13:25.713569+0000","last_fullsized":"2024-09-12T18:13:25.713569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711485+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:25.711485+0000","last_peered":"2024-09-12T18:13:25.711485+0000","last_clean":"2024-09-12T18:13:25.711485+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:25.711485+0000","last_undegraded":"2024-09-12T18:13:25.711485+0000","last_fullsized":"2024-09-12T18:13:25.711485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971298+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:25.971298+0000","last_peered":"2024-09-12T18:13:25.971298+0000","last_clean":"2024-09-12T18:13:25.971298+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:25.971298+0000","last_undegraded":"2024-09-12T18:13:25.971298+0000","last_fullsized":"2024-09-12T18:13:25.971298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711703+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:25.711703+0000","last_peered":"2024-09-12T18:13:25.711703+0000","last_clean":"2024-09-12T18:13:25.711703+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:25.711703+0000","last_undegraded":"2024-09-12T18:13:25.711703+0000","last_fullsized":"2024-09-12T18:13:25.711703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713449+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:25.713449+0000","last_peered":"2024-09-12T18:13:25.713449+0000","last_clean":"2024-09-12T18:13:25.713449+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:25.713449+0000","last_undegraded":"2024-09-12T18:13:25.713449+0000","last_fullsized":"2024-09-12T18:13:25.713449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711550+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:25.711550+0000","last_peered":"2024-09-12T18:13:25.711550+0000","last_clean":"2024-09-12T18:13:25.711550+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:25.711550+0000","last_undegraded":"2024-09-12T18:13:25.711550+0000","last_fullsized":"2024-09-12T18:13:25.711550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971442+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:25.971442+0000","last_peered":"2024-09-12T18:13:25.971442+0000","last_clean":"2024-09-12T18:13:25.971442+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:25.971442+0000","last_undegraded":"2024-09-12T18:13:25.971442+0000","last_fullsized":"2024-09-12T18:13:25.971442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968718+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:25.968718+0000","last_peered":"2024-09-12T18:13:25.968718+0000","last_clean":"2024-09-12T18:13:25.968718+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:25.968718+0000","last_undegraded":"2024-09-12T18:13:25.968718+0000","last_fullsized":"2024-09-12T18:13:25.968718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.967969+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:25.967969+0000","last_peered":"2024-09-12T18:13:25.967969+0000","last_clean":"2024-09-12T18:13:25.967969+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:25.967969+0000","last_undegraded":"2024-09-12T18:13:25.967969+0000","last_fullsized":"2024-09-12T18:13:25.967969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:27.815530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968021+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:25.968021+0000","last_peered":"2024-09-12T18:13:25.968021+0000","last_clean":"2024-09-12T18:13:25.968021+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:25.968021+0000","last_undegraded":"2024-09-12T18:13:25.968021+0000","last_fullsized":"2024-09-12T18:13:25.968021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711259+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:25.711259+0000","last_peered":"2024-09-12T18:13:25.711259+0000","last_clean":"2024-09-12T18:13:25.711259+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:25.711259+0000","last_undegraded":"2024-09-12T18:13:25.711259+0000","last_fullsized":"2024-09-12T18:13:25.711259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710998+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:25.710998+0000","last_peered":"2024-09-12T18:13:25.710998+0000","last_clean":"2024-09-12T18:13:25.710998+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:25.710998+0000","last_undegraded":"2024-09-12T18:13:25.710998+0000","last_fullsized":"2024-09-12T18:13:25.710998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.711349+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:25.711349+0000","last_peered":"2024-09-12T18:13:25.711349+0000","last_clean":"2024-09-12T18:13:25.711349+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:25.711349+0000","last_undegraded":"2024-09-12T18:13:25.711349+0000","last_fullsized":"2024-09-12T18:13:25.711349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.971174+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:25.971174+0000","last_peered":"2024-09-12T18:13:25.971174+0000","last_clean":"2024-09-12T18:13:25.971174+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:25.971174+0000","last_undegraded":"2024-09-12T18:13:25.971174+0000","last_fullsized":"2024-09-12T18:13:25.971174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.968579+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:25.968579+0000","last_peered":"2024-09-12T18:13:25.968579+0000","last_clean":"2024-09-12T18:13:25.968579+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:25.968579+0000","last_undegraded":"2024-09-12T18:13:25.968579+0000","last_fullsized":"2024-09-12T18:13:25.968579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713731+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:25.713731+0000","last_peered":"2024-09-12T18:13:25.713731+0000","last_clean":"2024-09-12T18:13:25.713731+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:25.713731+0000","last_undegraded":"2024-09-12T18:13:25.713731+0000","last_fullsized":"2024-09-12T18:13:25.713731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.710058+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:25.710058+0000","last_peered":"2024-09-12T18:13:25.710058+0000","last_clean":"2024-09-12T18:13:25.710058+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:25.710058+0000","last_undegraded":"2024-09-12T18:13:25.710058+0000","last_fullsized":"2024-09-12T18:13:25.710058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:13:25.713401+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:25.713401+0000","last_peered":"2024-09-12T18:13:25.713401+0000","last_clean":"2024-09-12T18:13:25.713401+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:25.713401+0000","last_undegraded":"2024-09-12T18:13:25.713401+0000","last_fullsized":"2024-09-12T18:13:25.713401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":656071,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":655436,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:36.987 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:13:36.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 20 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 5c1106a1-8b30-400f-94eb-0bea28eb5927 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-09-12T18:13:00.942825+0000 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-09-12T18:13:25.702443+0000 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:crush_version 4 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:full_ratio 0.95 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:backfillfull_ratio 0.9 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:nearfull_ratio 0.85 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:require_min_compat_client luminous 2024-09-12T18:13:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:min_compat_client jewel 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:require_osd_release squid 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:stretch_mode_enabled false 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:max_osd 3 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/1368744816,v1:172.21.15.129:6801/1368744816] [v2:172.21.15.129:6802/1368744816,v1:172.21.15.129:6803/1368744816] exists,up d5348027-f4dc-457f-8b4e-a4341015d874 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/1445669154,v1:172.21.15.151:6801/1445669154] [v2:172.21.15.151:6802/1445669154,v1:172.21.15.151:6803/1445669154] exists,up 939481c0-5bf6-4136-b772-e0ba4c215bf1 2024-09-12T18:13:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6800/752868242,v1:172.21.15.176:6801/752868242] [v2:172.21.15.176:6802/752868242,v1:172.21.15.176:6803/752868242] exists,up 66fc0ac1-f14f-48bf-a557-110b23bff1d2 2024-09-12T18:13:37.348 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/1368744816,v1:172.21.15.129:6801/1368744816] [v2:172.21.15.129:6802/1368744816,v1:172.21.15.129:6803/1368744816] exists,up d5348027-f4dc-457f-8b4e-a4341015d874', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/1445669154,v1:172.21.15.151:6801/1445669154] [v2:172.21.15.151:6802/1445669154,v1:172.21.15.151:6803/1445669154] exists,up 939481c0-5bf6-4136-b772-e0ba4c215bf1', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.176:6800/752868242,v1:172.21.15.176:6801/752868242] [v2:172.21.15.176:6802/752868242,v1:172.21.15.176:6803/752868242] exists,up 66fc0ac1-f14f-48bf-a557-110b23bff1d2'] 2024-09-12T18:13:37.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T18:13:37.466 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:13:37.466 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mon.a", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster": "ceph", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "admin_socket_mode": "", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_client_required": "cephx, none", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_cluster_required": "cephx", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_debug": "true", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_service_required": "cephx", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T18:13:37.467 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_supported": "cephx", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio": "true", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_aio_reap_max": "16", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_async_discard_threads": "0", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_block_size": "4096", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_aio": "false", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_enable_discard": "false", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_flock_retry": "3", 2024-09-12T18:13:37.468 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_inject_crash": "0", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_ioring": "false", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_ioring_hipri": "false", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bdev_type": "", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T18:13:37.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_allocator": "hybrid", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_buffered_io": "true", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T18:13:37.470 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_replay_recovery": "false", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_sync_write": "false", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_allocator": "hybrid", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T18:13:37.471 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_create": "true", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_db_create": "false", 2024-09-12T18:13:37.472 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_db_path": "", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_db_size": "0", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_path": "", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_size": "107374182400", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_wal_create": "false", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_wal_path": "", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs": "true", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T18:13:37.473 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_autotune": "true", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_size": "0", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T18:13:37.474 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_type": "2q", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_clone_cow": "true", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T18:13:37.475 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_mode": "none", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_freelist": "false", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T18:13:37.476 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T18:13:37.477 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fail_eio": "false", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T18:13:37.478 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T18:13:37.479 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_blob_size": "0", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T18:13:37.480 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T18:13:37.481 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_spdk_mem": "512", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_tracing": "false", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T18:13:37.482 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_write_v2": "false", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_write_v2_random": "false", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T18:13:37.483 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T18:13:37.484 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_cluster_require_version": "2", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_require_signatures": "false", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_require_version": "2", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_service_require_signatures": "false", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_service_require_version": "2", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "cephx_sign_messages": "true", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "chdir": "", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_acl_type": "", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_asio_thread_count": "2", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_cache_mid": "0.750000", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_cache_size": "16384", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_caps_release_delay": "5", 2024-09-12T18:13:37.485 INFO:teuthology.orchestra.run.smithi062.stdout: "client_check_pool_perm": "true", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_force_sync_read": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_getattr_caps": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_inject_features": "", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_die_on_failed_remount": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_dirsize_rbytes": "true", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_force_lazyio": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_fs": "", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_inject_release_failure": "false", 2024-09-12T18:13:37.486 INFO:teuthology.orchestra.run.smithi062.stdout: "client_max_inline_size": "4096", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mds_namespace": "", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_metadata": "", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mount_gid": "-1", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mount_timeout": "300", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mount_uid": "-1", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_mountpoint": "/", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_notify_timeout": "10", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc": "true", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_max_objects": "1000", 2024-09-12T18:13:37.487 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_size": "209715200", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_permissions": "true", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_quota": "true", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_quota_df": "true", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_readahead_max_bytes": "0", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_readahead_max_periods": "4", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_readahead_min": "131072", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_reconnect_stale": "false", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_shutdown_timeout": "30", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_snapdir": ".snap", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_tick_interval": "1", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_trace": "", 2024-09-12T18:13:37.488 INFO:teuthology.orchestra.run.smithi062.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "client_use_faked_inos": "false", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "client_use_random_mds": "false", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_graylog": "false", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_graylog_port": "12201", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_monitors": "default=true", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_syslog": "false", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "clog_to_syslog_level": "info", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "-", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_network": "", 2024-09-12T18:13:37.489 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_network_interface": "", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zlib_isal": "false", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zlib_level": "5", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "compressor_zstd_level": "1", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T18:13:37.490 INFO:teuthology.orchestra.run.smithi062.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_location": "", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_location_hook": "", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_location_hook_timeout": "10", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "daemonize": "false", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "daos_pool": "tank", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_alienstore": "0/5", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T18:13:37.491 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_asok": "1/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_asok_assert_abort": "false", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_auth": "20/20", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_bdev": "1/3", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_bluefs": "1/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_bluestore": "1/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_buffer": "0/1", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_cephsqlite": "0/5", 2024-09-12T18:13:37.492 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_client": "0/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_compressor": "1/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_context": "0/1", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_crush": "1/1", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_crypto": "1/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_cyanstore": "0/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_dpdk": "1/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_eventtrace": "1/5", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_filer": "0/1", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_filestore": "1/3", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_finisher": "1/1", 2024-09-12T18:13:37.493 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_fuse": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_javaclient": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_journal": "1/3", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_journaler": "0/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_kstore": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_lockdep": "0/1", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mclock": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_balancer": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_locker": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_log": "1/5", 2024-09-12T18:13:37.494 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_migrator": "1/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_memstore": "1/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mgr": "2/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mgrc": "1/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_mon": "20/20", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_monc": "0/10", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_ms": "1/1", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_none": "0/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_objclass": "0/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_objectcacher": "0/5", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_objecter": "0/1", 2024-09-12T18:13:37.495 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_optracker": "0/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_osd": "1/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_paxos": "20/20", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_perfcounter": "1/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_prioritycache": "1/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rados": "0/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd": "0/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T18:13:37.496 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rbd_replay": "0/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_refs": "0/0", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_reserver": "1/1", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_access": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_flight": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_notification": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rgw_sync": "1/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_rocksdb": "4/5", 2024-09-12T18:13:37.497 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_backref": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_cache": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_device": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_epm": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_journal": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_lba": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_odata": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_omap": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_onode": "0/5", 2024-09-12T18:13:37.498 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_t": "0/5", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_seastore_tm": "0/5", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_striper": "0/1", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_test": "0/5", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_throttle": "1/1", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_timer": "0/1", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_tp": "0/5", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "debug_trace": "1/5", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "device_failure_prediction_mode": "none", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_graylog": "false", 2024-09-12T18:13:37.499 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_journald": "false", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_stderr": "true", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "err_to_syslog": "false", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "event_tracing": "false", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_cert_file": "", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_http_port": "9926", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_key_file": "", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_prio_limit": "5", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_sort_metrics": "true", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "exporter_stats_period": "5", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "fake_statfs_for_testing": "0", 2024-09-12T18:13:37.500 INFO:teuthology.orchestra.run.smithi062.stdout: "fatal_signal_handlers": "true", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filer_max_purge_ops": "10", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filer_max_truncate_ops": "128", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_blackhole": "false", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_btrfs_snap": "true", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_caller_concurrency": "10", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_omap_check": "false", 2024-09-12T18:13:37.501 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_debug_verify_split": "false", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_dump_file": "", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fadvise": "true", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fail_eio": "true", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fd_cache_size": "128", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fiemap": "false", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_inject_stall": "0", 2024-09-12T18:13:37.502 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_journal_parallel": "false", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_journal_trailing": "false", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_journal_writeahead": "false", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_kill_at": "0", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T18:13:37.503 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_merge_threshold": "-10", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_odsync_write": "false", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_omap_backend_path": "", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T18:13:37.504 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_op_threads": "2", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_punch_hole": "false", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_queue_max_ops": "50", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T18:13:37.505 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_seek_data_hole": "false", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_sloppy_crc": "false", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_splice": "false", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_split_multiple": "2", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_split_rand_factor": "20", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_update_to": "1000", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T18:13:37.506 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_xfs_extsize": "false", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "filestore_zfs_snap": "false", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "fio_dir": "/tmp/fio", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_allow_other": "true", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_big_writes": "true", 2024-09-12T18:13:37.507 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_debug": "false", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_default_permissions": "false", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_disable_pagecache": "false", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_max_write": "0", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_multithreaded": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_require_active_mds": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_set_user_groups": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_splice_move": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_splice_read": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_splice_write": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T18:13:37.508 INFO:teuthology.orchestra.run.smithi062.stdout: "gss_target_name": "ceph", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_file": "", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_inject_failure": "0", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_interval": "5", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "host": "smithi062", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T18:13:37.509 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "inject_early_sigterm": "false", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "jaeger_agent_port": "6799", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "jaeger_tracing_enable": "false", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_aio": "true", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_align_min_size": "65536", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_block_align": "true", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_block_size": "4096", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_dio": "true", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_discard": "false", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_force_aio": "false", 2024-09-12T18:13:37.510 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_ignore_corruption": "false", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_max_write_entries": "100", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_replay_from": "0", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_write_header_frequency": "0", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journal_zero_on_create": "false", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journaler_prefetch_periods": "10", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journaler_prezero_periods": "5", 2024-09-12T18:13:37.511 INFO:teuthology.orchestra.run.smithi062.stdout: "journaler_write_head_interval": "15", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "keyfile": "", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_backend": "rocksdb", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_max_bytes": "67108864", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_max_ops": "512", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_onode_map_size": "1024", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T18:13:37.512 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "kstore_sync_transaction": "false", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "librados_thread_count": "2", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "lockdep": "false", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "lockdep_force_backtrace": "false", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_coarse_timestamps": "true", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_flush_on_exit": "false", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_graylog_port": "12201", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_max_new": "1000", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_max_recent": "10000", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_stderr_prefix": "", 2024-09-12T18:13:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": "true", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_graylog": "false", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_journald": "false", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_stderr": "false", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_syslog": "false", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_action_on_write_error": "1", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_alternate_name_max": "8192", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_asio_thread_count": "2", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_export_pin": "true", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T18:13:37.514 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_interval": "10", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_max": "-1", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_max_until": "-1", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_merge_size": "50", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_mode": "0", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T18:13:37.515 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_bits": "3", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_size": "10000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T18:13:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_mid": "0.700000", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_trim_interval": "1", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T18:13:37.517 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_auth_pins": "false", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_frag": "false", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_scatterstat": "false", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_debug_subtrees": "false", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_default_dir_hash": "2", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_defer_session_stale": "true", 2024-09-12T18:13:37.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_max_entries": "0", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dir_prefetch": "true", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_early_reply": "true", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_enable_op_tracker": "true", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_enforce_unique_name": "true", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T18:13:37.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T18:13:37.520 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_health_dummy": "false", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_join_fs": "", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_journal_format": "1", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_create_at": "0", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T18:13:37.521 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_export_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_import_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_journal_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_link_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_openc_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_rename_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T18:13:37.522 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_max_events": "-1", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_max_segments": "128", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_pause": "false", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_segment_size": "0", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_trim_threshold": "128", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T18:13:37.523 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_completed_requests": "100000", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_export_size": "20971520", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_file_recover": "32", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_purge_files": "64", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_purge_ops": "8192", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_metrics_update_interval": "2", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_min_caps_per_client": "100", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T18:13:37.524 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_numa_node": "-1", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_duration": "600", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_size": "20", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_op_log_threshold": "5", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_ping_grace": "15", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_ping_interval": "5", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_max_caps": "30000", 2024-09-12T18:13:37.525 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_replay_interval": "1.000000", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_root_ino_gid": "0", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_root_ino_uid": "0", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_scrub_stats_review_period": "1", 2024-09-12T18:13:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_shutdown_check": "0", 2024-09-12T18:13:37.527 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_skip_ino": "0", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_snap_min_uid": "0", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_snap_rstat": "false", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_symlink_recovery": "true", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_thrash_exports": "0", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_thrash_fragments": "0", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_tick_interval": "5.000000", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_valgrind_exit": "false", 2024-09-12T18:13:37.528 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_verify_backtrace": "1", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_verify_scatter": "false", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_wipe_sessions": "false", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool_debug": "false", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_page_set": "false", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "memstore_page_size": "65536", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_client_bytes": "134217728", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_client_messages": "512", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T18:13:37.529 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_disabled_modules": "", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mds_messages": "128", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_mon_messages": "128", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T18:13:37.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_op_history_duration": "600", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_op_history_size": "20", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_op_log_threshold": "5", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_osd_messages": "8192", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_pool": "true", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_standby_modules": "true", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_stats_period": "5", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_stats_threshold": "5", 2024-09-12T18:13:37.531 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_tick_period": "2", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_allow_pool_delete": "true", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_bytes": "104857600", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T18:13:37.532 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_client_target_rank": "-1", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_level": "debug", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T18:13:37.533 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_compact_on_start": "false", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_compact_on_trim": "true", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_cpu_threads": "4", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T18:13:37.534 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data_avail_crit": "5", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data_avail_warn": "5", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_dump_json": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_extra_checks": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T18:13:37.535 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_down_uptime_grace": "60", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_election_default_strategy": "1", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_election_timeout": "5.000000", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_enable_op_tracker": "true", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_fake_pool_delete": "false", 2024-09-12T18:13:37.536 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_force_quorum_join": "false", 2024-09-12T18:13:37.537 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T18:13:37.537 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T18:13:37.537 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T18:13:37.537 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_log_update_period": "5", 2024-09-12T18:13:37.537 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_max_detail": "50", 2024-09-12T18:13:37.537 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_to_clog": "true", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_host": "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],[v2:172.21.15.62:3302,v1:172.21.15.62:6791]", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_host_override": "", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_initial_members": "", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_lease": "5.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T18:13:37.538 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_log_full_interval": "50", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_log_max": "10000", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_log_max_summary": "50", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_log_epochs": "500", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_osd": "10000", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T18:13:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_memory_autotune": "true", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_memory_target": "2147483648", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_digest_period": "5", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T18:13:37.540 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_complaint_time": "30", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_duration": "600", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_size": "20", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_op_log_threshold": "5", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_cache_size": "500", 2024-09-12T18:13:37.541 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T18:13:37.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_report_timeout": "900", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T18:13:37.543 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T18:13:37.544 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_max_osds": "4", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_interval": "86400", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_max_keys": "100", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_scrub_timeout": "300", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_session_timeout": "300", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_smart_report_timeout": "5", 2024-09-12T18:13:37.545 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_pool_size": "4", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_debug": "false", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T18:13:37.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_tick_interval": "5", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T18:13:37.547 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_older_version": "true", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "monmap": "", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T18:13:37.548 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "motr_tracing_enabled": "false", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_op_threads": "3", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_cm": "false", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_device_name": "", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T18:13:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_sl": "3", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_rdma_type": "ib", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_async_reap_threshold": "5", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_before_connect": "false", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_ipv4": "true", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_ipv6": "false", 2024-09-12T18:13:37.550 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_msgr1": "true", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_msgr2": "true", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_port_max": "7568", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_port_min": "6800", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_retry_count": "3", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_bind_retry_delay": "5", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_client": "false", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_mds": "false", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_mgr": "false", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_mon": "false", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_blackhole_osd": "false", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_client_mode": "crc secure", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T18:13:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_cluster_type": "", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_compress_secure": "false", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_crc_data": "true", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_crc_header": "true", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_bug": "true", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_old_message": "true", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T18:13:37.552 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_hugepages": "", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_lro": "true", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_pmd": "", 2024-09-12T18:13:37.553 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_port_id": "0", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_dump_on_send": "false", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_delay_type": "", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_network_congestion": "0", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_inject_socket_failures": "0", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_max_accept_failures": "4", 2024-09-12T18:13:37.554 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_max_backoff": "15.000000", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_osd_compress_mode": "none", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_pq_min_cost": "65536", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_public_type": "", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_service_mode": "crc secure", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_nodelay": "true", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T18:13:37.555 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "ms_type": "async+posix", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "no_config_file": "false", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_inflight_ops": "1024", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T18:13:37.556 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter_timeout": "10.000000", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "objectstore_blackhole": "false", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "openssl_engine_opts": "", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_max_ops": "4", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_agent_slop": "0.020000", 2024-09-12T18:13:37.557 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_asio_thread_count": "2", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backfill_scan_max": "512", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backfill_scan_min": "64", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backoff_on_peering": "false", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_beacon_report_interval": "300", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_duration": "30", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T18:13:37.558 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_blkin_trace_all": "false", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_class_update_on_start": "true", 2024-09-12T18:13:37.559 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_message_cap": "256", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_op_priority": "63", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_client_watch_timeout": "30", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_command_max_records": "256", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_compact_on_start": "false", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_update_on_start": "true", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T18:13:37.560 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_op_order": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T18:13:37.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_shutdown": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_trim_objects": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T18:13:37.562 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_default_notify_timeout": "30", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ec_partial_reads": "true", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_enable_op_tracker": "true", 2024-09-12T18:13:37.563 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_info": "true", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_shutdown": "true", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T18:13:37.564 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_function_tracing": "false", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_grace": "20", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_interval": "6", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_stale": "600", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T18:13:37.565 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_journal_size": "5120", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_kill_backfill_at": "0", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_cache_size": "50", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_dedup": "true", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_message_max": "40", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_attr_name_len": "100", 2024-09-12T18:13:37.566 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_attr_size": "0", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_backfills": "1", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_markdown_count": "5", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_markdown_period": "600", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_object_name_len": "2048", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_object_size": "134217728", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_pgls": "1024", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_push_cost": "8388608", 2024-09-12T18:13:37.567 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_push_objects": "10", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_scrubs": "3", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_max_write_size": "90", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T18:13:37.568 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_profile": "balanced", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T18:13:37.569 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_base": "805306368", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_target": "4294967296", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_target_autotune": "false", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_min_recovery_priority": "0", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_report_interval": "5", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T18:13:37.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_num_cache_shards": "32", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_numa_node": "-1", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objecter_finishers": "1", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore": "bluestore", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore_fuse": "false", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_objectstore_tracing": "false", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_duration": "600", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_size": "20", 2024-09-12T18:13:37.571 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_log_threshold": "5", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_shards": "0", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T18:13:37.572 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_op_thread_timeout": "15", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_open_classes_on_start": "true", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_os_flags": "0", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_peering_op_priority": "255", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_delete_priority": "5", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T18:13:37.573 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_crimson": "false", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T18:13:37.574 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_flags": "0", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_min_size": "0", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T18:13:37.575 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_size": "2", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_default_type": "replicated", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_cost": "20971520", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_active": "0", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T18:13:37.576 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_op_priority": "3", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_priority": "5", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_repair_during_recovery": "false", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T18:13:37.577 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_cost": "52428800", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_end_hour": "0", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T18:13:37.578 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_priority": "5", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_retry_delay": "30", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-12T18:13:37.579 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_retry_trimming": "10", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_skip_data_digest": "false", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_smart_report_timeout": "5", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_priority": "5", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T18:13:37.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_target_transaction_size": "30", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T18:13:37.581 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_tracing": "false", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_use_stale_snap": "false", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_kill_at": "0", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_max_join_drift": "10", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_min": "500", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_min_wait": "0.050000", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_service_trim_max": "500", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_service_trim_min": "250", 2024-09-12T18:13:37.582 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_stash_full_interval": "25", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_trim_max": "500", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "paxos_trim_min": "250", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "perf": "true", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "-", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrv": "", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "public_bind_addr": "-", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "public_network": "", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "public_network_interface": "", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "qat_compressor_enabled": "false", 2024-09-12T18:13:37.583 INFO:teuthology.orchestra.run.smithi062.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rados_mon_op_timeout": "0", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rados_osd_op_timeout": "0", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rados_tracing": "false", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_atime_update_interval": "60", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache": "true", 2024-09-12T18:13:37.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_policy": "writearound", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_size": "33554432", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_compression_hint": "none", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_clone_format": "auto", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_data_pool": "", 2024-09-12T18:13:37.585 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_features": "61", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_format": "2", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_map_options": "", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_order": "22", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_pool": "rbd", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_stripe_count": "0", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T18:13:37.586 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_io_scheduler": "simple", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_order": "24", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_pool": "", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_journal_splay_width": "4", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T18:13:37.587 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T18:13:37.588 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T18:13:37.589 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_op_threads": "1", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T18:13:37.590 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_plugins": "", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T18:13:37.591 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T18:13:37.592 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_tracing": "false", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_validate_names": "true", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_validate_pool": "true", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "restapi_base_url": "", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "restapi_log_level": "", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_admin_entry": "admin", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T18:13:37.593 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_backend_store": "rados", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_barbican_url": "", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_beast_enable_async": "true", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T18:13:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cache_enabled": "true", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_config_store": "rados", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_content_length_compat": "false", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_cross_domain_policy": "", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T18:13:37.595 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T18:13:37.596 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T18:13:37.597 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T18:13:37.598 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T18:13:37.599 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_log_window": "30", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T18:13:37.600 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_disable_s3select": "false", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T18:13:37.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dns_name": "", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dns_s3website_name": "", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_ops_log": "false", 2024-09-12T18:13:37.602 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_static_website": "false", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enable_usage_log": "false", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_expose_bucket": "false", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_extended_http_attrs": "", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_filter": "none", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_objs": "32", 2024-09-12T18:13:37.603 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_init_timeout": "300", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T18:13:37.604 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_password": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_project": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_token": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_admin_user": "", 2024-09-12T18:13:37.605 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_url": "", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T18:13:37.606 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_objs": "32", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_worker": "3", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ldap_uri": "", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T18:13:37.607 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_http_headers": "", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_attr_size": "0", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T18:13:37.608 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_listing_results": "5000", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_notify_retries": "10", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T18:13:37.609 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T18:13:37.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_num_control_oids": "8", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_numa_node": "-1", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T18:13:37.611 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_op_tracing": "false", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_opa_token": "", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_opa_url": "", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_rados": "false", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T18:13:37.612 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_print_continue": "true", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T18:13:37.613 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rados_tracing": "false", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_realm": "", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_realm_id": "", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_region": "", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_request_uri": "", 2024-09-12T18:13:37.614 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_resolve_cname": "false", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_run_sync_thread": "true", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T18:13:37.615 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_script_uri": "", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_service_provider_name": "", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_client_id": "", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_client_secret": "", 2024-09-12T18:13:37.616 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_entry": "sts", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_key": "sts", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_auth_url": "", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_custom_header": "", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_need_stats": "true", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_tenant_name": "", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_url": "", 2024-09-12T18:13:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_lease_period": "120", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T18:13:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_thread_pool_size": "512", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_comment": "", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_createby": "", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_encoding": "", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_flag": "false", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_origin": "", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_torrent_tracker": "", 2024-09-12T18:13:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_max_shards": "32", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_use_opa_authz": "false", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_counters_cache": "false", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T18:13:37.620 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T18:13:37.621 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T18:13:37.621 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_user_unique_email": "true", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_verify_ssl": "true", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zone": "", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zone_id": "", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zonegroup": "", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zonegroup_id": "", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T18:13:37.624 INFO:teuthology.orchestra.run.smithi062.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_block_size": "4096", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T18:13:37.625 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_partition_filters": "false", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_perf": "false", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "run_dir": "/var/run/ceph", 2024-09-12T18:13:37.626 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_block_create": "true", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_device_size": "53687091200", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_full_integrity_check": "false", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_main_device_type": "SSD", 2024-09-12T18:13:37.627 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "seastore_segment_size": "67108864", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "set_keepcaps": "false", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "setgroup": "", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "setuser": "", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "setuser_match_path": "", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "thp": "false", 2024-09-12T18:13:37.628 INFO:teuthology.orchestra.run.smithi062.stdout: "threadpool_default_timeout": "60", 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout: "throttler_perf_counter": "true", 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tmp_dir": "/tmp", 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout: "uadk_compressor_enabled": "false", 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T18:13:37.629 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:13:37.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T18:13:37.774 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a: {} 2024-09-12T18:13:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:13:37.783 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b: {} 2024-09-12T18:13:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:13:37.793 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c: {} 2024-09-12T18:13:37.793 INFO:teuthology.orchestra.run.smithi062.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:13:37.808 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T18:13:37.809 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-12T18:13:37.820 INFO:tasks.radosbench:Beginning radosbench... 2024-09-12T18:13:37.820 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-12T18:13:37.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-12T18:13:37.821 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T18:13:37.821 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:13:37.821 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:13:37.821 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:13:37.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:13:37.822 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T18:13:37.822 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T18:13:37.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:13:37.823 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T18:13:37.823 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:37.823 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T18:13:37.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:13:37.825 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:37.825+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:37.924 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:37.922+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:37.956 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:37.956 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:13:37.957 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-09-12T18:13:37.957 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:37.971 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:37.977 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:37.977 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:38.013 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:38.013 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:38.048 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:38.048 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:38.056 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:38.054+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:38.126 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:38.125+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:38.136 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:38.137 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:38.152 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 20, 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-09-12T18:13:00.942825+0000", 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-09-12T18:13:25.702443+0000", 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-09-12T18:13:10.269506+0000", 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-09-12T18:13:01.815814+0000", 2024-09-12T18:13:38.162 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-09-12T18:13:38.163 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 4, 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:10.380891+0000", 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:38.164 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:38.165 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-09-12T18:13:38.166 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:38.167 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:38.168 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:38.169 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-09-12T18:13:38.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.171 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:13:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-09-12T18:13:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:16.182185+0000", 2024-09-12T18:13:38.172 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 8193, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:38.173 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:38.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 2, 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 15, 2024-09-12T18:13:38.175 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:38.176 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:38.177 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:38.178 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-09-12T18:13:38.179 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:20.398999+0000", 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:38.180 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:38.181 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "18", 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:38.182 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:38.183 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:38.184 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:13:38.185 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:21.732662+0000", 2024-09-12T18:13:38.186 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-09-12T18:13:38.187 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2024-09-12T18:13:38.188 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:38.189 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.190 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-09-12T18:13:38.191 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:13:38.192 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "d5348027-f4dc-457f-8b4e-a4341015d874", 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:13:38.193 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6800", 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.194 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6801", 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6802", 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6803", 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6806", 2024-09-12T18:13:38.196 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6807", 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6804", 2024-09-12T18:13:38.197 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6805", 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.129:6801/1368744816", 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.129:6803/1368744816", 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.129:6807/1368744816", 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.129:6805/1368744816", 2024-09-12T18:13:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "939481c0-5bf6-4136-b772-e0ba4c215bf1", 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:13:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6800", 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6801", 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6802", 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.201 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6803", 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6806", 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.202 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6807", 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6804", 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.203 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6805", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.151:6801/1445669154", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.151:6803/1445669154", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.151:6807/1445669154", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.151:6805/1445669154", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:13:38.204 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "66fc0ac1-f14f-48bf-a557-110b23bff1d2", 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 17, 2024-09-12T18:13:38.205 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6800", 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6801", 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.206 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6802", 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6803", 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.207 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6806", 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6807", 2024-09-12T18:13:38.208 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6804", 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:38.209 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6805", 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.176:6801/752868242", 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.176:6803/752868242", 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.176:6807/752868242", 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.176:6805/752868242", 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.210 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.730957+0000", 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.793073+0000", 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:13:38.212 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.762001+0000", 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-09-12T18:13:38.213 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-09-12T18:13:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [ 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "snaps": [ 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "begin": 2, 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "length": 1 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-09-12T18:13:38.215 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:13:38.218 INFO:tasks.thrashosds.thrasher:j is {'epoch': 20, 'fsid': '5c1106a1-8b30-400f-94eb-0bea28eb5927', 'created': '2024-09-12T18:13:00.942825+0000', 'modified': '2024-09-12T18:13:25.702443+0000', 'last_up_change': '2024-09-12T18:13:10.269506+0000', 'last_in_change': '2024-09-12T18:13:01.815814+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:13:10.380891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:13:16.182185+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:13:20.398999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:13:21.732662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'd5348027-f4dc-457f-8b4e-a4341015d874', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 1368744816}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 1368744816}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 1368744816}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 1368744816}]}, 'public_addr': '172.21.15.129:6801/1368744816', 'cluster_addr': '172.21.15.129:6803/1368744816', 'heartbeat_back_addr': '172.21.15.129:6807/1368744816', 'heartbeat_front_addr': '172.21.15.129:6805/1368744816', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '939481c0-5bf6-4136-b772-e0ba4c215bf1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 1445669154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 1445669154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 1445669154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 1445669154}]}, 'public_addr': '172.21.15.151:6801/1445669154', 'cluster_addr': '172.21.15.151:6803/1445669154', 'heartbeat_back_addr': '172.21.15.151:6807/1445669154', 'heartbeat_front_addr': '172.21.15.151:6805/1445669154', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '66fc0ac1-f14f-48bf-a557-110b23bff1d2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6800', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6801', 'nonce': 752868242}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6802', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6803', 'nonce': 752868242}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6806', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6807', 'nonce': 752868242}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6804', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6805', 'nonce': 752868242}]}, 'public_addr': '172.21.15.176:6801/752868242', 'cluster_addr': '172.21.15.176:6803/752868242', 'heartbeat_back_addr': '172.21.15.176:6807/752868242', 'heartbeat_front_addr': '172.21.15.176:6805/752868242', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.730957+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.793073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.762001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:13:38.218 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T18:13:38.227 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:38.225+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'unique_pool_0' created 2024-09-12T18:13:38.279 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:13:38.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-12T18:13:38.328 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:38.322+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:38.344 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:38.344 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:38.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:38.428 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:38.429+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:38.490 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:38.490 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:38.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:38.529 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:38.526+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:38.630 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:38.629+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:38.669 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:38.669 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:38.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:38.730 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:38.730+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:38.831 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:38.833+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:38.850 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:38.851 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:38.865 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:38.933 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:38.933+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:38.996 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:38.996 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.010 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:39.056 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:39.054+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:39.134 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:39.134 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.135 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:39.133+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:39.148 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:39.236 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:39.234+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-12T18:13:39.317 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:39.317 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.331 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:39.376 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:39.374+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:39.437 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:39.434+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:39.464 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:39.464 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.478 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:39.538 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:39.538+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:39.639 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:39.638+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:39.643 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:39.643 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.657 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:39.740 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:39.741+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:39.779 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:39.779 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:39.840 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:39.838+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:39.924 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:39.924 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:39.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:39.941 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:39.941+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:40.042 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:40.042+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:40.063 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:40.063 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:40.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:13:40.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:40.143 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:40.141+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:40.198 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:40.199 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:40.214 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:40.227 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:40.227 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:40.243 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:40.242+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:40.248 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:40.248 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:40.267 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:40.267 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:40.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:13:40.317 DEBUG:teuthology.orchestra.run.smithi062:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-09-12T18:13:40.344 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:40.345+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:40.348 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:13:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 0 2024-09-12T18:13:40.349 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:40.352 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-12T18:13:40.365 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-12T18:13:40.365 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-12T18:13:40.366 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:40.398 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:hints = 1 2024-09-12T18:13:40.398 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-09-12T18:13:40.398 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Object prefix: benchmark_data_smithi062_23645 2024-09-12T18:13:40.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:13:40.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 0 0 0 0 0 0 - 0 2024-09-12T18:13:40.445 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:40.442+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:40.509 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:40.509 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:13:40.509 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:13:40.509 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:13:40.509 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:40.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:40.570 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:40.570+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:40.647 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:40.642+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:40.681 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:40.681 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:13:40.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:13:40.681 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:40.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 28.384195585000001, 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:40.682 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:40.683 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:40.683 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:13:40.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.683 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:13:40.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:13:40.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:13:40.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:13:40.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:13:40.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.579902458999999, 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.692 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:40.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:13:40.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.579867282999999, 2024-09-12T18:13:40.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:13:40.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:13:40.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:13:40.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.284271610000001, 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.708 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:13:40.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:13:40.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.716 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.284177934999999, 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.717 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:13:40.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.284108705000001, 2024-09-12T18:13:40.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:13:40.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:13:40.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:13:40.730 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.284017939000002, 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.731 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:40.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:13:40.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:13:40.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:13:40.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:13:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.283956916000001, 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:13:40.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:13:40.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.283898156999999, 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:13:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:13:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:13:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:13:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.283835107000002, 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:13:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.283034733000001, 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:13:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:13:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:13:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282896530999999, 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:13:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282833280999998, 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:13:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:13:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:13:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:13:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282734709, 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:13:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:13:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282433313999999, 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:13:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:13:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282335212, 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:13:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:13:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:13:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.28224282, 2024-09-12T18:13:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:13:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282155923000001, 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:13:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.282032301000001, 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:13:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.281640701000001, 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:13:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:40.831 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:40.832 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:40.830+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:40.833 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:40.933 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:40.933+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:40.989 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:40.989 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:40.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:1997 5.4 5:2e842f61:::benchmark_data_smithi062_23645_object1996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.989174+0000", 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0018482500000000001, 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001868109, 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 1997 2024-09-12T18:13:40.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989174+0000", 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989174+0000", 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989175+0000", 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0449999999999999e-06 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989301+0000", 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012627600000000001 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989316+0000", 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4878999999999999e-05 2024-09-12T18:13:40.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989325+0000", 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3360000000000001e-06 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989373+0000", 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7676000000000002e-05 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:40.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989472+0000", 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9674999999999997e-05 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.989548+0000", 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5512999999999993e-05 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990213+0000", 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00066514500000000002 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:40.994 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:1999 5.a e23/21 5:55718f09:::benchmark_data_smithi062_23645_object1998:head v 23'123, mlcod=23'121)", 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.990173+0000", 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00084830400000000003, 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00091110400000000004, 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990173+0000", 2024-09-12T18:13:40.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990173+0000", 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990174+0000", 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9699999999999995e-07 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990309+0000", 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135301 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990323+0000", 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3681e-05 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990332+0000", 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.312e-06 2024-09-12T18:13:40.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990385+0000", 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2120000000000002e-05 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.990400+0000", 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5868000000000001e-05 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:1984 5.e 5:782f4fc0:::benchmark_data_smithi062_23645_object1983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.984358+0000", 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00666368, 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067656670000000004, 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 1984 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:40.999 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984358+0000", 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984358+0000", 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984359+0000", 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984380+0000", 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1591999999999999e-05 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984385+0000", 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984388+0000", 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2160000000000002e-06 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.985206+0000", 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000818445 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.985315+0000", 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000109264 2024-09-12T18:13:41.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.985442+0000", 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669100000000001 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986432+0000", 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00099012300000000009 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:1990 5.0 5:09ed1d84:::benchmark_data_smithi062_23645_object1989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.984852+0000", 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.006170076, 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063111139999999996, 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 1990 2024-09-12T18:13:41.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984852+0000", 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984852+0000", 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984853+0000", 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984959+0000", 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010626199999999999 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984969+0000", 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0087e-05 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.984976+0000", 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1369999999999996e-06 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.985027+0000", 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0940999999999999e-05 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.985123+0000", 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6138999999999996e-05 2024-09-12T18:13:41.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.985243+0000", 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120118 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986153+0000", 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00090946600000000005 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:1991 5.b 5:de12b579:::benchmark_data_smithi062_23645_object1990:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.986364+0000", 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0046577739999999999, 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048367139999999998, 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 1991 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.009 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986364+0000", 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986364+0000", 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986365+0000", 2024-09-12T18:13:41.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0809999999999999e-06 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986495+0000", 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012963499999999999 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986505+0000", 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9750000000000002e-06 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986510+0000", 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3589999999999999e-06 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986574+0000", 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3600000000000001e-05 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986704+0000", 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013029200000000001 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.986860+0000", 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000155608 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.987580+0000", 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00072059299999999995 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.013 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:13:41.014 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 5 2024-09-12T18:13:41.014 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:41.015 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:41.060 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:41.058+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:41.135 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:41.134+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:41.183 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:41.183 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:13:41.183 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:13:41.183 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:13:41.183 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:41.204 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:41.248 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:41.246+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:41.302 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:13:41.337 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:41.337+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:41.373 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'main'} 2024-09-12T18:13:41.373 DEBUG:teuthology.orchestra.run.smithi062:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=main' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T18:13:41.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 1 16 3572 3556 222.236 222.25 0.00530775 0.0044816 2024-09-12T18:13:41.405 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:41.405 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:13:41.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:13:41.405 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:41.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013806998, 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:13:41.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:13:41.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:13:41.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:41.412 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013691636000001, 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:13:41.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:13:41.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013610669999998, 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.419 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:13:41.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:13:41.425 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013506157999998, 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.426 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:13:41.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:13:41.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013422214999999, 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:13:41.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:13:41.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.439 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013299269000001, 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:13:41.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:13:41.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013227759999999, 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:13:41.446 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:13:41.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013162860000001, 2024-09-12T18:13:41.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:41.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:13:41.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:41.458 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.013093393999998, 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:13:41.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.463 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:15 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.399714+0000", 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.005122935999999, 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014927421, 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399714+0000", 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399714+0000", 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399715+0000", 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399733+0000", 2024-09-12T18:13:41.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8065999999999999e-05 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399751+0000", 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8063999999999998e-05 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399767+0000", 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5529e-05 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402655+0000", 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002888294 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402696+0000", 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0540000000000001e-05 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414530+0000", 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011834674999999999 2024-09-12T18:13:41.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414642+0000", 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111446 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.402580+0000", 2024-09-12T18:13:41.468 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.002257301, 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013182937, 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402580+0000", 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402580+0000", 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402581+0000", 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.35e-06 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402594+0000", 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3019e-05 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402618+0000", 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3657000000000001e-05 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402639+0000", 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0769000000000001e-05 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408739+0000", 2024-09-12T18:13:41.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061000730000000001 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408780+0000", 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0979999999999997e-05 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415683+0000", 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069036059999999996 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415763+0000", 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9482999999999998e-05 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.998675233, 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:13:41.473 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:13:41.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:13:41.477 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.412815+0000", 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.992022514999999, 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013246984999999999, 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412815+0000", 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412815+0000", 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412816+0000", 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:13:41.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412872+0000", 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5962999999999999e-05 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412892+0000", 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0716e-05 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412906+0000", 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.376e-05 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413140+0000", 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00023424200000000001 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413187+0000", 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6678999999999998e-05 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425938+0000", 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012750991999999999 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.426062+0000", 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012365600000000001 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:34 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.414847+0000", 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.989989971, 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010169918999999999, 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414847+0000", 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414847+0000", 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414849+0000", 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7740000000000001e-06 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414863+0000", 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4032999999999999e-05 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414892+0000", 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.887e-05 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414910+0000", 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7686999999999999e-05 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415090+0000", 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018082499999999999 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415144+0000", 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3443000000000003e-05 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.424152+0000", 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090084329999999997 2024-09-12T18:13:41.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425017+0000", 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00086485399999999997 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:2 5.b 5:ddc78c99:::benchmark_data_smithi062_23645_object1:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.402744+0000", 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.0020933249999999, 2024-09-12T18:13:41.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010651051, 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 2 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.402744+0000", 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.402744+0000", 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.402747+0000", 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3799999999999998e-06 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.402993+0000", 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024530800000000002 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403025+0000", 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2110000000000003e-05 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403057+0000", 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2053e-05 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403815+0000", 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00075819699999999995 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.404113+0000", 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000298521 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.491 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.404419+0000", 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030548100000000003 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413127+0000", 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087085860000000008 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413164+0000", 2024-09-12T18:13:41.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6897000000000003e-05 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413283+0000", 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119009 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413395+0000", 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011150900000000001 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:12 5.b 5:d82e6a4c:::benchmark_data_smithi062_23645_object11:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.403704+0000", 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.001133082, 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010223901000000001, 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 12 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.494 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403704+0000", 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403704+0000", 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403706+0000", 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5829999999999999e-06 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403822+0000", 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116452 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403841+0000", 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8870000000000001e-05 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403856+0000", 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5469999999999999e-05 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.405498+0000", 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016419539999999999 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.405833+0000", 2024-09-12T18:13:41.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033432399999999999 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.406222+0000", 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038894400000000001 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413511+0000", 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072892429999999999 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413675+0000", 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016378899999999999 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413801+0000", 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126573 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413928+0000", 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126699 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.499 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:13 5.b 5:d4fd72ad:::benchmark_data_smithi062_23645_object12:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.403887+0000", 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.000950311, 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010292034, 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.500 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 13 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403887+0000", 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403887+0000", 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403888+0000", 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3999999999999999e-06 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403954+0000", 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6160000000000004e-05 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403975+0000", 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0383000000000001e-05 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.403990+0000", 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5233e-05 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.407551+0000", 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035612059999999999 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.407761+0000", 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000210106 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408101+0000", 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033979700000000003 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413637+0000", 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055359900000000002 2024-09-12T18:13:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.413956+0000", 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00031907099999999998 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.414083+0000", 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126876 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.414179+0000", 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5811999999999997e-05 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:19 5.b 5:d04877ca:::benchmark_data_smithi062_23645_object18:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.408032+0000", 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.99680502199999999, 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011775949000000001, 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.506 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 19 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408032+0000", 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408032+0000", 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408035+0000", 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408129+0000", 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3906000000000005e-05 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408161+0000", 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1986000000000002e-05 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.408184+0000", 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3163000000000002e-05 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.411217+0000", 2024-09-12T18:13:41.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030329100000000002 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.411641+0000", 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00042462400000000002 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.412253+0000", 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061152500000000002 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.418045+0000", 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057923690000000003 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.419600+0000", 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001554904 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.419701+0000", 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010077 2024-09-12T18:13:41.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.419808+0000", 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010718900000000001 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:29 5.b 5:dc601e19:::benchmark_data_smithi062_23645_object28:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.411971+0000", 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.99286642599999997, 2024-09-12T18:13:41.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012155689000000001, 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.411971+0000", 2024-09-12T18:13:41.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.411971+0000", 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.411972+0000", 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4899999999999999e-06 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.412147+0000", 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017442799999999999 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.412170+0000", 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2926999999999999e-05 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.412186+0000", 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6676000000000001e-05 2024-09-12T18:13:41.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.416667+0000", 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.004480866 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.416861+0000", 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019369799999999999 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.417160+0000", 2024-09-12T18:13:41.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029920800000000003 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.419843+0000", 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026832499999999999 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.423873+0000", 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0040296680000000001 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.424022+0000", 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014953199999999999 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.424126+0000", 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103946 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.518 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:107 5.d 5:bd0892d4:::benchmark_data_smithi062_23645_object106:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:40.441775+0000", 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.96306248000000005, 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011506901, 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 107 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:41.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.441775+0000", 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.441775+0000", 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.441776+0000", 2024-09-12T18:13:41.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.441877+0000", 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010108299999999999 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.441895+0000", 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7893e-05 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.441903+0000", 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4970000000000001e-06 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.442022+0000", 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118379 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.442349+0000", 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032765000000000002 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.442707+0000", 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00035805400000000001 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.444260+0000", 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015528689999999999 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.453103+0000", 2024-09-12T18:13:41.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088425410000000006 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.453221+0000", 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011849900000000001 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:40.453282+0000", 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0316000000000003e-05 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.524 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.525 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:41.525 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:41.525 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:41.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:41.527 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:41.526+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:41.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-12T18:13:41.626 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:41.622+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:41.681 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:41.681 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:41.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.681 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4602 5.8 e24/21 5:1dd920ad:::benchmark_data_smithi062_23645_object4601:head v 24'302, mlcod=24'300)", 2024-09-12T18:13:41.681 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.680335+0000", 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0010970719999999999, 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011134439999999999, 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680335+0000", 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680335+0000", 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680335+0000", 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5000000000000002e-07 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680420+0000", 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4338999999999993e-05 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680428+0000", 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2609999999999993e-06 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680443+0000", 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4585e-05 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680504+0000", 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1017000000000002e-05 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680523+0000", 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9069e-05 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4603 5.0 e24/21 5:0769fe71:::benchmark_data_smithi062_23645_object4602:head v 24'306, mlcod=24'304)", 2024-09-12T18:13:41.685 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.680457+0000", 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00097444299999999997, 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010405200000000001, 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680457+0000", 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680457+0000", 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680458+0000", 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9200000000000002e-07 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680496+0000", 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8581000000000002e-05 2024-09-12T18:13:41.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680504+0000", 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9209999999999992e-06 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680510+0000", 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3789999999999997e-06 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680547+0000", 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7781000000000003e-05 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680567+0000", 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9831999999999999e-05 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4605 5.2 e24/21 5:47afa531:::benchmark_data_smithi062_23645_object4604:head v 24'298, mlcod=24'295)", 2024-09-12T18:13:41.689 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.680467+0000", 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00096529600000000004, 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010836019999999999, 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680467+0000", 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680467+0000", 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680467+0000", 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.58e-07 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680554+0000", 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7095000000000006e-05 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680561+0000", 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2649999999999999e-06 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680567+0000", 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4269999999999999e-06 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680613+0000", 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6687999999999998e-05 2024-09-12T18:13:41.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680626+0000", 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2024999999999999e-05 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4610 5.6 5:6db54831:::benchmark_data_smithi062_23645_object4609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.680861+0000", 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00057105999999999997, 2024-09-12T18:13:41.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075441799999999997, 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4610 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680861+0000", 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680861+0000", 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680862+0000", 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0270000000000001e-06 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680893+0000", 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1469e-05 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680907+0000", 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3723999999999999e-05 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680915+0000", 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0930000000000003e-06 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681219+0000", 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030424 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681350+0000", 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013076400000000001 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681491+0000", 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014044700000000001 2024-09-12T18:13:41.697 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4607 5.2 e24/21 5:4da55471:::benchmark_data_smithi062_23645_object4606:head v 24'299, mlcod=24'295)", 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.681343+0000", 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.9123999999999996e-05, 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034567499999999999, 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681343+0000", 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681343+0000", 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681343+0000", 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2099999999999996e-07 2024-09-12T18:13:41.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681418+0000", 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5142000000000007e-05 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681428+0000", 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6180000000000001e-06 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681434+0000", 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3049999999999998e-06 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681482+0000", 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7899000000000003e-05 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681494+0000", 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1752e-05 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.701 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4611 5.e e24/21 5:71ab8a4a:::benchmark_data_smithi062_23645_object4610:head v 24'297, mlcod=24'295)", 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.681412+0000", 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.9414000000000001e-05, 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032651099999999998, 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681412+0000", 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681412+0000", 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681413+0000", 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5499999999999997e-07 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681484+0000", 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0723999999999996e-05 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681493+0000", 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3640000000000005e-06 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681498+0000", 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.267e-06 2024-09-12T18:13:41.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681540+0000", 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2543999999999998e-05 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681560+0000", 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9927000000000001e-05 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:4604 5.3 e24/21)", 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.681767+0000", 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9996653, 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3329999999999999e-05, 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.706 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:41.707 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681767+0000", 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681767+0000", 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681767+0000", 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5199999999999997e-07 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681770+0000", 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8279999999999999e-06 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681777+0000", 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5390000000000004e-06 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681780+0000", 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7459999999999998e-06 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4593 5.3 5:cc88306a:::benchmark_data_smithi062_23645_object4592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.677272+0000", 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0041595349999999998, 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045686640000000001, 2024-09-12T18:13:41.710 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4593 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677272+0000", 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677272+0000", 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677273+0000", 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677338+0000", 2024-09-12T18:13:41.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4603000000000005e-05 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677348+0000", 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026e-05 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677353+0000", 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3419999999999998e-06 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677403+0000", 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9489e-05 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677536+0000", 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132929 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677676+0000", 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014071099999999999 2024-09-12T18:13:41.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679501+0000", 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001824523 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4594 5.5 5:adcd4aa8:::benchmark_data_smithi062_23645_object4593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.677366+0000", 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0040663449999999999, 2024-09-12T18:13:41.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045607210000000002, 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4594 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677366+0000", 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677366+0000", 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677366+0000", 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.08e-07 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677430+0000", 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4021000000000002e-05 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677436+0000", 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7799999999999997e-06 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677440+0000", 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8630000000000001e-06 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677475+0000", 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5666e-05 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677574+0000", 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8564e-05 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677656+0000", 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2621999999999996e-05 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679809+0000", 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021526399999999999 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4596 5.6 5:67826987:::benchmark_data_smithi062_23645_object4595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.677458+0000", 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0039739830000000004, 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046028809999999996, 2024-09-12T18:13:41.720 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4596 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677458+0000", 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677458+0000", 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677458+0000", 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1900000000000003e-07 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677503+0000", 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4211000000000001e-05 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677508+0000", 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7470000000000002e-06 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677512+0000", 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4699999999999998e-06 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677562+0000", 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9889000000000003e-05 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677686+0000", 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012401099999999999 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.677831+0000", 2024-09-12T18:13:41.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014491800000000001 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679576+0000", 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017453569999999999 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4597 5.1 e24/21 5:85288d2f:::benchmark_data_smithi062_23645_object4596:head v 24'298, mlcod=24'295)", 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.678029+0000", 2024-09-12T18:13:41.725 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003402501, 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040815479999999999, 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678029+0000", 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678029+0000", 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678030+0000", 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5999999999999999e-07 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678086+0000", 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5760000000000001e-05 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678092+0000", 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000001e-06 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678096+0000", 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0269999999999997e-06 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678142+0000", 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5853999999999998e-05 2024-09-12T18:13:41.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678156+0000", 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4158000000000001e-05 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:4599 5.2 e24/21 5:419abf9c:::benchmark_data_smithi062_23645_object4598:head v 24'297, mlcod=24'294)", 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.678294+0000", 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031379759999999998, 2024-09-12T18:13:41.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038455260000000002, 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678294+0000", 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678294+0000", 2024-09-12T18:13:41.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678294+0000", 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9500000000000002e-07 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678361+0000", 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6662000000000007e-05 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678370+0000", 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5120000000000008e-06 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678384+0000", 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3892e-05 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678440+0000", 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6659000000000001e-05 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.678456+0000", 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5760000000000002e-05 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4601 5.c 5:368cb61d:::benchmark_data_smithi062_23645_object4600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.679141+0000", 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002291352, 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003038486, 2024-09-12T18:13:41.733 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4601 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679141+0000", 2024-09-12T18:13:41.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679141+0000", 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679141+0000", 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679229+0000", 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7453000000000004e-05 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679238+0000", 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6180000000000001e-06 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679243+0000", 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8500000000000002e-06 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679300+0000", 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7166000000000001e-05 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679487+0000", 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018687700000000001 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679616+0000", 2024-09-12T18:13:41.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012831799999999999 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680738+0000", 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011228950000000001 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4604 5.3 5:c2f71d49:::benchmark_data_smithi062_23645_object4603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.679870+0000", 2024-09-12T18:13:41.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0015618050000000001, 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023952399999999999, 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4604 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679870+0000", 2024-09-12T18:13:41.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679870+0000", 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679871+0000", 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0499999999999999e-06 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679977+0000", 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105775 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.679993+0000", 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6487e-05 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680001+0000", 2024-09-12T18:13:41.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1240000000000005e-06 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680045+0000", 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3098e-05 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680192+0000", 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000146997 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680335+0000", 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014350300000000001 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.681832+0000", 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014965860000000001 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:4609 5.6 5:6cdab331:::benchmark_data_smithi062_23645_object4608:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:41.743 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:41.680220+0000", 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0012119030000000001, 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021302339999999999, 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 4609 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680220+0000", 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680220+0000", 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680221+0000", 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8899999999999998e-07 2024-09-12T18:13:41.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680304+0000", 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3231000000000003e-05 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680315+0000", 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0902e-05 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:41.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680323+0000", 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4309999999999997e-06 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680371+0000", 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8232999999999997e-05 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680485+0000", 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011459399999999999 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:41.680690+0000", 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020454800000000001 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 15 2024-09-12T18:13:41.748 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:41.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:41.750 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:41.749+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:41.760 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "ops": [ 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4892, 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.2559a008", 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4891", 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4891", 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.757118+0000", 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.762 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4897, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.5aa4a0b", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4896", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4896", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.763 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.757794+0000", 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4898, 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.e21bc2fb", 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4897", 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.764 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4897", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759191+0000", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.765 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4902, 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.50393990", 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4901", 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4901", 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.766 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759769+0000", 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4903, 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.9436d7ce", 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4902", 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4902", 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.768 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759904+0000", 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4906, 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.e7c45130", 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.769 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4905", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4905", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760078+0000", 2024-09-12T18:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4908, 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.64446d24", 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4907", 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4907", 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.771 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760317+0000", 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4909, 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.6c51885e", 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4908", 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4908", 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.773 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760334+0000", 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4910, 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.821c171e", 2024-09-12T18:13:41.774 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4909", 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4909", 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.775 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760617+0000", 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4900, 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.43fe3a65", 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4899", 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.776 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4899", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759391+0000", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4904, 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.62ac108a", 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4903", 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4903", 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.778 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759988+0000", 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4905, 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.40a0708c", 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4904", 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4904", 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.780 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760020+0000", 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4899, 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.2d3accc7", 2024-09-12T18:13:41.781 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4898", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4898", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759206+0000", 2024-09-12T18:13:41.782 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4901, 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.4a72882f", 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4900", 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4900", 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.783 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.759562+0000", 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.784 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4907, 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.6f7aaac1", 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4906", 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4906", 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.785 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760095+0000", 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "tid": 4911, 2024-09-12T18:13:41.786 INFO:teuthology.orchestra.run.smithi062.stdout: "pg": "5.b969eedf", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "object_id": "benchmark_data_smithi062_23645_object4910", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "object_locator": "@5", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_id": "benchmark_data_smithi062_23645_object4910", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "target_object_locator": "@5", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "paused": 0, 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "used_replica": 0, 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "precalc_pgid": 0, 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "last_sent": "696.433562s", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "age": 0.0039999629999999996, 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "attempts": 1, 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "snapid": "head", 2024-09-12T18:13:41.787 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_context": "0=[]", 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "mtime": "2024-09-12T18:13:41.760632+0000", 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_ops": [ 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "write 0~65536 in=65536b" 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ops": [], 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_ops": [], 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_stat_ops": [], 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_ops": [], 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout: "command_ops": [] 2024-09-12T18:13:41.788 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:13:41.789 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 4892, "pg": "5.2559a008", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4891", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4891", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.757118+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4897, "pg": "5.5aa4a0b", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4896", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4896", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.757794+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4898, "pg": "5.e21bc2fb", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4897", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4897", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759191+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4902, "pg": "5.50393990", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4901", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4901", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759769+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4903, "pg": "5.9436d7ce", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4902", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4902", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759904+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4906, "pg": "5.e7c45130", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4905", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4905", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760078+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4908, "pg": "5.64446d24", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4907", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4907", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760317+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4909, "pg": "5.6c51885e", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4908", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4908", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760334+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4910, "pg": "5.821c171e", "osd": 0, "object_id": "benchmark_data_smithi062_23645_object4909", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4909", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760617+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4900, "pg": "5.43fe3a65", "osd": 1, "object_id": "benchmark_data_smithi062_23645_object4899", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4899", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759391+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4904, "pg": "5.62ac108a", "osd": 1, "object_id": "benchmark_data_smithi062_23645_object4903", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4903", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759988+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4905, "pg": "5.40a0708c", "osd": 1, "object_id": "benchmark_data_smithi062_23645_object4904", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4904", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760020+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4899, "pg": "5.2d3accc7", "osd": 2, "object_id": "benchmark_data_smithi062_23645_object4898", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4898", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759206+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4901, "pg": "5.4a72882f", "osd": 2, "object_id": "benchmark_data_smithi062_23645_object4900", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4900", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.759562+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4907, "pg": "5.6f7aaac1", "osd": 2, "object_id": "benchmark_data_smithi062_23645_object4906", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4906", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760095+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4911, "pg": "5.b969eedf", "osd": 2, "object_id": "benchmark_data_smithi062_23645_object4910", "object_locator": "@5", "target_object_id": "benchmark_data_smithi062_23645_object4910", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "696.433562s", "age": 0.0039999629999999996, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-12T18:13:41.760632+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-12T18:13:41.790 DEBUG:teuthology.orchestra.run.smithi062:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-12T18:13:41.827 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-12T18:13:41.850 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:41.846+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:41.875 DEBUG:teuthology.parallel:result is None 2024-09-12T18:13:41.876 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-12T18:13:41.889 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-09-12T18:13:41.889 INFO:teuthology.orchestra.run:waiting for 2100 2024-09-12T18:13:41.951 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:41.946+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:41.956 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:41.956 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:13:41.956 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:13:41.956 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:13:41.956 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:41.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:42.052 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:42.053+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:42.149 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:42.149 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:13:42.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:16 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.400590+0000", 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.748373978, 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012346578, 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.400590+0000", 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.400590+0000", 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.400591+0000", 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.400614+0000", 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2813e-05 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.400637+0000", 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3252999999999999e-05 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.400656+0000", 2024-09-12T18:13:42.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9343000000000001e-05 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401685+0000", 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010285489999999999 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401754+0000", 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8839999999999998e-05 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409757+0000", 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080035550000000007 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.412937+0000", 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031793989999999999 2024-09-12T18:13:42.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.747778007000001, 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:42.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:13:42.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:31 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401237+0000", 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.747726960000001, 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012550656, 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401237+0000", 2024-09-12T18:13:42.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401237+0000", 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401238+0000", 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9999999999999997e-07 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401244+0000", 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4400000000000002e-06 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401259+0000", 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4956e-05 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401270+0000", 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0560000000000001e-05 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403735+0000", 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024654870000000001 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403783+0000", 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7793999999999997e-05 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413713+0000", 2024-09-12T18:13:42.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099301700000000003 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413788+0000", 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4648999999999996e-05 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743747777999999, 2024-09-12T18:13:42.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:13:42.165 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.165 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.165 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.165 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:42.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:13:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:13:42.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:42.171 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743577542000001, 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:13:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:13:42.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:42.177 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743460783, 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:13:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:13:42.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.183 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743391646999999, 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:13:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:13:42.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:42.189 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743279895000001, 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:13:42.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:13:42.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:21 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405750+0000", 2024-09-12T18:13:42.195 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743214145, 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012682405000000001, 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405750+0000", 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405750+0000", 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405751+0000", 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2130000000000001e-06 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405785+0000", 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4060000000000003e-05 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405804+0000", 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8978999999999999e-05 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405819+0000", 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4436999999999999e-05 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405936+0000", 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117809 2024-09-12T18:13:42.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406301+0000", 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00036498699999999999 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406581+0000", 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027991499999999999 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.415242+0000", 2024-09-12T18:13:42.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086608499999999995 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418192+0000", 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029496240000000001 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418307+0000", 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011541599999999999 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418432+0000", 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125115 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743116072999999, 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.201 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:13:42.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:42.205 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.743055306999999, 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:42.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:42.209 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.742931011, 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014554022, 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406034+0000", 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3400000000000001e-06 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406054+0000", 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0046000000000001e-05 2024-09-12T18:13:42.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406078+0000", 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3314000000000001e-05 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406093+0000", 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4983e-05 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409043+0000", 2024-09-12T18:13:42.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029506549999999999 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409285+0000", 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024186100000000001 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.420587+0000", 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011301823000000001 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:91 5.a 5:5a3e81a6:::benchmark_data_smithi062_23645_object90:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.434680+0000", 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.714283701, 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093785980000000001, 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 91 2024-09-12T18:13:42.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.434680+0000", 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.434680+0000", 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.434683+0000", 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.434783+0000", 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100499 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.434808+0000", 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4649999999999999e-05 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.434826+0000", 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8156e-05 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.436268+0000", 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001441779 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.436562+0000", 2024-09-12T18:13:42.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000294331 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.436931+0000", 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000368857 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.439763+0000", 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028321140000000002 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.443694+0000", 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039311440000000001 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.443856+0000", 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016208100000000001 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.444059+0000", 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000202707 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.219 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:93 5.a 5:58b23333:::benchmark_data_smithi062_23645_object92:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.435151+0000", 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.7138129119999999, 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093119020000000004, 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.220 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 93 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435151+0000", 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435151+0000", 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435153+0000", 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435316+0000", 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016347599999999999 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435339+0000", 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2473e-05 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435359+0000", 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9927000000000001e-05 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.438003+0000", 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026441009999999998 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.438334+0000", 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033127500000000002 2024-09-12T18:13:42.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.438706+0000", 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000372228 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.441688+0000", 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029816270000000001 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.444179+0000", 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024912010000000002 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.444373+0000", 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000193971 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.444463+0000", 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9932999999999994e-05 2024-09-12T18:13:42.225 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:94 5.a 5:5979c177:::benchmark_data_smithi062_23645_object93:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.435386+0000", 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.7135779, 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011136854, 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.226 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435386+0000", 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435386+0000", 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435388+0000", 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.663e-06 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435534+0000", 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014660500000000001 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435557+0000", 2024-09-12T18:13:42.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2764000000000001e-05 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.435578+0000", 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0800000000000001e-05 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.439924+0000", 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004345743 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.440284+0000", 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00036010099999999999 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.440658+0000", 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037388299999999998 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.442738+0000", 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020805709999999998 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446297+0000", 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035591310000000001 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446422+0000", 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012495400000000001 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446523+0000", 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100639 2024-09-12T18:13:42.231 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:119 5.3 5:c1225236:::benchmark_data_smithi062_23645_object118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.446191+0000", 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.7027727939999999, 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094581800000000001, 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.232 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 119 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446191+0000", 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446191+0000", 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446194+0000", 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.514e-06 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446257+0000", 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2830000000000007e-05 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446283+0000", 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6259e-05 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.446299+0000", 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6263e-05 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.447784+0000", 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014851790000000001 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.448219+0000", 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043440999999999998 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.448710+0000", 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049105000000000004 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.451484+0000", 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027739610000000001 2024-09-12T18:13:42.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.455528+0000", 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040439780000000002 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.455599+0000", 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1755999999999995e-05 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.455649+0000", 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9979999999999999e-05 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:185 5.a 5:50dd47ca:::benchmark_data_smithi062_23645_object184:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.474731+0000", 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.674232854, 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0092510820000000007, 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.238 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 185 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.474731+0000", 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.474731+0000", 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.474733+0000", 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5820000000000001e-06 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.474791+0000", 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8372000000000003e-05 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.474813+0000", 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1787e-05 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.474828+0000", 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4731e-05 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.475913+0000", 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010855960000000001 2024-09-12T18:13:42.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.476160+0000", 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000247063 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.476515+0000", 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035499199999999999 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.478863+0000", 2024-09-12T18:13:42.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023473370000000001 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.483783+0000", 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00492057 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.483898+0000", 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115295 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.483982+0000", 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3757000000000005e-05 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:285 5.6 5:692ef176:::benchmark_data_smithi062_23645_object284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.516453+0000", 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.6325113280000001, 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010180532000000001, 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.244 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516453+0000", 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516453+0000", 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516454+0000", 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.505e-06 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516535+0000", 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1274999999999997e-05 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516554+0000", 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8751000000000001e-05 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516566+0000", 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1986e-05 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516655+0000", 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8549999999999998e-05 2024-09-12T18:13:42.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.516895+0000", 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024049799999999999 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.517143+0000", 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024746399999999997 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.521499+0000", 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043565829999999998 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.525875+0000", 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043755779999999998 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.525934+0000", 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9422999999999997e-05 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.526633+0000", 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00069891899999999999 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:293 5.6 5:69e83ed8:::benchmark_data_smithi062_23645_object292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.519356+0000", 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.629608403, 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095169750000000004, 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.250 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 293 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519356+0000", 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519356+0000", 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519357+0000", 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.779e-06 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519450+0000", 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2781999999999994e-05 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519474+0000", 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4104000000000002e-05 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519494+0000", 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9998000000000001e-05 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519598+0000", 2024-09-12T18:13:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103526 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519833+0000", 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023567999999999999 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520127+0000", 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029372900000000001 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.524337+0000", 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004209595 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.528775+0000", 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004438455 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.528834+0000", 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8628000000000002e-05 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.528873+0000", 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8699000000000003e-05 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:296 5.3 5:c1db6959:::benchmark_data_smithi062_23645_object295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:40.519963+0000", 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.6290013129999998, 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0089892370000000006, 2024-09-12T18:13:42.256 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 296 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519963+0000", 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519963+0000", 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.519964+0000", 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2300000000000001e-06 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520016+0000", 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2173999999999999e-05 2024-09-12T18:13:42.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520036+0000", 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9511e-05 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520048+0000", 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2018000000000001e-05 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520149+0000", 2024-09-12T18:13:42.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101335 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520323+0000", 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000173647 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.520491+0000", 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016800499999999999 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.524575+0000", 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040842719999999999 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.528805+0000", 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042296540000000002 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.528889+0000", 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4919999999999993e-05 2024-09-12T18:13:42.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:40.528952+0000", 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2471000000000005e-05 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:42.262 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:42.264 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:42.264 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:42.262+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:42.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:13:42.364 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:42.362+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:42.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 2 16 7312 7296 227.979 233.75 0.00619988 0.00437985 2024-09-12T18:13:42.422 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7373 5.f 5:f1c4e6bc:::benchmark_data_smithi062_23645_object7372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.420043+0000", 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0032513350000000002, 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003289424, 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.423 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7373 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420043+0000", 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420043+0000", 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.424 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420044+0000", 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1170000000000001e-06 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420125+0000", 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0035000000000002e-05 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420134+0000", 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5680000000000005e-06 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420139+0000", 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3630000000000002e-06 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420174+0000", 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4731999999999999e-05 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420250+0000", 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5798999999999997e-05 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420322+0000", 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2112000000000003e-05 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422594+0000", 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022715729999999998 2024-09-12T18:13:42.427 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:7377 5.5 e24/21 5:a4125404:::benchmark_data_smithi062_23645_object7376:head v 24'470, mlcod=24'468)", 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.420642+0000", 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0026525960000000001, 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002775165, 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420642+0000", 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420642+0000", 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420643+0000", 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9100000000000004e-07 2024-09-12T18:13:42.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420707+0000", 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4701000000000003e-05 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420714+0000", 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0339999999999999e-06 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420718+0000", 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7280000000000001e-06 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420757+0000", 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8825999999999997e-05 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.420769+0000", 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1609e-05 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.431 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7379 5.2 5:4fe03338:::benchmark_data_smithi062_23645_object7378:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.421281+0000", 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020133350000000002, 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021985619999999998, 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.432 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7379 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421281+0000", 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421281+0000", 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421282+0000", 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3900000000000005e-07 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421353+0000", 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0760999999999996e-05 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421360+0000", 2024-09-12T18:13:42.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0990000000000001e-06 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421364+0000", 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9519999999999996e-06 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421402+0000", 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8414000000000002e-05 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421480+0000", 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7952000000000002e-05 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421591+0000", 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000110584 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7380 5.7 5:e9bce62a:::benchmark_data_smithi062_23645_object7379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.436 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.421524+0000", 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0017712050000000001, 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020062650000000001, 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7380 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421524+0000", 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421524+0000", 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421524+0000", 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4399999999999999e-07 2024-09-12T18:13:42.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421605+0000", 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0567000000000003e-05 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421615+0000", 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6129999999999993e-06 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421621+0000", 2024-09-12T18:13:42.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7669999999999998e-06 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421658+0000", 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7163000000000003e-05 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421747+0000", 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8485000000000004e-05 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.421834+0000", 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6757999999999998e-05 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7387 5.2 5:404385b5:::benchmark_data_smithi062_23645_object7386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.422864+0000", 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00043072899999999998, 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00070896800000000003, 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.441 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7387 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422864+0000", 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422864+0000", 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422865+0000", 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4e-07 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422926+0000", 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1045999999999998e-05 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422935+0000", 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7770000000000008e-06 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422940+0000", 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1630000000000004e-06 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.422989+0000", 2024-09-12T18:13:42.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9663000000000002e-05 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423104+0000", 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000114419 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423229+0000", 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012537200000000001 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.445 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7388 5.7 5:e67df536:::benchmark_data_smithi062_23645_object7387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423048+0000", 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00024644700000000001, 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00059906300000000005, 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.446 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7388 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423048+0000", 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423048+0000", 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423049+0000", 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423111+0000", 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2674000000000003e-05 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423118+0000", 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9029999999999998e-06 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423122+0000", 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9890000000000003e-06 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423170+0000", 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.778e-05 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423336+0000", 2024-09-12T18:13:42.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00016580300000000001 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423526+0000", 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018990700000000001 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:7379 5.2 e24/21)", 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423154+0000", 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00014071400000000001, 2024-09-12T18:13:42.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00054531100000000004, 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423154+0000", 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423154+0000", 2024-09-12T18:13:42.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423155+0000", 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423157+0000", 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3829999999999999e-06 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423162+0000", 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8040000000000001e-06 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423165+0000", 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.281e-06 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.453 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:7384 5.5 e24/21 5:a06a1e04:::benchmark_data_smithi062_23645_object7383:head v 24'471, mlcod=24'468)", 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423174+0000", 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000120592, 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00055128200000000005, 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423174+0000", 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423174+0000", 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423174+0000", 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2000000000000001e-07 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423237+0000", 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2769999999999997e-05 2024-09-12T18:13:42.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423247+0000", 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0023e-05 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423253+0000", 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8769999999999998e-06 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:42.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423300+0000", 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7021999999999998e-05 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423318+0000", 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7657000000000001e-05 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:7380 5.7 e24/21)", 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423266+0000", 2024-09-12T18:13:42.457 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 2.8886000000000001e-05, 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00048402800000000001, 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423266+0000", 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423266+0000", 2024-09-12T18:13:42.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423266+0000", 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8999999999999998e-07 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423268+0000", 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8810000000000001e-06 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423274+0000", 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2650000000000002e-06 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423279+0000", 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2930000000000002e-06 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.460 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7389 5.f 5.ec3aac5f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423339+0000", 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9999557, 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000433602, 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.461 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7389 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423339+0000", 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423339+0000", 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423340+0000", 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423369+0000", 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9728000000000001e-05 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423378+0000", 2024-09-12T18:13:42.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8769999999999999e-06 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423384+0000", 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7390 5.f 5.2fddf0cf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423394+0000", 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9999003, 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040419700000000002, 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7390 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.465 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423394+0000", 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423394+0000", 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423395+0000", 2024-09-12T18:13:42.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3000000000000001e-07 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423430+0000", 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5058000000000002e-05 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423438+0000", 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.892e-06 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423444+0000", 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8359999999999997e-06 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:7392 5.7 5.1fe1c187 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:42.423509+0000", 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9997859, 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031468799999999998, 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:42.468 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 7392 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423509+0000", 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423509+0000", 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423509+0000", 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0900000000000001e-07 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423598+0000", 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8898000000000002e-05 2024-09-12T18:13:42.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423614+0000", 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5628e-05 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:42.423623+0000", 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3829999999999998e-06 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.471 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:42.472 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:13:42.472 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 12 2024-09-12T18:13:42.472 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:42.473 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:42.473 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:42.473+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:42.474 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:42.474 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:42.479 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:42.479 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:42.498 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:42.499 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:42.574 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:42.573+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:42.636 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:42.636 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:42.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:42.674 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:42.670+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:42.775 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:42.770+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:42.821 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:42.822 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:42.843 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:42.888 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:42.886+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:42.977 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:42.974+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:42.993 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:42.993 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:43.014 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:43.100 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:43.098+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:43.178 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:43.177+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:43.208 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:43.208 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:43.219 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:13:43.219 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:13:43.219 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:13:43.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:13:43.230 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:43.316 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:43.314+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:43.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:13:43.379 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:43.378+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:43.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 3 16 10516 10500 218.727 200.25 0.00771237 0.00455948 2024-09-12T18:13:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:43.421 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:43.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:43.488 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:43.486+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:43.569 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:43.699 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:13:43.699 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 24, 2024-09-12T18:13:43.699 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-09-12T18:13:00.942825+0000", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-09-12T18:13:41.290568+0000", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-09-12T18:13:10.269506+0000", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-09-12T18:13:01.815814+0000", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5806080, 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "nodeep-scrub", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "noscrub", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-09-12T18:13:43.700 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 5, 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-09-12T18:13:43.701 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:10.380891+0000", 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:43.702 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:43.703 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:43.704 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:43.706 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:43.707 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:16.182185+0000", 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 8193, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:43.709 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:43.710 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 2, 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 15, 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:43.711 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:43.712 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:43.713 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:20.398999+0000", 2024-09-12T18:13:43.715 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:43.716 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:43.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "18", 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:43.718 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:43.719 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:43.720 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:43.721 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-09-12T18:13:43.722 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:21.732662+0000", 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:43.723 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:43.725 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:43.726 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:43.727 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:13:43.728 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 5, 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:38.126670+0000", 2024-09-12T18:13:43.729 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:13:43.730 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 16, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 16, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 16, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 16, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 16, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.731 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "23", 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:13:43.732 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:13:43.733 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:13:43.734 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "rados": {} 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:13:43.735 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "d5348027-f4dc-457f-8b4e-a4341015d874", 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:13:43.736 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6800", 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6801", 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6802", 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6803", 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6806", 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6807", 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6804", 2024-09-12T18:13:43.740 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6805", 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.129:6801/1368744816", 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.129:6803/1368744816", 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.129:6807/1368744816", 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.129:6805/1368744816", 2024-09-12T18:13:43.741 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "939481c0-5bf6-4136-b772-e0ba4c215bf1", 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:13:43.742 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6800", 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.743 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6801", 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6802", 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6803", 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6806", 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6807", 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6804", 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6805", 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.151:6801/1445669154", 2024-09-12T18:13:43.748 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.151:6803/1445669154", 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.151:6807/1445669154", 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.151:6805/1445669154", 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "66fc0ac1-f14f-48bf-a557-110b23bff1d2", 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:13:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6800", 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6801", 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6802", 2024-09-12T18:13:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6803", 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6806", 2024-09-12T18:13:43.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6807", 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:13:43.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6804", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6805", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.176:6801/752868242", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.176:6803/752868242", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.176:6807/752868242", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.176:6805/752868242", 2024-09-12T18:13:43.754 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:13:43.755 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.730957+0000", 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.793073+0000", 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.762001+0000", 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-09-12T18:13:43.757 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-09-12T18:13:43.758 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:13:43.759 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:13:43.760 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-09-12T18:13:43.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:13:43.760 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:13:43.762 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:43.762 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:43.763 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': '5c1106a1-8b30-400f-94eb-0bea28eb5927', 'created': '2024-09-12T18:13:00.942825+0000', 'modified': '2024-09-12T18:13:41.290568+0000', 'last_up_change': '2024-09-12T18:13:10.269506+0000', 'last_in_change': '2024-09-12T18:13:01.815814+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:13:10.380891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:13:16.182185+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:13:20.398999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:13:21.732662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:13:38.126670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'd5348027-f4dc-457f-8b4e-a4341015d874', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 1368744816}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 1368744816}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 1368744816}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 1368744816}]}, 'public_addr': '172.21.15.129:6801/1368744816', 'cluster_addr': '172.21.15.129:6803/1368744816', 'heartbeat_back_addr': '172.21.15.129:6807/1368744816', 'heartbeat_front_addr': '172.21.15.129:6805/1368744816', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '939481c0-5bf6-4136-b772-e0ba4c215bf1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 1445669154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 1445669154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 1445669154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 1445669154}]}, 'public_addr': '172.21.15.151:6801/1445669154', 'cluster_addr': '172.21.15.151:6803/1445669154', 'heartbeat_back_addr': '172.21.15.151:6807/1445669154', 'heartbeat_front_addr': '172.21.15.151:6805/1445669154', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '66fc0ac1-f14f-48bf-a557-110b23bff1d2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6800', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6801', 'nonce': 752868242}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6802', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6803', 'nonce': 752868242}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6806', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6807', 'nonce': 752868242}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6804', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6805', 'nonce': 752868242}]}, 'public_addr': '172.21.15.176:6801/752868242', 'cluster_addr': '172.21.15.176:6803/752868242', 'heartbeat_back_addr': '172.21.15.176:6807/752868242', 'heartbeat_front_addr': '172.21.15.176:6805/752868242', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.730957+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.793073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.762001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:13:43.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:43.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:43.764 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:43.761+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:43.862 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:43.858+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:43.963 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:43.962+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:43.966 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:43.967 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:43.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:44.065 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:44.062+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:44.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:13:44.094 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:13:44.109 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-12T18:13:42.340389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4524957,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":252,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90188,"kb_used_data":772,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025332,"statfs":{"total":289910292480,"available":289817939968,"internally_reserved":0,"allocated":790528,"data_stored":1409964,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.057107"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297661+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:13:40.297661+0000","last_peered":"2024-09-12T18:13:40.297661+0000","last_clean":"2024-09-12T18:13:40.297661+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:13:40.297661+0000","last_undegraded":"2024-09-12T18:13:40.297661+0000","last_fullsized":"2024-09-12T18:13:40.297661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296072+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:13:40.296072+0000","last_peered":"2024-09-12T18:13:40.296072+0000","last_clean":"2024-09-12T18:13:40.296072+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:13:40.296072+0000","last_undegraded":"2024-09-12T18:13:40.296072+0000","last_fullsized":"2024-09-12T18:13:40.296072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:28.043135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.342165+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:13:40.342165+0000","last_peered":"2024-09-12T18:13:40.342165+0000","last_clean":"2024-09-12T18:13:40.342165+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:13:40.342165+0000","last_undegraded":"2024-09-12T18:13:40.342165+0000","last_fullsized":"2024-09-12T18:13:40.342165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341164+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:13:40.341164+0000","last_peered":"2024-09-12T18:13:40.341164+0000","last_clean":"2024-09-12T18:13:40.341164+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:13:40.341164+0000","last_undegraded":"2024-09-12T18:13:40.341164+0000","last_fullsized":"2024-09-12T18:13:40.341164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296511+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:13:40.296511+0000","last_peered":"2024-09-12T18:13:40.296511+0000","last_clean":"2024-09-12T18:13:40.296511+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:13:40.296511+0000","last_undegraded":"2024-09-12T18:13:40.296511+0000","last_fullsized":"2024-09-12T18:13:40.296511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340862+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:13:40.340862+0000","last_peered":"2024-09-12T18:13:40.340862+0000","last_clean":"2024-09-12T18:13:40.340862+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:13:40.340862+0000","last_undegraded":"2024-09-12T18:13:40.340862+0000","last_fullsized":"2024-09-12T18:13:40.340862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340607+0000","last_change":"2024-09-12T18:13:23.408751+0000","last_active":"2024-09-12T18:13:40.340607+0000","last_peered":"2024-09-12T18:13:40.340607+0000","last_clean":"2024-09-12T18:13:40.340607+0000","last_became_active":"2024-09-12T18:13:23.407752+0000","last_became_peered":"2024-09-12T18:13:23.407752+0000","last_unstale":"2024-09-12T18:13:40.340607+0000","last_undegraded":"2024-09-12T18:13:40.340607+0000","last_fullsized":"2024-09-12T18:13:40.340607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:02.709092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.339544+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:13:40.339544+0000","last_peered":"2024-09-12T18:13:40.339544+0000","last_clean":"2024-09-12T18:13:40.339544+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:13:40.339544+0000","last_undegraded":"2024-09-12T18:13:40.339544+0000","last_fullsized":"2024-09-12T18:13:40.339544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296266+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:13:40.296266+0000","last_peered":"2024-09-12T18:13:40.296266+0000","last_clean":"2024-09-12T18:13:40.296266+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:13:40.296266+0000","last_undegraded":"2024-09-12T18:13:40.296266+0000","last_fullsized":"2024-09-12T18:13:40.296266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296319+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:13:40.296319+0000","last_peered":"2024-09-12T18:13:40.296319+0000","last_clean":"2024-09-12T18:13:40.296319+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:13:40.296319+0000","last_undegraded":"2024-09-12T18:13:40.296319+0000","last_fullsized":"2024-09-12T18:13:40.296319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.342328+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:13:40.342328+0000","last_peered":"2024-09-12T18:13:40.342328+0000","last_clean":"2024-09-12T18:13:40.342328+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:13:40.342328+0000","last_undegraded":"2024-09-12T18:13:40.342328+0000","last_fullsized":"2024-09-12T18:13:40.342328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296424+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:13:40.296424+0000","last_peered":"2024-09-12T18:13:40.296424+0000","last_clean":"2024-09-12T18:13:40.296424+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:13:40.296424+0000","last_undegraded":"2024-09-12T18:13:40.296424+0000","last_fullsized":"2024-09-12T18:13:40.296424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:11.642559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295651+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:13:40.295651+0000","last_peered":"2024-09-12T18:13:40.295651+0000","last_clean":"2024-09-12T18:13:40.295651+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:13:40.295651+0000","last_undegraded":"2024-09-12T18:13:40.295651+0000","last_fullsized":"2024-09-12T18:13:40.295651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:19.521219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341098+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:13:40.341098+0000","last_peered":"2024-09-12T18:13:40.341098+0000","last_clean":"2024-09-12T18:13:40.341098+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:13:40.341098+0000","last_undegraded":"2024-09-12T18:13:40.341098+0000","last_fullsized":"2024-09-12T18:13:40.341098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340751+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:13:40.340751+0000","last_peered":"2024-09-12T18:13:40.340751+0000","last_clean":"2024-09-12T18:13:40.340751+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:13:40.340751+0000","last_undegraded":"2024-09-12T18:13:40.340751+0000","last_fullsized":"2024-09-12T18:13:40.340751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.339559+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:13:40.339559+0000","last_peered":"2024-09-12T18:13:40.339559+0000","last_clean":"2024-09-12T18:13:40.339559+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:13:40.339559+0000","last_undegraded":"2024-09-12T18:13:40.339559+0000","last_fullsized":"2024-09-12T18:13:40.339559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297750+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:13:40.297750+0000","last_peered":"2024-09-12T18:13:40.297750+0000","last_clean":"2024-09-12T18:13:40.297750+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:13:40.297750+0000","last_undegraded":"2024-09-12T18:13:40.297750+0000","last_fullsized":"2024-09-12T18:13:40.297750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296960+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:13:40.296960+0000","last_peered":"2024-09-12T18:13:40.296960+0000","last_clean":"2024-09-12T18:13:40.296960+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:13:40.296960+0000","last_undegraded":"2024-09-12T18:13:40.296960+0000","last_fullsized":"2024-09-12T18:13:40.296960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295816+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:13:40.295816+0000","last_peered":"2024-09-12T18:13:40.295816+0000","last_clean":"2024-09-12T18:13:40.295816+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:13:40.295816+0000","last_undegraded":"2024-09-12T18:13:40.295816+0000","last_fullsized":"2024-09-12T18:13:40.295816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341159+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:13:40.341159+0000","last_peered":"2024-09-12T18:13:40.341159+0000","last_clean":"2024-09-12T18:13:40.341159+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:13:40.341159+0000","last_undegraded":"2024-09-12T18:13:40.341159+0000","last_fullsized":"2024-09-12T18:13:40.341159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340937+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:13:40.340937+0000","last_peered":"2024-09-12T18:13:40.340937+0000","last_clean":"2024-09-12T18:13:40.340937+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:13:40.340937+0000","last_undegraded":"2024-09-12T18:13:40.340937+0000","last_fullsized":"2024-09-12T18:13:40.340937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295358+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:13:40.295358+0000","last_peered":"2024-09-12T18:13:40.295358+0000","last_clean":"2024-09-12T18:13:40.295358+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:13:40.295358+0000","last_undegraded":"2024-09-12T18:13:40.295358+0000","last_fullsized":"2024-09-12T18:13:40.295358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294568+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:13:40.294568+0000","last_peered":"2024-09-12T18:13:40.294568+0000","last_clean":"2024-09-12T18:13:40.294568+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:13:40.294568+0000","last_undegraded":"2024-09-12T18:13:40.294568+0000","last_fullsized":"2024-09-12T18:13:40.294568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295132+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:13:40.295132+0000","last_peered":"2024-09-12T18:13:40.295132+0000","last_clean":"2024-09-12T18:13:40.295132+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:13:40.295132+0000","last_undegraded":"2024-09-12T18:13:40.295132+0000","last_fullsized":"2024-09-12T18:13:40.295132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:14.363786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297676+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:13:40.297676+0000","last_peered":"2024-09-12T18:13:40.297676+0000","last_clean":"2024-09-12T18:13:40.297676+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:13:40.297676+0000","last_undegraded":"2024-09-12T18:13:40.297676+0000","last_fullsized":"2024-09-12T18:13:40.297676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296319+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:13:40.296319+0000","last_peered":"2024-09-12T18:13:40.296319+0000","last_clean":"2024-09-12T18:13:40.296319+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:13:40.296319+0000","last_undegraded":"2024-09-12T18:13:40.296319+0000","last_fullsized":"2024-09-12T18:13:40.296319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.342399+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:13:40.342399+0000","last_peered":"2024-09-12T18:13:40.342399+0000","last_clean":"2024-09-12T18:13:40.342399+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:13:40.342399+0000","last_undegraded":"2024-09-12T18:13:40.342399+0000","last_fullsized":"2024-09-12T18:13:40.342399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297458+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:13:40.297458+0000","last_peered":"2024-09-12T18:13:40.297458+0000","last_clean":"2024-09-12T18:13:40.297458+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:13:40.297458+0000","last_undegraded":"2024-09-12T18:13:40.297458+0000","last_fullsized":"2024-09-12T18:13:40.297458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:39.628972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295421+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:13:40.295421+0000","last_peered":"2024-09-12T18:13:40.295421+0000","last_clean":"2024-09-12T18:13:40.295421+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:13:40.295421+0000","last_undegraded":"2024-09-12T18:13:40.295421+0000","last_fullsized":"2024-09-12T18:13:40.295421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295807+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:13:40.295807+0000","last_peered":"2024-09-12T18:13:40.295807+0000","last_clean":"2024-09-12T18:13:40.295807+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:13:40.295807+0000","last_undegraded":"2024-09-12T18:13:40.295807+0000","last_fullsized":"2024-09-12T18:13:40.295807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294610+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:13:40.294610+0000","last_peered":"2024-09-12T18:13:40.294610+0000","last_clean":"2024-09-12T18:13:40.294610+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:13:40.294610+0000","last_undegraded":"2024-09-12T18:13:40.294610+0000","last_fullsized":"2024-09-12T18:13:40.294610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.339692+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:13:40.339692+0000","last_peered":"2024-09-12T18:13:40.339692+0000","last_clean":"2024-09-12T18:13:40.339692+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:13:40.339692+0000","last_undegraded":"2024-09-12T18:13:40.339692+0000","last_fullsized":"2024-09-12T18:13:40.339692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297084+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:13:40.297084+0000","last_peered":"2024-09-12T18:13:40.297084+0000","last_clean":"2024-09-12T18:13:40.297084+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:13:40.297084+0000","last_undegraded":"2024-09-12T18:13:40.297084+0000","last_fullsized":"2024-09-12T18:13:40.297084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341000+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:40.341000+0000","last_peered":"2024-09-12T18:13:40.341000+0000","last_clean":"2024-09-12T18:13:40.341000+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:13:40.341000+0000","last_undegraded":"2024-09-12T18:13:40.341000+0000","last_fullsized":"2024-09-12T18:13:40.341000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297437+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:13:40.297437+0000","last_peered":"2024-09-12T18:13:40.297437+0000","last_clean":"2024-09-12T18:13:40.297437+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:13:40.297437+0000","last_undegraded":"2024-09-12T18:13:40.297437+0000","last_fullsized":"2024-09-12T18:13:40.297437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295289+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:13:40.295289+0000","last_peered":"2024-09-12T18:13:40.295289+0000","last_clean":"2024-09-12T18:13:40.295289+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:13:40.295289+0000","last_undegraded":"2024-09-12T18:13:40.295289+0000","last_fullsized":"2024-09-12T18:13:40.295289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297531+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:13:40.297531+0000","last_peered":"2024-09-12T18:13:40.297531+0000","last_clean":"2024-09-12T18:13:40.297531+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:13:40.297531+0000","last_undegraded":"2024-09-12T18:13:40.297531+0000","last_fullsized":"2024-09-12T18:13:40.297531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295280+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:13:40.295280+0000","last_peered":"2024-09-12T18:13:40.295280+0000","last_clean":"2024-09-12T18:13:40.295280+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:13:40.295280+0000","last_undegraded":"2024-09-12T18:13:40.295280+0000","last_fullsized":"2024-09-12T18:13:40.295280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295957+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:13:40.295957+0000","last_peered":"2024-09-12T18:13:40.295957+0000","last_clean":"2024-09-12T18:13:40.295957+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:13:40.295957+0000","last_undegraded":"2024-09-12T18:13:40.295957+0000","last_fullsized":"2024-09-12T18:13:40.295957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.339901+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:13:40.339901+0000","last_peered":"2024-09-12T18:13:40.339901+0000","last_clean":"2024-09-12T18:13:40.339901+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:13:40.339901+0000","last_undegraded":"2024-09-12T18:13:40.339901+0000","last_fullsized":"2024-09-12T18:13:40.339901+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"23'5","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.420651+0000","last_change":"2024-09-12T18:13:39.302813+0000","last_active":"2024-09-12T18:13:40.420651+0000","last_peered":"2024-09-12T18:13:40.420651+0000","last_clean":"2024-09-12T18:13:40.420651+0000","last_became_active":"2024-09-12T18:13:39.302410+0000","last_became_peered":"2024-09-12T18:13:39.302410+0000","last_unstale":"2024-09-12T18:13:40.420651+0000","last_undegraded":"2024-09-12T18:13:40.420651+0000","last_fullsized":"2024-09-12T18:13:40.420651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:44.866987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.343179+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:13:40.343179+0000","last_peered":"2024-09-12T18:13:40.343179+0000","last_clean":"2024-09-12T18:13:40.343179+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:13:40.343179+0000","last_undegraded":"2024-09-12T18:13:40.343179+0000","last_fullsized":"2024-09-12T18:13:40.343179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295371+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:13:40.295371+0000","last_peered":"2024-09-12T18:13:40.295371+0000","last_clean":"2024-09-12T18:13:40.295371+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:13:40.295371+0000","last_undegraded":"2024-09-12T18:13:40.295371+0000","last_fullsized":"2024-09-12T18:13:40.295371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.410034+0000","last_change":"2024-09-12T18:13:39.307524+0000","last_active":"2024-09-12T18:13:40.410034+0000","last_peered":"2024-09-12T18:13:40.410034+0000","last_clean":"2024-09-12T18:13:40.410034+0000","last_became_active":"2024-09-12T18:13:39.306702+0000","last_became_peered":"2024-09-12T18:13:39.306702+0000","last_unstale":"2024-09-12T18:13:40.410034+0000","last_undegraded":"2024-09-12T18:13:40.410034+0000","last_fullsized":"2024-09-12T18:13:40.410034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:45.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297165+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:13:40.297165+0000","last_peered":"2024-09-12T18:13:40.297165+0000","last_clean":"2024-09-12T18:13:40.297165+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:13:40.297165+0000","last_undegraded":"2024-09-12T18:13:40.297165+0000","last_fullsized":"2024-09-12T18:13:40.297165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294990+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:13:40.294990+0000","last_peered":"2024-09-12T18:13:40.294990+0000","last_clean":"2024-09-12T18:13:40.294990+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:13:40.294990+0000","last_undegraded":"2024-09-12T18:13:40.294990+0000","last_fullsized":"2024-09-12T18:13:40.294990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"23'9","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.425490+0000","last_change":"2024-09-12T18:13:39.307176+0000","last_active":"2024-09-12T18:13:40.425490+0000","last_peered":"2024-09-12T18:13:40.425490+0000","last_clean":"2024-09-12T18:13:40.425490+0000","last_became_active":"2024-09-12T18:13:39.306405+0000","last_became_peered":"2024-09-12T18:13:39.306405+0000","last_unstale":"2024-09-12T18:13:40.425490+0000","last_undegraded":"2024-09-12T18:13:40.425490+0000","last_fullsized":"2024-09-12T18:13:40.425490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.343460+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:13:40.343460+0000","last_peered":"2024-09-12T18:13:40.343460+0000","last_clean":"2024-09-12T18:13:40.343460+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:13:40.343460+0000","last_undegraded":"2024-09-12T18:13:40.343460+0000","last_fullsized":"2024-09-12T18:13:40.343460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341151+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:13:40.341151+0000","last_peered":"2024-09-12T18:13:40.341151+0000","last_clean":"2024-09-12T18:13:40.341151+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:13:40.341151+0000","last_undegraded":"2024-09-12T18:13:40.341151+0000","last_fullsized":"2024-09-12T18:13:40.341151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.418326+0000","last_change":"2024-09-12T18:13:39.304569+0000","last_active":"2024-09-12T18:13:40.418326+0000","last_peered":"2024-09-12T18:13:40.418326+0000","last_clean":"2024-09-12T18:13:40.418326+0000","last_became_active":"2024-09-12T18:13:39.303719+0000","last_became_peered":"2024-09-12T18:13:39.303719+0000","last_unstale":"2024-09-12T18:13:40.418326+0000","last_undegraded":"2024-09-12T18:13:40.418326+0000","last_fullsized":"2024-09-12T18:13:40.418326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:27.784587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341947+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:13:40.341947+0000","last_peered":"2024-09-12T18:13:40.341947+0000","last_clean":"2024-09-12T18:13:40.341947+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:13:40.341947+0000","last_undegraded":"2024-09-12T18:13:40.341947+0000","last_fullsized":"2024-09-12T18:13:40.341947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295533+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:13:40.295533+0000","last_peered":"2024-09-12T18:13:40.295533+0000","last_clean":"2024-09-12T18:13:40.295533+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:13:40.295533+0000","last_undegraded":"2024-09-12T18:13:40.295533+0000","last_fullsized":"2024-09-12T18:13:40.295533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"23'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.429479+0000","last_change":"2024-09-12T18:13:39.304500+0000","last_active":"2024-09-12T18:13:40.429479+0000","last_peered":"2024-09-12T18:13:40.429479+0000","last_clean":"2024-09-12T18:13:40.429479+0000","last_became_active":"2024-09-12T18:13:39.303780+0000","last_became_peered":"2024-09-12T18:13:39.303780+0000","last_unstale":"2024-09-12T18:13:40.429479+0000","last_undegraded":"2024-09-12T18:13:40.429479+0000","last_fullsized":"2024-09-12T18:13:40.429479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:21.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296063+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:13:40.296063+0000","last_peered":"2024-09-12T18:13:40.296063+0000","last_clean":"2024-09-12T18:13:40.296063+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:13:40.296063+0000","last_undegraded":"2024-09-12T18:13:40.296063+0000","last_fullsized":"2024-09-12T18:13:40.296063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341466+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:13:40.341466+0000","last_peered":"2024-09-12T18:13:40.341466+0000","last_clean":"2024-09-12T18:13:40.341466+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:13:40.341466+0000","last_undegraded":"2024-09-12T18:13:40.341466+0000","last_fullsized":"2024-09-12T18:13:40.341466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.418326+0000","last_change":"2024-09-12T18:13:39.304504+0000","last_active":"2024-09-12T18:13:40.418326+0000","last_peered":"2024-09-12T18:13:40.418326+0000","last_clean":"2024-09-12T18:13:40.418326+0000","last_became_active":"2024-09-12T18:13:39.302178+0000","last_became_peered":"2024-09-12T18:13:39.302178+0000","last_unstale":"2024-09-12T18:13:40.418326+0000","last_undegraded":"2024-09-12T18:13:40.418326+0000","last_fullsized":"2024-09-12T18:13:40.418326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341504+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:13:40.341504+0000","last_peered":"2024-09-12T18:13:40.341504+0000","last_clean":"2024-09-12T18:13:40.341504+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:13:40.341504+0000","last_undegraded":"2024-09-12T18:13:40.341504+0000","last_fullsized":"2024-09-12T18:13:40.341504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.343221+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:13:40.343221+0000","last_peered":"2024-09-12T18:13:40.343221+0000","last_clean":"2024-09-12T18:13:40.343221+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:13:40.343221+0000","last_undegraded":"2024-09-12T18:13:40.343221+0000","last_fullsized":"2024-09-12T18:13:40.343221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.419740+0000","last_change":"2024-09-12T18:13:39.303893+0000","last_active":"2024-09-12T18:13:40.419740+0000","last_peered":"2024-09-12T18:13:40.419740+0000","last_clean":"2024-09-12T18:13:40.419740+0000","last_became_active":"2024-09-12T18:13:39.303338+0000","last_became_peered":"2024-09-12T18:13:39.303338+0000","last_unstale":"2024-09-12T18:13:40.419740+0000","last_undegraded":"2024-09-12T18:13:40.419740+0000","last_fullsized":"2024-09-12T18:13:40.419740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:12.283961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296051+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:13:40.296051+0000","last_peered":"2024-09-12T18:13:40.296051+0000","last_clean":"2024-09-12T18:13:40.296051+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:13:40.296051+0000","last_undegraded":"2024-09-12T18:13:40.296051+0000","last_fullsized":"2024-09-12T18:13:40.296051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.342030+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:13:40.342030+0000","last_peered":"2024-09-12T18:13:40.342030+0000","last_clean":"2024-09-12T18:13:40.342030+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:13:40.342030+0000","last_undegraded":"2024-09-12T18:13:40.342030+0000","last_fullsized":"2024-09-12T18:13:40.342030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"23'5","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.431268+0000","last_change":"2024-09-12T18:13:39.307337+0000","last_active":"2024-09-12T18:13:40.431268+0000","last_peered":"2024-09-12T18:13:40.431268+0000","last_clean":"2024-09-12T18:13:40.431268+0000","last_became_active":"2024-09-12T18:13:39.306607+0000","last_became_peered":"2024-09-12T18:13:39.306607+0000","last_unstale":"2024-09-12T18:13:40.431268+0000","last_undegraded":"2024-09-12T18:13:40.431268+0000","last_fullsized":"2024-09-12T18:13:40.431268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:48.160767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295622+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:13:40.295622+0000","last_peered":"2024-09-12T18:13:40.295622+0000","last_clean":"2024-09-12T18:13:40.295622+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:13:40.295622+0000","last_undegraded":"2024-09-12T18:13:40.295622+0000","last_fullsized":"2024-09-12T18:13:40.295622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296238+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:13:40.296238+0000","last_peered":"2024-09-12T18:13:40.296238+0000","last_clean":"2024-09-12T18:13:40.296238+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:13:40.296238+0000","last_undegraded":"2024-09-12T18:13:40.296238+0000","last_fullsized":"2024-09-12T18:13:40.296238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"23'7","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.424501+0000","last_change":"2024-09-12T18:13:39.308661+0000","last_active":"2024-09-12T18:13:40.424501+0000","last_peered":"2024-09-12T18:13:40.424501+0000","last_clean":"2024-09-12T18:13:40.424501+0000","last_became_active":"2024-09-12T18:13:39.306758+0000","last_became_peered":"2024-09-12T18:13:39.306758+0000","last_unstale":"2024-09-12T18:13:40.424501+0000","last_undegraded":"2024-09-12T18:13:40.424501+0000","last_fullsized":"2024-09-12T18:13:40.424501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:07.495377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340046+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:13:40.340046+0000","last_peered":"2024-09-12T18:13:40.340046+0000","last_clean":"2024-09-12T18:13:40.340046+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:13:40.340046+0000","last_undegraded":"2024-09-12T18:13:40.340046+0000","last_fullsized":"2024-09-12T18:13:40.340046+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341275+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:13:40.341275+0000","last_peered":"2024-09-12T18:13:40.341275+0000","last_clean":"2024-09-12T18:13:40.341275+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:13:40.341275+0000","last_undegraded":"2024-09-12T18:13:40.341275+0000","last_fullsized":"2024-09-12T18:13:40.341275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295543+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:13:40.295543+0000","last_peered":"2024-09-12T18:13:40.295543+0000","last_clean":"2024-09-12T18:13:40.295543+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:13:40.295543+0000","last_undegraded":"2024-09-12T18:13:40.295543+0000","last_fullsized":"2024-09-12T18:13:40.295543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.343303+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:13:40.343303+0000","last_peered":"2024-09-12T18:13:40.343303+0000","last_clean":"2024-09-12T18:13:40.343303+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:13:40.343303+0000","last_undegraded":"2024-09-12T18:13:40.343303+0000","last_fullsized":"2024-09-12T18:13:40.343303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.418691+0000","last_change":"2024-09-12T18:13:39.304779+0000","last_active":"2024-09-12T18:13:40.418691+0000","last_peered":"2024-09-12T18:13:40.418691+0000","last_clean":"2024-09-12T18:13:40.418691+0000","last_became_active":"2024-09-12T18:13:39.304291+0000","last_became_peered":"2024-09-12T18:13:39.304291+0000","last_unstale":"2024-09-12T18:13:40.418691+0000","last_undegraded":"2024-09-12T18:13:40.418691+0000","last_fullsized":"2024-09-12T18:13:40.418691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:56.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.339937+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:13:40.339937+0000","last_peered":"2024-09-12T18:13:40.339937+0000","last_clean":"2024-09-12T18:13:40.339937+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:13:40.339937+0000","last_undegraded":"2024-09-12T18:13:40.339937+0000","last_fullsized":"2024-09-12T18:13:40.339937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295084+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:13:40.295084+0000","last_peered":"2024-09-12T18:13:40.295084+0000","last_clean":"2024-09-12T18:13:40.295084+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:13:40.295084+0000","last_undegraded":"2024-09-12T18:13:40.295084+0000","last_fullsized":"2024-09-12T18:13:40.295084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296631+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:13:40.296631+0000","last_peered":"2024-09-12T18:13:40.296631+0000","last_clean":"2024-09-12T18:13:40.296631+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:13:40.296631+0000","last_undegraded":"2024-09-12T18:13:40.296631+0000","last_fullsized":"2024-09-12T18:13:40.296631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.408662+0000","last_change":"2024-09-12T18:13:39.304331+0000","last_active":"2024-09-12T18:13:40.408662+0000","last_peered":"2024-09-12T18:13:40.408662+0000","last_clean":"2024-09-12T18:13:40.408662+0000","last_became_active":"2024-09-12T18:13:39.303195+0000","last_became_peered":"2024-09-12T18:13:39.303195+0000","last_unstale":"2024-09-12T18:13:40.408662+0000","last_undegraded":"2024-09-12T18:13:40.408662+0000","last_fullsized":"2024-09-12T18:13:40.408662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:21.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295285+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:13:40.295285+0000","last_peered":"2024-09-12T18:13:40.295285+0000","last_clean":"2024-09-12T18:13:40.295285+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:13:40.295285+0000","last_undegraded":"2024-09-12T18:13:40.295285+0000","last_fullsized":"2024-09-12T18:13:40.295285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295880+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:13:40.295880+0000","last_peered":"2024-09-12T18:13:40.295880+0000","last_clean":"2024-09-12T18:13:40.295880+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:13:40.295880+0000","last_undegraded":"2024-09-12T18:13:40.295880+0000","last_fullsized":"2024-09-12T18:13:40.295880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296539+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:13:40.296539+0000","last_peered":"2024-09-12T18:13:40.296539+0000","last_clean":"2024-09-12T18:13:40.296539+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:13:40.296539+0000","last_undegraded":"2024-09-12T18:13:40.296539+0000","last_fullsized":"2024-09-12T18:13:40.296539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.418340+0000","last_change":"2024-09-12T18:13:39.303887+0000","last_active":"2024-09-12T18:13:40.418340+0000","last_peered":"2024-09-12T18:13:40.418340+0000","last_clean":"2024-09-12T18:13:40.418340+0000","last_became_active":"2024-09-12T18:13:39.303308+0000","last_became_peered":"2024-09-12T18:13:39.303308+0000","last_unstale":"2024-09-12T18:13:40.418340+0000","last_undegraded":"2024-09-12T18:13:40.418340+0000","last_fullsized":"2024-09-12T18:13:40.418340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:51.598853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341660+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:13:40.341660+0000","last_peered":"2024-09-12T18:13:40.341660+0000","last_clean":"2024-09-12T18:13:40.341660+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:13:40.341660+0000","last_undegraded":"2024-09-12T18:13:40.341660+0000","last_fullsized":"2024-09-12T18:13:40.341660+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341171+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:13:40.341171+0000","last_peered":"2024-09-12T18:13:40.341171+0000","last_clean":"2024-09-12T18:13:40.341171+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:13:40.341171+0000","last_undegraded":"2024-09-12T18:13:40.341171+0000","last_fullsized":"2024-09-12T18:13:40.341171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296069+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:13:40.296069+0000","last_peered":"2024-09-12T18:13:40.296069+0000","last_clean":"2024-09-12T18:13:40.296069+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:13:40.296069+0000","last_undegraded":"2024-09-12T18:13:40.296069+0000","last_fullsized":"2024-09-12T18:13:40.296069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.418789+0000","last_change":"2024-09-12T18:13:39.303725+0000","last_active":"2024-09-12T18:13:40.418789+0000","last_peered":"2024-09-12T18:13:40.418789+0000","last_clean":"2024-09-12T18:13:40.418789+0000","last_became_active":"2024-09-12T18:13:39.302101+0000","last_became_peered":"2024-09-12T18:13:39.302101+0000","last_unstale":"2024-09-12T18:13:40.418789+0000","last_undegraded":"2024-09-12T18:13:40.418789+0000","last_fullsized":"2024-09-12T18:13:40.418789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:45.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.343547+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:13:40.343547+0000","last_peered":"2024-09-12T18:13:40.343547+0000","last_clean":"2024-09-12T18:13:40.343547+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:13:40.343547+0000","last_undegraded":"2024-09-12T18:13:40.343547+0000","last_fullsized":"2024-09-12T18:13:40.343547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296371+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:13:40.296371+0000","last_peered":"2024-09-12T18:13:40.296371+0000","last_clean":"2024-09-12T18:13:40.296371+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:13:40.296371+0000","last_undegraded":"2024-09-12T18:13:40.296371+0000","last_fullsized":"2024-09-12T18:13:40.296371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295403+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:13:40.295403+0000","last_peered":"2024-09-12T18:13:40.295403+0000","last_clean":"2024-09-12T18:13:40.295403+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:13:40.295403+0000","last_undegraded":"2024-09-12T18:13:40.295403+0000","last_fullsized":"2024-09-12T18:13:40.295403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:08.786394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340308+0000","last_change":"2024-09-12T18:13:39.298632+0000","last_active":"2024-09-12T18:13:40.340308+0000","last_peered":"2024-09-12T18:13:40.340308+0000","last_clean":"2024-09-12T18:13:40.340308+0000","last_became_active":"2024-09-12T18:13:39.298316+0000","last_became_peered":"2024-09-12T18:13:39.298316+0000","last_unstale":"2024-09-12T18:13:40.340308+0000","last_undegraded":"2024-09-12T18:13:40.340308+0000","last_fullsized":"2024-09-12T18:13:40.340308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:48.671293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296318+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:13:40.296318+0000","last_peered":"2024-09-12T18:13:40.296318+0000","last_clean":"2024-09-12T18:13:40.296318+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:13:40.296318+0000","last_undegraded":"2024-09-12T18:13:40.296318+0000","last_fullsized":"2024-09-12T18:13:40.296318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297885+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:13:40.297885+0000","last_peered":"2024-09-12T18:13:40.297885+0000","last_clean":"2024-09-12T18:13:40.297885+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:13:40.297885+0000","last_undegraded":"2024-09-12T18:13:40.297885+0000","last_fullsized":"2024-09-12T18:13:40.297885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296258+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:13:40.296258+0000","last_peered":"2024-09-12T18:13:40.296258+0000","last_clean":"2024-09-12T18:13:40.296258+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:13:40.296258+0000","last_undegraded":"2024-09-12T18:13:40.296258+0000","last_fullsized":"2024-09-12T18:13:40.296258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:03.114396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"23'5","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.417817+0000","last_change":"2024-09-12T18:13:39.299411+0000","last_active":"2024-09-12T18:13:40.417817+0000","last_peered":"2024-09-12T18:13:40.417817+0000","last_clean":"2024-09-12T18:13:40.417817+0000","last_became_active":"2024-09-12T18:13:39.298808+0000","last_became_peered":"2024-09-12T18:13:39.298808+0000","last_unstale":"2024-09-12T18:13:40.417817+0000","last_undegraded":"2024-09-12T18:13:40.417817+0000","last_fullsized":"2024-09-12T18:13:40.417817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:30.228394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297870+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:13:40.297870+0000","last_peered":"2024-09-12T18:13:40.297870+0000","last_clean":"2024-09-12T18:13:40.297870+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:13:40.297870+0000","last_undegraded":"2024-09-12T18:13:40.297870+0000","last_fullsized":"2024-09-12T18:13:40.297870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297607+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:13:40.297607+0000","last_peered":"2024-09-12T18:13:40.297607+0000","last_clean":"2024-09-12T18:13:40.297607+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:13:40.297607+0000","last_undegraded":"2024-09-12T18:13:40.297607+0000","last_fullsized":"2024-09-12T18:13:40.297607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295946+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:13:40.295946+0000","last_peered":"2024-09-12T18:13:40.295946+0000","last_clean":"2024-09-12T18:13:40.295946+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:13:40.295946+0000","last_undegraded":"2024-09-12T18:13:40.295946+0000","last_fullsized":"2024-09-12T18:13:40.295946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"23'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.414055+0000","last_change":"2024-09-12T18:13:39.307029+0000","last_active":"2024-09-12T18:13:40.414055+0000","last_peered":"2024-09-12T18:13:40.414055+0000","last_clean":"2024-09-12T18:13:40.414055+0000","last_became_active":"2024-09-12T18:13:39.306294+0000","last_became_peered":"2024-09-12T18:13:39.306294+0000","last_unstale":"2024-09-12T18:13:40.414055+0000","last_undegraded":"2024-09-12T18:13:40.414055+0000","last_fullsized":"2024-09-12T18:13:40.414055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:21.862841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297531+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:13:40.297531+0000","last_peered":"2024-09-12T18:13:40.297531+0000","last_clean":"2024-09-12T18:13:40.297531+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:13:40.297531+0000","last_undegraded":"2024-09-12T18:13:40.297531+0000","last_fullsized":"2024-09-12T18:13:40.297531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.343177+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:13:40.343177+0000","last_peered":"2024-09-12T18:13:40.343177+0000","last_clean":"2024-09-12T18:13:40.343177+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:13:40.343177+0000","last_undegraded":"2024-09-12T18:13:40.343177+0000","last_fullsized":"2024-09-12T18:13:40.343177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295186+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:13:40.295186+0000","last_peered":"2024-09-12T18:13:40.295186+0000","last_clean":"2024-09-12T18:13:40.295186+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:13:40.295186+0000","last_undegraded":"2024-09-12T18:13:40.295186+0000","last_fullsized":"2024-09-12T18:13:40.295186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:51.724774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340664+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:13:40.340664+0000","last_peered":"2024-09-12T18:13:40.340664+0000","last_clean":"2024-09-12T18:13:40.340664+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:13:40.340664+0000","last_undegraded":"2024-09-12T18:13:40.340664+0000","last_fullsized":"2024-09-12T18:13:40.340664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341886+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:13:40.341886+0000","last_peered":"2024-09-12T18:13:40.341886+0000","last_clean":"2024-09-12T18:13:40.341886+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:13:40.341886+0000","last_undegraded":"2024-09-12T18:13:40.341886+0000","last_fullsized":"2024-09-12T18:13:40.341886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294998+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:13:40.294998+0000","last_peered":"2024-09-12T18:13:40.294998+0000","last_clean":"2024-09-12T18:13:40.294998+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:13:40.294998+0000","last_undegraded":"2024-09-12T18:13:40.294998+0000","last_fullsized":"2024-09-12T18:13:40.294998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297718+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:13:40.297718+0000","last_peered":"2024-09-12T18:13:40.297718+0000","last_clean":"2024-09-12T18:13:40.297718+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:13:40.297718+0000","last_undegraded":"2024-09-12T18:13:40.297718+0000","last_fullsized":"2024-09-12T18:13:40.297718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.342147+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:13:40.342147+0000","last_peered":"2024-09-12T18:13:40.342147+0000","last_clean":"2024-09-12T18:13:40.342147+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:13:40.342147+0000","last_undegraded":"2024-09-12T18:13:40.342147+0000","last_fullsized":"2024-09-12T18:13:40.342147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294708+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:13:40.294708+0000","last_peered":"2024-09-12T18:13:40.294708+0000","last_clean":"2024-09-12T18:13:40.294708+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:13:40.294708+0000","last_undegraded":"2024-09-12T18:13:40.294708+0000","last_fullsized":"2024-09-12T18:13:40.294708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297737+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:13:40.297737+0000","last_peered":"2024-09-12T18:13:40.297737+0000","last_clean":"2024-09-12T18:13:40.297737+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:13:40.297737+0000","last_undegraded":"2024-09-12T18:13:40.297737+0000","last_fullsized":"2024-09-12T18:13:40.297737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294992+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:13:40.294992+0000","last_peered":"2024-09-12T18:13:40.294992+0000","last_clean":"2024-09-12T18:13:40.294992+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:13:40.294992+0000","last_undegraded":"2024-09-12T18:13:40.294992+0000","last_fullsized":"2024-09-12T18:13:40.294992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297934+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:13:40.297934+0000","last_peered":"2024-09-12T18:13:40.297934+0000","last_clean":"2024-09-12T18:13:40.297934+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:13:40.297934+0000","last_undegraded":"2024-09-12T18:13:40.297934+0000","last_fullsized":"2024-09-12T18:13:40.297934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295697+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:13:40.295697+0000","last_peered":"2024-09-12T18:13:40.295697+0000","last_clean":"2024-09-12T18:13:40.295697+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:13:40.295697+0000","last_undegraded":"2024-09-12T18:13:40.295697+0000","last_fullsized":"2024-09-12T18:13:40.295697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296363+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:13:40.296363+0000","last_peered":"2024-09-12T18:13:40.296363+0000","last_clean":"2024-09-12T18:13:40.296363+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:13:40.296363+0000","last_undegraded":"2024-09-12T18:13:40.296363+0000","last_fullsized":"2024-09-12T18:13:40.296363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.294915+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:13:40.294915+0000","last_peered":"2024-09-12T18:13:40.294915+0000","last_clean":"2024-09-12T18:13:40.294915+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:13:40.294915+0000","last_undegraded":"2024-09-12T18:13:40.294915+0000","last_fullsized":"2024-09-12T18:13:40.294915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297142+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:13:40.297142+0000","last_peered":"2024-09-12T18:13:40.297142+0000","last_clean":"2024-09-12T18:13:40.297142+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:13:40.297142+0000","last_undegraded":"2024-09-12T18:13:40.297142+0000","last_fullsized":"2024-09-12T18:13:40.297142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296104+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:13:40.296104+0000","last_peered":"2024-09-12T18:13:40.296104+0000","last_clean":"2024-09-12T18:13:40.296104+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:13:40.296104+0000","last_undegraded":"2024-09-12T18:13:40.296104+0000","last_fullsized":"2024-09-12T18:13:40.296104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296724+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:13:40.296724+0000","last_peered":"2024-09-12T18:13:40.296724+0000","last_clean":"2024-09-12T18:13:40.296724+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:13:40.296724+0000","last_undegraded":"2024-09-12T18:13:40.296724+0000","last_fullsized":"2024-09-12T18:13:40.296724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:27.815530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.296772+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:13:40.296772+0000","last_peered":"2024-09-12T18:13:40.296772+0000","last_clean":"2024-09-12T18:13:40.296772+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:13:40.296772+0000","last_undegraded":"2024-09-12T18:13:40.296772+0000","last_fullsized":"2024-09-12T18:13:40.296772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.340587+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:13:40.340587+0000","last_peered":"2024-09-12T18:13:40.340587+0000","last_clean":"2024-09-12T18:13:40.340587+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:13:40.340587+0000","last_undegraded":"2024-09-12T18:13:40.340587+0000","last_fullsized":"2024-09-12T18:13:40.340587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341769+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:13:40.341769+0000","last_peered":"2024-09-12T18:13:40.341769+0000","last_clean":"2024-09-12T18:13:40.341769+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:13:40.341769+0000","last_undegraded":"2024-09-12T18:13:40.341769+0000","last_fullsized":"2024-09-12T18:13:40.341769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.341402+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:13:40.341402+0000","last_peered":"2024-09-12T18:13:40.341402+0000","last_clean":"2024-09-12T18:13:40.341402+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:13:40.341402+0000","last_undegraded":"2024-09-12T18:13:40.341402+0000","last_fullsized":"2024-09-12T18:13:40.341402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297460+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:13:40.297460+0000","last_peered":"2024-09-12T18:13:40.297460+0000","last_clean":"2024-09-12T18:13:40.297460+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:13:40.297460+0000","last_undegraded":"2024-09-12T18:13:40.297460+0000","last_fullsized":"2024-09-12T18:13:40.297460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.295700+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:13:40.295700+0000","last_peered":"2024-09-12T18:13:40.295700+0000","last_clean":"2024-09-12T18:13:40.295700+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:13:40.295700+0000","last_undegraded":"2024-09-12T18:13:40.295700+0000","last_fullsized":"2024-09-12T18:13:40.295700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297455+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:13:40.297455+0000","last_peered":"2024-09-12T18:13:40.297455+0000","last_clean":"2024-09-12T18:13:40.297455+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:13:40.297455+0000","last_undegraded":"2024-09-12T18:13:40.297455+0000","last_fullsized":"2024-09-12T18:13:40.297455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.339816+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:13:40.339816+0000","last_peered":"2024-09-12T18:13:40.339816+0000","last_clean":"2024-09-12T18:13:40.339816+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:13:40.339816+0000","last_undegraded":"2024-09-12T18:13:40.339816+0000","last_fullsized":"2024-09-12T18:13:40.339816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:13:40.297576+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:13:40.297576+0000","last_peered":"2024-09-12T18:13:40.297576+0000","last_clean":"2024-09-12T18:13:40.297576+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:13:40.297576+0000","last_undegraded":"2024-09-12T18:13:40.297576+0000","last_fullsized":"2024-09-12T18:13:40.297576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":7340032,"data_compressed":6028,"data_compressed_allocated":458752,"data_compressed_original":7340032,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":290816,"data_stored":665948,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":290816,"data_stored":670230,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":2949120,"data_compressed":2427,"data_compressed_allocated":184320,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":2293760,"data_compressed":1880,"data_compressed_allocated":143360,"data_compressed_original":2293760,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":2097152,"data_compressed":1721,"data_compressed_allocated":131072,"data_compressed_original":2097152,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:44.114 INFO:tasks.thrashosds.thrasher:Setting 4.39 to [0, 1] 2024-09-12T18:13:44.115 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.39', '0', '1'] 2024-09-12T18:13:44.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.39 0 1 2024-09-12T18:13:44.153 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:44.154 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:44.165 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:44.162+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:44.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:44.266 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:44.262+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:44.318 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:13:44.333 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:44.333 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:44.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:44.367 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:44.362+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:44.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 4 16 13419 13403 209.401 181.438 0.00530467 0.00476807 2024-09-12T18:13:44.468 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:44.466+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:44.502 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:44.502 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:44.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:13:44.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:44.568 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:44.569+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:44.669 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:44.666+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:44.671 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:44.671 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:44.691 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:44.691 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:44.709 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:44.709 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:44.721 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:44.721 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:13:44.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:13:44.721 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 32.427180341000003, 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:13:44.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:13:44.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:13:44.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.728 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.622887214999999, 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:44.729 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:13:44.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:13:44.734 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.622852039000001, 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:44.735 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:44.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:13:44.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.327256366, 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:13:44.741 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:13:44.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:13:44.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.327162691000002, 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.747 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:13:44.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:13:44.752 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.327093461, 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:13:44.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:13:44.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.758 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.327002695000001, 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:44.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:13:44.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:13:44.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:13:44.764 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.326941672, 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.765 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:13:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:13:44.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.326882912999999, 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.771 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:13:44.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:13:44.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.776 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.326819863000001, 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:13:44.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.326019489, 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:13:44.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.788 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325881287000001, 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:13:44.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:13:44.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:13:44.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325818037000001, 2024-09-12T18:13:44.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:44.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:13:44.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325719464999999, 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:13:44.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:44.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.806 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325418070000001, 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:13:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:13:44.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:13:44.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:44.812 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325319967999999, 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:13:44.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325227576, 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.818 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:13:44.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:13:44.823 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325140679, 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:13:44.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:13:44.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.829 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.325017057, 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:44.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:13:44.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:13:44.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:44.835 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.324625457, 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:13:44.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:13:44.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.840 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:44.840 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:44.840 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:44.842 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:44.838+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:44.842 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:44.942 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:44.938+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:45.005 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15178 5.e 5:72643a93:::benchmark_data_smithi062_23645_object15177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.006317+0000", 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.001006194, 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00102542, 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.006 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15178 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006317+0000", 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006317+0000", 2024-09-12T18:13:45.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006318+0000", 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1699999999999997e-07 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006362+0000", 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3921999999999997e-05 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006371+0000", 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9809999999999992e-06 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006375+0000", 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.865e-06 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006435+0000", 2024-09-12T18:13:45.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9580000000000002e-05 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006572+0000", 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013702199999999999 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006709+0000", 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013676500000000001 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.010 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15179 5.d 5:bec7d88a:::benchmark_data_smithi062_23645_object15178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.006391+0000", 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00093232099999999995, 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00099536099999999995, 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.011 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15179 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006391+0000", 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006391+0000", 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006391+0000", 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4300000000000003e-07 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006430+0000", 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8717000000000002e-05 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006437+0000", 2024-09-12T18:13:45.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6649999999999997e-06 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006440+0000", 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8070000000000001e-06 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006480+0000", 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9415999999999997e-05 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006603+0000", 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012275400000000001 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006682+0000", 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9000999999999998e-05 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.015 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15181 5.0 5:0d32ae75:::benchmark_data_smithi062_23645_object15180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.006484+0000", 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00083945899999999997, 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093795900000000004, 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15181 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006484+0000", 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006484+0000", 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006484+0000", 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:13:45.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006575+0000", 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0173000000000006e-05 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006582+0000", 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1609999999999997e-06 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006587+0000", 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3460000000000001e-06 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006635+0000", 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7907000000000001e-05 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006753+0000", 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011777600000000001 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006883+0000", 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000130199 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15163 5.8 5:13235230:::benchmark_data_smithi062_23645_object15162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.001513+0000", 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0058098179999999996, 2024-09-12T18:13:45.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00594409, 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15163 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.001513+0000", 2024-09-12T18:13:45.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.001513+0000", 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.001514+0000", 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9500000000000001e-07 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.001570+0000", 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6168999999999997e-05 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.001583+0000", 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3224000000000001e-05 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.001593+0000", 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1099999999999992e-06 2024-09-12T18:13:45.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002547+0000", 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00095457099999999998 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002678+0000", 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013041499999999999 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002824+0000", 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014603199999999999 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006069+0000", 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003245689 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:15164 5.a e25/21 5:5bf9169b:::benchmark_data_smithi062_23645_object15163:head v 25'928, mlcod=25'926)", 2024-09-12T18:13:45.025 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.002919+0000", 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0044038819999999996, 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045751949999999998, 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002919+0000", 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002919+0000", 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002920+0000", 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002959+0000", 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8980999999999998e-05 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002970+0000", 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1284000000000001e-05 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002979+0000", 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003026+0000", 2024-09-12T18:13:45.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7128e-05 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003049+0000", 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2693000000000001e-05 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15166 5.4 5:2493056a:::benchmark_data_smithi062_23645_object15165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.002964+0000", 2024-09-12T18:13:45.029 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0043586349999999996, 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045594279999999999, 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15166 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002964+0000", 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002964+0000", 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.002966+0000", 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.468e-06 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003051+0000", 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4776000000000003e-05 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003065+0000", 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4431e-05 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003075+0000", 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8819999999999996e-06 2024-09-12T18:13:45.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003127+0000", 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2250000000000003e-05 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003200+0000", 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2784e-05 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003274+0000", 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4357000000000007e-05 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006290+0000", 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030158030000000001 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15168 5.8 5:1b77e212:::benchmark_data_smithi062_23645_object15167:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.034 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.003096+0000", 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0042274499999999998, 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.004466879, 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15168 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003096+0000", 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003096+0000", 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003096+0000", 2024-09-12T18:13:45.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0299999999999998e-07 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003139+0000", 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2851e-05 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003149+0000", 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8640000000000008e-06 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003156+0000", 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7150000000000001e-06 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003646+0000", 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000490318 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003806+0000", 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015997099999999999 2024-09-12T18:13:45.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003958+0000", 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000151693 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006125+0000", 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021671070000000001 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15170 5.4 5:202c9e00:::benchmark_data_smithi062_23645_object15169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.003915+0000", 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0034078540000000001, 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0036835990000000001, 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15170 2024-09-12T18:13:45.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003915+0000", 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003915+0000", 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.003916+0000", 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1100000000000004e-07 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004027+0000", 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111282 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004043+0000", 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5747999999999999e-05 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004052+0000", 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0210000000000005e-06 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004113+0000", 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0803e-05 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004192+0000", 2024-09-12T18:13:45.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8700000000000002e-05 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004291+0000", 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9397999999999999e-05 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.007327+0000", 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030354639999999999 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.044 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:15171 5.a e25/21 5:5325322e:::benchmark_data_smithi062_23645_object15170:head v 25'929, mlcod=25'926)", 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.004433+0000", 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.002890035, 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031999509999999999, 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004433+0000", 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004433+0000", 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004434+0000", 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004544+0000", 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011011299999999999 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004554+0000", 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9229999999999997e-06 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004575+0000", 2024-09-12T18:13:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1444e-05 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004632+0000", 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6449000000000001e-05 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004652+0000", 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0432e-05 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15175 5.8 5:19484cbf:::benchmark_data_smithi062_23645_object15174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.004580+0000", 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0027426030000000001, 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030802189999999999, 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15175 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004580+0000", 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004580+0000", 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004581+0000", 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004663+0000", 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1864000000000001e-05 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004672+0000", 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7609999999999996e-06 2024-09-12T18:13:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004677+0000", 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9280000000000001e-06 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004732+0000", 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4923000000000003e-05 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004862+0000", 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013004 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004999+0000", 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013715600000000001 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.006555+0000", 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001555952 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.053 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:15172 5.9 e25/21 5:9037ce93:::benchmark_data_smithi062_23645_object15171:head v 25'950, mlcod=25'948)", 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.004828+0000", 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0024951079999999998, 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028679690000000002, 2024-09-12T18:13:45.054 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004828+0000", 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004828+0000", 2024-09-12T18:13:45.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004828+0000", 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1199999999999998e-07 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004883+0000", 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4493999999999997e-05 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004889+0000", 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1770000000000003e-06 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004893+0000", 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9750000000000001e-06 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004931+0000", 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7614999999999998e-05 2024-09-12T18:13:45.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.004942+0000", 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.146e-05 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 11 2024-09-12T18:13:45.058 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:45.060 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:45.060 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:45.054+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:45.160 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:45.161+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:45.261 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:45.258+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:45.261 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:45.261 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:13:45.261 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:13:45.262 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:13:45.262 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:45.283 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:45.332 INFO:teuthology.orchestra.run.smithi062.stderr:set 4.39 pg_upmap mapping to [0,1] 2024-09-12T18:13:45.362 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:45.361+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:45.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 5 16 16328 16312 203.881 181.812 0.00897807 0.00489897 2024-09-12T18:13:45.462 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:45.458+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.092535971, 2024-09-12T18:13:45.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:13:45.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:13:45.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:13:45.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.092420609000001, 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.491 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:13:45.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:13:45.497 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.092339642999999, 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:13:45.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:13:45.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.504 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.092235130999999, 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:13:45.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:45.511 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.092151187999999, 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:13:45.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:13:45.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.092028242000001, 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.518 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:13:45.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:13:45.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.091956733, 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.525 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:13:45.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:45.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:13:45.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.091891832999998, 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:13:45.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:13:45.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.091822366999999, 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.537 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:13:45.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:13:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:15 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.399714+0000", 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.083851909, 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014927421, 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.542 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399714+0000", 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399714+0000", 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399715+0000", 2024-09-12T18:13:45.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399733+0000", 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8065999999999999e-05 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399751+0000", 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8063999999999998e-05 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.399767+0000", 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5529e-05 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402655+0000", 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002888294 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.402696+0000", 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0540000000000001e-05 2024-09-12T18:13:45.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414530+0000", 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011834674999999999 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414642+0000", 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111446 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.077404206000001, 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:13:45.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15908 5.0 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.24362615700000001, 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018670684, 2024-09-12T18:13:45.551 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15908 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239941+0000", 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6400000000000001e-07 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239986+0000", 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5466999999999997e-05 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239996+0000", 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6209999999999999e-06 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240002+0000", 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.229e-06 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240369+0000", 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036721600000000002 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240554+0000", 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018448100000000001 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240680+0000", 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012593700000000001 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.242166+0000", 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014860170000000001 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258545+0000", 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01637885 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258579+0000", 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.468e-05 2024-09-12T18:13:45.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258611+0000", 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1322000000000003e-05 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.557 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15914 5.e 5:77dbab1b:::benchmark_data_smithi062_23645_object15913:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245359+0000", 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.23820740800000001, 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014812567, 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15914 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.558 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245359+0000", 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245359+0000", 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245361+0000", 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7710000000000001e-06 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245448+0000", 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7367999999999994e-05 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245458+0000", 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0380000000000001e-05 2024-09-12T18:13:45.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245467+0000", 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0410000000000003e-06 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245518+0000", 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0550999999999998e-05 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245605+0000", 2024-09-12T18:13:45.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6757999999999998e-05 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245695+0000", 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0622000000000001e-05 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253600+0000", 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079045939999999992 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260103+0000", 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065026720000000001 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260138+0000", 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5596000000000003e-05 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260171+0000", 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3213999999999997e-05 2024-09-12T18:13:45.563 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15916 5.0 5:0a1d5cb1:::benchmark_data_smithi062_23645_object15915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245489+0000", 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.23807689000000001, 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014660632999999999, 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.564 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15916 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245489+0000", 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245489+0000", 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245490+0000", 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2299999999999999e-07 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245574+0000", 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3405999999999994e-05 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245580+0000", 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245584+0000", 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0790000000000002e-06 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245634+0000", 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0142999999999997e-05 2024-09-12T18:13:45.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245806+0000", 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000171967 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245939+0000", 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000132874 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253656+0000", 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0077169489999999999 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260089+0000", 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064327170000000001 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260125+0000", 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6375000000000003e-05 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260150+0000", 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4803e-05 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15917 5.b 5:d520353b:::benchmark_data_smithi062_23645_object15916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.23797021300000001, 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015705908000000001, 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.570 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15917 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245597+0000", 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245642+0000", 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5484e-05 2024-09-12T18:13:45.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245647+0000", 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2399999999999998e-06 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245651+0000", 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3469999999999999e-06 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245695+0000", 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4249999999999998e-05 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245806+0000", 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110752 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245920+0000", 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114156 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255011+0000", 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090915860000000005 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261216+0000", 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062048700000000004 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261251+0000", 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4854999999999997e-05 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261302+0000", 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0766999999999997e-05 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.23790325900000001, 2024-09-12T18:13:45.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:13:45.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.582 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15920 5.4 5:271008db:::benchmark_data_smithi062_23645_object15919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246340+0000", 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.23722591600000001, 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014017409999999999, 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15920 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.584 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246340+0000", 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246340+0000", 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246341+0000", 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246368+0000", 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6732000000000001e-05 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246380+0000", 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2486e-05 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246386+0000", 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1449999999999996e-06 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246445+0000", 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8337000000000001e-05 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246551+0000", 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105958 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246658+0000", 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107361 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255733+0000", 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090751229999999992 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260266+0000", 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045326689999999996 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260320+0000", 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3860000000000003e-05 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.260358+0000", 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7888e-05 2024-09-12T18:13:45.589 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15923 5.4 5:217c37e3:::benchmark_data_smithi062_23645_object15922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.236615292, 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017388715999999999, 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.590 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15923 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:45.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246952+0000", 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.95e-07 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247021+0000", 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9080999999999998e-05 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247032+0000", 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0577999999999999e-05 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247039+0000", 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3699999999999997e-06 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253374+0000", 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063354919999999999 2024-09-12T18:13:45.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253534+0000", 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159421 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253632+0000", 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8021000000000002e-05 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255738+0000", 2024-09-12T18:13:45.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021061550000000002 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264249+0000", 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085105400000000005 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264301+0000", 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1996999999999997e-05 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264340+0000", 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9066000000000002e-05 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15927 5.b 5:da456c12:::benchmark_data_smithi062_23645_object15926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.252345+0000", 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.231221603, 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014947368000000001, 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.596 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15927 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.252345+0000", 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.252345+0000", 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.252345+0000", 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.252458+0000", 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112528 2024-09-12T18:13:45.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.252467+0000", 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6700000000000006e-06 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.252476+0000", 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0800000000000006e-06 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253401+0000", 2024-09-12T18:13:45.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00092557100000000003 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253500+0000", 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9054000000000004e-05 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253591+0000", 2024-09-12T18:13:45.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0847999999999995e-05 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255439+0000", 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018479970000000001 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267237+0000", 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011797561999999999 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267271+0000", 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4433e-05 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267292+0000", 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0896000000000001e-05 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15930 5.4 5:2e101ab4:::benchmark_data_smithi062_23645_object15929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:45.602 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.254033+0000", 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.229532967, 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014475946, 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15930 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:45.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.254033+0000", 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.254033+0000", 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.254034+0000", 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.254110+0000", 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5914999999999994e-05 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.254123+0000", 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2818e-05 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.254130+0000", 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4909999999999999e-06 2024-09-12T18:13:45.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255097+0000", 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096653799999999997 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255175+0000", 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8226999999999995e-05 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255267+0000", 2024-09-12T18:13:45.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1749999999999994e-05 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.256060+0000", 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00079299299999999997 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.268424+0000", 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012364227 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:45.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.268474+0000", 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9376000000000003e-05 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.268509+0000", 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5596999999999998e-05 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:45.608 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:45.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:45.610 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:45.606+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:45.710 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:45.710+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:17291 5.a 5:5a40b64d:::benchmark_data_smithi062_23645_object17290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.762271+0000", 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0066722919999999998, 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066930740000000002, 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.768 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 17291 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.762271+0000", 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.762271+0000", 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.762271+0000", 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.762306+0000", 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4443000000000002e-05 2024-09-12T18:13:45.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.762313+0000", 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6869999999999994e-06 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.762319+0000", 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2889999999999997e-06 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.763178+0000", 2024-09-12T18:13:45.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085901599999999999 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.763320+0000", 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014261800000000001 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.763469+0000", 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148858 2024-09-12T18:13:45.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.765173+0000", 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001703785 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:17304 5.3 5:c9849ac4:::benchmark_data_smithi062_23645_object17303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.767390+0000", 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0015531900000000001, 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016593879999999999, 2024-09-12T18:13:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 17304 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767390+0000", 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767390+0000", 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767391+0000", 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2500000000000004e-07 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767465+0000", 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4707000000000001e-05 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767474+0000", 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0319999999999992e-06 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767479+0000", 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0830000000000003e-06 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767516+0000", 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6489999999999998e-05 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767603+0000", 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7229000000000001e-05 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767683+0000", 2024-09-12T18:13:45.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0272000000000007e-05 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:17305 5.e e26/21 5:71fa885c:::benchmark_data_smithi062_23645_object17304:head v 26'1086, mlcod=26'1084)", 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.767886+0000", 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0010567479999999999, 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001231514, 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:45.778 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767886+0000", 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767886+0000", 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767887+0000", 2024-09-12T18:13:45.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.23e-07 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767995+0000", 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010823300000000001 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768006+0000", 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1355999999999999e-05 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768014+0000", 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5820000000000004e-06 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768072+0000", 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8137000000000003e-05 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768090+0000", 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8155000000000002e-05 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.781 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:17310 5.3 5:c209ca0f:::benchmark_data_smithi062_23645_object17309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.767917+0000", 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001025848, 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012545729999999999, 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:45.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 17310 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767917+0000", 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767917+0000", 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.767918+0000", 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0800000000000004e-07 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768043+0000", 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124843 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768055+0000", 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2471e-05 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768062+0000", 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.238e-06 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768448+0000", 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038556099999999998 2024-09-12T18:13:45.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768596+0000", 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014775199999999999 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768728+0000", 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131927 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:17306 5.2 e26/21 5:4b6fa2f4:::benchmark_data_smithi062_23645_object17305:head v 26'1096, mlcod=26'1094)", 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.768616+0000", 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00032656299999999998, 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061743200000000001, 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768616+0000", 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768616+0000", 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768617+0000", 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768683+0000", 2024-09-12T18:13:45.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6129000000000003e-05 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768692+0000", 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3890000000000005e-06 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768696+0000", 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8629999999999999e-06 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768742+0000", 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5466000000000001e-05 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768760+0000", 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7799999999999999e-05 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:17308 5.b e26/21 5:dea9a48b:::benchmark_data_smithi062_23645_object17307:head v 26'1071, mlcod=26'1069)", 2024-09-12T18:13:45.790 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.768821+0000", 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000121651, 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046687299999999997, 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768821+0000", 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768821+0000", 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768822+0000", 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5600000000000005e-07 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768873+0000", 2024-09-12T18:13:45.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0586e-05 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768883+0000", 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0299000000000001e-05 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768889+0000", 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.241e-06 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768950+0000", 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0454000000000001e-05 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768967+0000", 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7278e-05 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:17309 5.0 e26/21 5:05448b38:::benchmark_data_smithi062_23645_object17308:head v 26'1070, mlcod=26'1067)", 2024-09-12T18:13:45.794 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.768904+0000", 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.9366999999999998e-05, 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043164700000000001, 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768904+0000", 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768904+0000", 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768904+0000", 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.96e-07 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768941+0000", 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6698e-05 2024-09-12T18:13:45.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768948+0000", 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2810000000000003e-06 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768952+0000", 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4209999999999997e-06 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.768999+0000", 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6408e-05 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769018+0000", 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9245e-05 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:17307 5.e e26/21 5:76834092:::benchmark_data_smithi062_23645_object17306:head v 26'1087, mlcod=26'1084)", 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.769005+0000", 2024-09-12T18:13:45.798 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.999938, 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038018299999999997, 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769005+0000", 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:45.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769005+0000", 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769006+0000", 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2500000000000001e-07 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769069+0000", 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3231999999999994e-05 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769077+0000", 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9000000000000006e-06 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769081+0000", 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7940000000000002e-06 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769121+0000", 2024-09-12T18:13:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9745e-05 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.769140+0000", 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8287e-05 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 8 2024-09-12T18:13:45.802 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:45.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:45.811 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:45.810+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:45.912 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:45.913+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:45.970 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:13:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:13:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:13:45.971 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:45.993 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:46.013 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:46.010+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:46.115 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:46.113+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:46.193 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.792919872999999, 2024-09-12T18:13:46.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:13:46.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:13:46.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:13:46.200 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.200 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.200 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788889644000001, 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.201 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:46.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:13:46.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.207 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788719407999999, 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:13:46.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:13:46.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788602649000001, 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:13:46.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:13:46.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:13:46.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:13:46.220 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788533513000001, 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.221 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:13:46.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:13:46.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:13:46.226 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788421760999999, 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:13:46.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:13:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:13:46.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.232 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788257939000001, 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:13:46.233 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:13:46.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:13:46.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:13:46.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:13:46.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.239 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.239 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:46.239 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788197173, 2024-09-12T18:13:46.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:13:46.239 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:13:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.243 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.788072877000001, 2024-09-12T18:13:46.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014554022, 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:46.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406034+0000", 2024-09-12T18:13:46.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3400000000000001e-06 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406054+0000", 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0046000000000001e-05 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406078+0000", 2024-09-12T18:13:46.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3314000000000001e-05 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406093+0000", 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4983e-05 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409043+0000", 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029506549999999999 2024-09-12T18:13:46.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409285+0000", 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024186100000000001 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.420587+0000", 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011301823000000001 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.249 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.95323400999999996, 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:13:46.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:13:46.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:13:46.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15911 5.2 e25/21 5:49718f9f:::benchmark_data_smithi062_23645_object15910:head v 25'1014, mlcod=25'1012)", 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94949778900000004, 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014500318999999999, 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.255 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244609+0000", 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244676+0000", 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7323999999999994e-05 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244686+0000", 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7159999999999998e-06 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244691+0000", 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0270000000000003e-06 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244741+0000", 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0235000000000003e-05 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244774+0000", 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.269e-05 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259059+0000", 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014285525 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259108+0000", 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9011999999999998e-05 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15913 5.a 5:5c7723a1:::benchmark_data_smithi062_23645_object15912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94932052200000006, 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015699285, 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.261 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15913 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:46.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244786+0000", 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244888+0000", 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244894+0000", 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244899+0000", 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244972+0000", 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3316000000000001e-05 2024-09-12T18:13:46.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245084+0000", 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111703 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245200+0000", 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115406 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259521+0000", 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014321122 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260404+0000", 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088351800000000002 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260457+0000", 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3001000000000003e-05 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260485+0000", 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7424e-05 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15914 5.e e25/21 5:77dbab1b:::benchmark_data_smithi062_23645_object15913:head v 25'995, mlcod=25'993)", 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245378+0000", 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94872803000000006, 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014147501, 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245378+0000", 2024-09-12T18:13:46.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245378+0000", 2024-09-12T18:13:46.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245379+0000", 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6700000000000002e-07 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245438+0000", 2024-09-12T18:13:46.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9076000000000002e-05 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245452+0000", 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3864e-05 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245461+0000", 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1370000000000008e-06 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257972+0000", 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012511138999999999 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257996+0000", 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3971000000000001e-05 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259470+0000", 2024-09-12T18:13:46.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001474349 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259525+0000", 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4997999999999998e-05 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15922 5.3 5:c9e976be:::benchmark_data_smithi062_23645_object15921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:46.273 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94854159000000005, 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015052953000000001, 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15922 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245565+0000", 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2109999999999999e-06 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245594+0000", 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245601+0000", 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3670000000000002e-06 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245606+0000", 2024-09-12T18:13:46.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.023e-06 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245652+0000", 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6811999999999998e-05 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245758+0000", 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105834 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245862+0000", 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010354200000000001 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259068+0000", 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013205783 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260567+0000", 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014991570000000001 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260594+0000", 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7362e-05 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260617+0000", 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3105e-05 2024-09-12T18:13:46.279 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15917 5.b e25/21 5:d520353b:::benchmark_data_smithi062_23645_object15916:head v 25'983, mlcod=25'981)", 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94851423000000001, 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015050452000000001, 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.280 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245704+0000", 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111766 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245735+0000", 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0534000000000003e-05 2024-09-12T18:13:46.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245742+0000", 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6499999999999996e-06 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257961+0000", 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012218250999999999 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257987+0000", 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6352000000000001e-05 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260621+0000", 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026337119999999999 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260642+0000", 2024-09-12T18:13:46.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1467e-05 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94747026999999995, 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:13:46.285 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:46.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:13:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:46.292 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.56498872300000003, 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:46.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:46.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:13:46.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:13:46.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:13:46.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16962 5.a 5:5bca3d75:::benchmark_data_smithi062_23645_object16961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:46.302 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.56299796499999999, 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015114977, 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16962 2024-09-12T18:13:46.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631109+0000", 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0240000000000001e-06 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631271+0000", 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016195700000000001 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631282+0000", 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0746e-05 2024-09-12T18:13:46.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631287+0000", 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631335+0000", 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8134999999999999e-05 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631473+0000", 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013780300000000001 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631621+0000", 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148238 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633224+0000", 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001602942 2024-09-12T18:13:46.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646094+0000", 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012870651 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646181+0000", 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780999999999995e-05 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646223+0000", 2024-09-12T18:13:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1638999999999999e-05 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16965 5.5 5:a0639920:::benchmark_data_smithi062_23645_object16964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.56064139999999996, 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015569835000000001, 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.309 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16965 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633466+0000", 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-06 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633536+0000", 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0366999999999999e-05 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633546+0000", 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059e-05 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633552+0000", 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0129999999999999e-06 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646012+0000", 2024-09-12T18:13:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012459822000000001 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646152+0000", 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013997200000000001 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646248+0000", 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6335999999999994e-05 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648453+0000", 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022045770000000001 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648912+0000", 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045902200000000001 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648997+0000", 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970999999999997e-05 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649034+0000", 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7585e-05 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16969 5.5 5:a17db384:::benchmark_data_smithi062_23645_object16968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.55992797100000002, 2024-09-12T18:13:46.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015671503999999999, 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16969 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:46.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634179+0000", 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-06 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634280+0000", 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010138500000000001 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634291+0000", 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634309+0000", 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.836e-05 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647082+0000", 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012772149999999999 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647205+0000", 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012367500000000001 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647364+0000", 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015912200000000001 2024-09-12T18:13:46.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649290+0000", 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019254960000000001 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649781+0000", 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049094099999999995 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649812+0000", 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1007000000000003e-05 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649849+0000", 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7602999999999999e-05 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:46.321 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:46.323 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:46.323 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:46.318+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:46.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:13:46.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 6 16 19151 19135 199.304 176.438 0.00585765 0.00501257 2024-09-12T18:13:46.423 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:46.422+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:46.477 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:46.477 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:46.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.477 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:19333 5.1 5:8aaf1baf:::benchmark_data_smithi062_23645_object19332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:13:46.477 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:46.474390+0000", 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0039536049999999998, 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0039734970000000003, 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 19333 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474390+0000", 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474390+0000", 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474391+0000", 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8700000000000005e-07 2024-09-12T18:13:46.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474463+0000", 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2286000000000006e-05 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474474+0000", 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0708e-05 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474481+0000", 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.72e-06 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474547+0000", 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5780999999999999e-05 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474640+0000", 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3449999999999995e-05 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474781+0000", 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014124100000000001 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477308+0000", 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002527217 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:19332 5.6 e27/21 5:62917d76:::benchmark_data_smithi062_23645_object19331:head v 27'1235, mlcod=27'1233)", 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:46.474536+0000", 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0038079110000000002, 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0038775799999999998, 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474536+0000", 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474536+0000", 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474536+0000", 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.15e-07 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474616+0000", 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9194000000000001e-05 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474625+0000", 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5009999999999993e-06 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474633+0000", 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2360000000000004e-06 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474705+0000", 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1957000000000002e-05 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.474725+0000", 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9726999999999999e-05 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.486 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:19335 5.7 5:e6a9a7f2:::benchmark_data_smithi062_23645_object19334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:46.476046+0000", 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0022974900000000001, 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024102619999999998, 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 19335 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476046+0000", 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476046+0000", 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476047+0000", 2024-09-12T18:13:46.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8800000000000002e-07 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476100+0000", 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2587999999999999e-05 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476110+0000", 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0074999999999999e-05 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476115+0000", 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6609999999999997e-06 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476160+0000", 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4792000000000001e-05 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476243+0000", 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2869999999999998e-05 2024-09-12T18:13:46.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476324+0000", 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0655999999999995e-05 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.478015+0000", 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001691155 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:19337 5.f 5:f3e7abce:::benchmark_data_smithi062_23645_object19336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:46.476602+0000", 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0017419969999999999, 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001911507, 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 19337 2024-09-12T18:13:46.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476602+0000", 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476602+0000", 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476602+0000", 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6600000000000002e-07 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476668+0000", 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5164000000000002e-05 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476676+0000", 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1599999999999998e-06 2024-09-12T18:13:46.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476680+0000", 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2860000000000001e-06 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476732+0000", 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2070999999999997e-05 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.476873+0000", 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000140469 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477054+0000", 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000181406 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:19339 5.3 e27/21 5:cf4038be:::benchmark_data_smithi062_23645_object19338:head v 27'1206, mlcod=27'1203)", 2024-09-12T18:13:46.496 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:46.477771+0000", 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00057283799999999999, 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00078769799999999998, 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477771+0000", 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477771+0000", 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477771+0000", 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.39e-07 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477831+0000", 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9171e-05 2024-09-12T18:13:46.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477836+0000", 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5330000000000002e-06 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477840+0000", 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6969999999999999e-06 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477883+0000", 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2932999999999997e-05 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:46.477896+0000", 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3456e-05 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 5 2024-09-12T18:13:46.500 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:46.501 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:46.546 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:46.546+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:46.626 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:46.625+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:46.654 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:46.654 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:13:46.654 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:13:46.654 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:13:46.654 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:46.678 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:46.727 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:46.726+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:46.828 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:46.829+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:46.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:13:46.882 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:46.882 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:13:46.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:13:46.882 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 34.587699911999998, 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:46.883 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:13:46.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 33.783406786, 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.891 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:13:46.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:13:46.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 33.783371610000003, 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.897 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:13:46.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:13:46.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487775936999999, 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:13:46.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.909 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487682262, 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:46.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:46.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487613031999999, 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.916 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:46.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:13:46.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:13:46.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:46.922 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487522265999999, 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:13:46.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:13:46.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:13:46.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:46.928 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487461242999998, 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:13:46.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:13:46.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:13:46.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.934 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487402484, 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:13:46.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:13:46.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.940 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.487339433999999, 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:13:46.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:13:46.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.486539059999998, 2024-09-12T18:13:46.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:13:46.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:13:46.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.486400858, 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.952 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:13:46.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:13:46.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:13:46.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:13:46.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.959 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.486337607999999, 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:13:46.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:13:46.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:13:46.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.965 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.486239036000001, 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:46.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.971 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.485937641, 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.972 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:13:46.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.485839539000001, 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:13:46.978 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:13:46.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.485747147000001, 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:46.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:13:46.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.990 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.485660249999999, 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:13:46.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:46.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:46.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:13:46.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:13:46.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:46.996 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:13:46.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:13:46.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:13:46.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:46.998 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.485536627999998, 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:46.999 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:47.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:47.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:47.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:13:47.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:47.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:13:47.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:13:47.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:13:47.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:13:47.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:13:47.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:47.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.485145028000002, 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:47.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:13:47.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:13:47.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:13:47.012 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:47.012 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:47.012 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:47.012 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:47.012 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:47.012 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:47.013 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:47.014 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:47.013+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:47.014 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:47.014 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:47.026 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:47.026 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:47.045 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:47.045 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:47.115 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:47.110+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:47.169 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:47.169 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:47.191 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:47.242 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:47.238+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:47.330 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:47.322+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:47.353 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:13:47.397 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:47.398 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:47.408 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 7 16 22003 21987 196.294 178.25 0.00596588 0.00508793 2024-09-12T18:13:47.418 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:47.438 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:47.414+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:47.603 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:47.603 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:47.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:47.628 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:47.622+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:47.723 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:47.718+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:47.748 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:47.742+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:47.799 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:47.799 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:47.823 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:47.824 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:47.818+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:47.924 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:47.925+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:48.025 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:48.022+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:48.032 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:48.032 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:48.055 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:48.149 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:48.149+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:48.226 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:48.222+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:48.265 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:48.285 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:48.327 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:48.322+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:48.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 8 16 24749 24733 193.209 171.625 0.00685427 0.00516962 2024-09-12T18:13:48.428 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:48.426+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:48.449 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:48.466 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:48.529 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:48.526+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:48.621 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:48.622 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:48.630 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:48.630+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:48.645 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:48.731 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:48.733+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:48.831 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:48.826+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:48.835 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:48.857 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:48.933 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:48.933+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:49.013 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:49.034 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:49.035 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:49.030+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:49.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:13:49.134 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:49.134+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:49.192 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:49.213 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:49.228 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:49.228 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:49.236 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:49.234+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:49.250 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:49.250 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:49.270 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:49.336 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:49.337+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.369 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977750143000002, 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:49.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:13:49.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:13:49.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:13:49.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:13:49.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:13:49.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977634780999999, 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:13:49.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:13:49.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:13:49.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:49.389 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977553815, 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:13:49.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:13:49.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:13:49.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:13:49.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.400 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977449303, 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.401 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:49.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:49.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:13:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:13:49.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:13:49.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.97736536, 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.412 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:13:49.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:13:49.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:13:49.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.422 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977242413999999, 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:13:49.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:13:49.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:13:49.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977170905000001, 2024-09-12T18:13:49.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:49.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:13:49.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:13:49.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977106005, 2024-09-12T18:13:49.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:13:49.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:13:49.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:49.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:13:49.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.448 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.977036539, 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:13:49.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.962618377999998, 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:13:49.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:13:49.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15908 5.0 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:49.462 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.128840329, 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018670684, 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15908 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.463 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239941+0000", 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6400000000000001e-07 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239986+0000", 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5466999999999997e-05 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239996+0000", 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6209999999999999e-06 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240002+0000", 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.229e-06 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240369+0000", 2024-09-12T18:13:49.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036721600000000002 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240554+0000", 2024-09-12T18:13:49.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018448100000000001 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240680+0000", 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012593700000000001 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.242166+0000", 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014860170000000001 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258545+0000", 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01637885 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258579+0000", 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.468e-05 2024-09-12T18:13:49.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258611+0000", 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1322000000000003e-05 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15917 5.b 5:d520353b:::benchmark_data_smithi062_23645_object15916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1231843850000001, 2024-09-12T18:13:49.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015705908000000001, 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15917 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:49.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245597+0000", 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245642+0000", 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5484e-05 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245647+0000", 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2399999999999998e-06 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245651+0000", 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3469999999999999e-06 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245695+0000", 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4249999999999998e-05 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245806+0000", 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110752 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245920+0000", 2024-09-12T18:13:49.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114156 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255011+0000", 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090915860000000005 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261216+0000", 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062048700000000004 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261251+0000", 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4854999999999997e-05 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261302+0000", 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0766999999999997e-05 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:49.478 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1231174309999998, 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:13:49.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:13:49.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15923 5.4 5:217c37e3:::benchmark_data_smithi062_23645_object15922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1218294640000002, 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017388715999999999, 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15923 2024-09-12T18:13:49.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246952+0000", 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.95e-07 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247021+0000", 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9080999999999998e-05 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247032+0000", 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0577999999999999e-05 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247039+0000", 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3699999999999997e-06 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253374+0000", 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063354919999999999 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253534+0000", 2024-09-12T18:13:49.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159421 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253632+0000", 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8021000000000002e-05 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255738+0000", 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021061550000000002 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264249+0000", 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085105400000000005 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264301+0000", 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1996999999999997e-05 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264340+0000", 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9066000000000002e-05 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.490 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16961 5.b 5:d94b6522:::benchmark_data_smithi062_23645_object16960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7372437820000002, 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016331854, 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.491 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16961 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:49.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631676+0000", 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013913799999999999 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631689+0000", 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2483000000000001e-05 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631694+0000", 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1610000000000002e-06 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631778+0000", 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4529000000000003e-05 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631935+0000", 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156279 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632093+0000", 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000157792 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634146+0000", 2024-09-12T18:13:49.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002053301 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647775+0000", 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013628695 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647829+0000", 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4945999999999999e-05 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647868+0000", 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8914e-05 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16963 5.4 5:2fa071ac:::benchmark_data_smithi062_23645_object16962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7370751489999998, 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016816028, 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.497 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16963 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631706+0000", 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631736+0000", 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0224000000000001e-05 2024-09-12T18:13:49.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631741+0000", 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5910000000000003e-06 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631745+0000", 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631788+0000", 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2823e-05 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631918+0000", 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000129586 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632010+0000", 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2215999999999999e-05 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.633704+0000", 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001693784 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648445+0000", 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014741316000000001 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648480+0000", 2024-09-12T18:13:49.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4620999999999999e-05 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648521+0000", 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1631999999999997e-05 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16971 5.4 5:271b2960:::benchmark_data_smithi062_23645_object16970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7343842789999999, 2024-09-12T18:13:49.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015406705, 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16971 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:49.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634397+0000", 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0189999999999999e-06 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634500+0000", 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103398 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634511+0000", 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0733e-05 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634519+0000", 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4850000000000003e-06 2024-09-12T18:13:49.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634589+0000", 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0180999999999998e-05 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634736+0000", 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000147443 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634879+0000", 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000142943 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637632+0000", 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002753237 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649640+0000", 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012007261999999999 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649742+0000", 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102231 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649803+0000", 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0773000000000002e-05 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16972 5.0 5:0a18df3f:::benchmark_data_smithi062_23645_object16971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7342353080000001, 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015621523999999999, 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16972 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.510 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634546+0000", 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634588+0000", 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2580999999999998e-05 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634597+0000", 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6959999999999994e-06 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634603+0000", 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7690000000000002e-06 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634654+0000", 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1607000000000002e-05 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634826+0000", 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017138099999999999 2024-09-12T18:13:49.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635023+0000", 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019718000000000001 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637067+0000", 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002043703 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650031+0000", 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012964260999999999 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650113+0000", 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2522999999999996e-05 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650167+0000", 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3151e-05 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.515 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16973 5.e 5:7478c9cc:::benchmark_data_smithi062_23645_object16972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7341643270000002, 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015645486, 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.516 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16973 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634617+0000", 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634659+0000", 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2555000000000002e-05 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634667+0000", 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634673+0000", 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3640000000000004e-06 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634739+0000", 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6229000000000006e-05 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634900+0000", 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016037000000000001 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635079+0000", 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017936699999999999 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637311+0000", 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0022314629999999999 2024-09-12T18:13:49.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650191+0000", 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012880302 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650232+0000", 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0595e-05 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650261+0000", 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9957000000000001e-05 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16974 5.4 5:2e454f5d:::benchmark_data_smithi062_23645_object16973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634686+0000", 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7340938399999999, 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015320001999999999, 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:49.522 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16974 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634686+0000", 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:49.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634686+0000", 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634687+0000", 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634741+0000", 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3337000000000001e-05 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634748+0000", 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6399999999999997e-06 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634754+0000", 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4040000000000003e-06 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635977+0000", 2024-09-12T18:13:49.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012234629999999999 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.636273+0000", 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029642900000000002 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.636545+0000", 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027181599999999997 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:49.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.638271+0000", 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001725425 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649880+0000", 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011609298000000001 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649963+0000", 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999999e-05 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:49.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650006+0000", 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3117000000000001e-05 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:49.528 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:49.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:13:49.530 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 9 16 27501 27485 190.85 172 0.00782751 0.00523396 2024-09-12T18:13:49.531 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:49.531 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:49.526+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:49.631 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:49.629+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:49.701 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28337 5.c 5:3a77fc8c:::benchmark_data_smithi062_23645_object28336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.700313+0000", 2024-09-12T18:13:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00084696599999999999, 2024-09-12T18:13:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00086802699999999995, 2024-09-12T18:13:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28337 2024-09-12T18:13:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700313+0000", 2024-09-12T18:13:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700313+0000", 2024-09-12T18:13:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700314+0000", 2024-09-12T18:13:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.124e-06 2024-09-12T18:13:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700417+0000", 2024-09-12T18:13:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103285 2024-09-12T18:13:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700427+0000", 2024-09-12T18:13:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-09-12T18:13:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700432+0000", 2024-09-12T18:13:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2310000000000004e-06 2024-09-12T18:13:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700487+0000", 2024-09-12T18:13:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5015000000000001e-05 2024-09-12T18:13:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700632+0000", 2024-09-12T18:13:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014567900000000001 2024-09-12T18:13:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700762+0000", 2024-09-12T18:13:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012993 2024-09-12T18:13:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28338 5.a 5:55d05337:::benchmark_data_smithi062_23645_object28337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.700561+0000", 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000598585, 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00069059999999999998, 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28338 2024-09-12T18:13:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700561+0000", 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700561+0000", 2024-09-12T18:13:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700563+0000", 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2589999999999999e-06 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700633+0000", 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0067000000000005e-05 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700643+0000", 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027e-05 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700650+0000", 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.63e-06 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700777+0000", 2024-09-12T18:13:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012758999999999999 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700886+0000", 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010880899999999999 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700968+0000", 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2249000000000005e-05 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28339 5.3 5:cf1b79a4:::benchmark_data_smithi062_23645_object28338:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.700746+0000", 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00041437100000000002, 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054623400000000004, 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28339 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700746+0000", 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700746+0000", 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700746+0000", 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700786+0000", 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9560000000000001e-05 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700794+0000", 2024-09-12T18:13:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8909999999999995e-06 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700801+0000", 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0450000000000003e-06 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700853+0000", 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2028999999999999e-05 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700988+0000", 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013540500000000001 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701134+0000", 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000146074 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28342 5.5 5:a309fcb0:::benchmark_data_smithi062_23645_object28341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.701025+0000", 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00013454499999999999, 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030681399999999998, 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28342 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701025+0000", 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701025+0000", 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701026+0000", 2024-09-12T18:13:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.003e-06 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701095+0000", 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8201999999999995e-05 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701106+0000", 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701114+0000", 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9710000000000004e-06 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701172+0000", 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7732999999999998e-05 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.701282+0000", 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109572 2024-09-12T18:13:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28326 5.6 5:65ac9acd:::benchmark_data_smithi062_23645_object28325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.695882+0000", 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0052784800000000003, 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00548476, 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28326 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.695882+0000", 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.695882+0000", 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.695883+0000", 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.209e-06 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.695921+0000", 2024-09-12T18:13:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8507000000000002e-05 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.695933+0000", 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1423999999999999e-05 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.695939+0000", 2024-09-12T18:13:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8020000000000003e-06 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696890+0000", 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00095043799999999996 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697079+0000", 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189013 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697227+0000", 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014760899999999999 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700599+0000", 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033724779999999999 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28327 5.6 5:6f00de0a:::benchmark_data_smithi062_23645_object28326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.696705+0000", 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0044551820000000002, 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047205229999999999, 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28327 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696705+0000", 2024-09-12T18:13:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696705+0000", 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696706+0000", 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8899999999999998e-07 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696782+0000", 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6624000000000004e-05 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696793+0000", 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1042e-05 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.696801+0000", 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4209999999999998e-06 2024-09-12T18:13:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.698437+0000", 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001636319 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.698663+0000", 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000226011 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.698739+0000", 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5397999999999999e-05 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.700702+0000", 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019631789999999998 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:28332 5.c 5:3320ea31:::benchmark_data_smithi062_23645_object28331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.697052+0000", 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0041077029999999999, 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044557640000000001, 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 28332 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697052+0000", 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697052+0000", 2024-09-12T18:13:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697053+0000", 2024-09-12T18:13:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.16e-07 2024-09-12T18:13:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697116+0000", 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2840000000000001e-05 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697128+0000", 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2359e-05 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697136+0000", 2024-09-12T18:13:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0590000000000003e-06 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697208+0000", 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1533999999999996e-05 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697329+0000", 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012086700000000001 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697451+0000", 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122006 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:28328 5.4 e28/21 5:252b0153:::benchmark_data_smithi062_23645_object28327:head v 28'1739, mlcod=28'1737)", 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:49.697372+0000", 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0037882800000000002, 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041923100000000003, 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697372+0000", 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697372+0000", 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697372+0000", 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5000000000000002e-07 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697467+0000", 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4606999999999997e-05 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697477+0000", 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4089999999999992e-06 2024-09-12T18:13:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697483+0000", 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7499999999999997e-06 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697525+0000", 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1539000000000003e-05 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:49.697541+0000", 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6169000000000001e-05 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 8 2024-09-12T18:13:49.753 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:49.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:49.755 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:49.753+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:49.855 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:49.853+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:49.956 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:49.957+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:49.963 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:49.963 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:13:49.963 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:13:49.963 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:13:49.963 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:49.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:50.057 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:50.054+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:50.158 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:50.158+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:50.200 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:50.200 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:13:50.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:13:50.200 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:50.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.201 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:13:50.201 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:50.201 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.797976619, 2024-09-12T18:13:50.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:13:50.201 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.201 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:50.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:50.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:13:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:13:50.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:13:50.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:13:50.208 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.208 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793946389999999, 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.209 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:13:50.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:13:50.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793776154, 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.215 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:50.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:13:50.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:13:50.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793659394999999, 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:13:50.221 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:13:50.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:13:50.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793590258999998, 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.227 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:13:50.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.232 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793478507, 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:13:50.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:13:50.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793314684999999, 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:13:50.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:13:50.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:13:50.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:13:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:13:50.243 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793253919000001, 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:50.244 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:13:50.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.793129622999999, 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014554022, 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406034+0000", 2024-09-12T18:13:50.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3400000000000001e-06 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406054+0000", 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0046000000000001e-05 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406078+0000", 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3314000000000001e-05 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406093+0000", 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4983e-05 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409043+0000", 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029506549999999999 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409285+0000", 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024186100000000001 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.420587+0000", 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011301823000000001 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.253 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9582907560000002, 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:13:50.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:13:50.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:13:50.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:13:50.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:13:50.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15911 5.2 e25/21 5:49718f9f:::benchmark_data_smithi062_23645_object15910:head v 25'1014, mlcod=25'1012)", 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9545545349999998, 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014500318999999999, 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.260 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244609+0000", 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244676+0000", 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7323999999999994e-05 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244686+0000", 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7159999999999998e-06 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244691+0000", 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0270000000000003e-06 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244741+0000", 2024-09-12T18:13:50.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0235000000000003e-05 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244774+0000", 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.269e-05 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259059+0000", 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014285525 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259108+0000", 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9011999999999998e-05 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15913 5.a 5:5c7723a1:::benchmark_data_smithi062_23645_object15912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.954377268, 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015699285, 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15913 2024-09-12T18:13:50.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244786+0000", 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244888+0000", 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244894+0000", 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244899+0000", 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244972+0000", 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3316000000000001e-05 2024-09-12T18:13:50.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245084+0000", 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111703 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245200+0000", 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115406 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259521+0000", 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014321122 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260404+0000", 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088351800000000002 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260457+0000", 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3001000000000003e-05 2024-09-12T18:13:50.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260485+0000", 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7424e-05 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15922 5.3 5:c9e976be:::benchmark_data_smithi062_23645_object15921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:50.272 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9535983359999998, 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015052953000000001, 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15922 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245565+0000", 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2109999999999999e-06 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245594+0000", 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245601+0000", 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3670000000000002e-06 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245606+0000", 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.023e-06 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245652+0000", 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6811999999999998e-05 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245758+0000", 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105834 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245862+0000", 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010354200000000001 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259068+0000", 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013205783 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260567+0000", 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014991570000000001 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260594+0000", 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7362e-05 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260617+0000", 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3105e-05 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15917 5.b e25/21 5:d520353b:::benchmark_data_smithi062_23645_object15916:head v 25'983, mlcod=25'981)", 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.953570976, 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015050452000000001, 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245704+0000", 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111766 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245735+0000", 2024-09-12T18:13:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0534000000000003e-05 2024-09-12T18:13:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245742+0000", 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6499999999999996e-06 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257961+0000", 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012218250999999999 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257987+0000", 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6352000000000001e-05 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260621+0000", 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026337119999999999 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260642+0000", 2024-09-12T18:13:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1467e-05 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9525270160000003, 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:13:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5700454690000001, 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:13:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:13:50.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16962 5.a 5:5bca3d75:::benchmark_data_smithi062_23645_object16961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5680547110000003, 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015114977, 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.299 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16962 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631109+0000", 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0240000000000001e-06 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631271+0000", 2024-09-12T18:13:50.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016195700000000001 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631282+0000", 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0746e-05 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631287+0000", 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631335+0000", 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8134999999999999e-05 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631473+0000", 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013780300000000001 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631621+0000", 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148238 2024-09-12T18:13:50.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633224+0000", 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001602942 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646094+0000", 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012870651 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646181+0000", 2024-09-12T18:13:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780999999999995e-05 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646223+0000", 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1638999999999999e-05 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16965 5.5 5:a0639920:::benchmark_data_smithi062_23645_object16964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5656981459999999, 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015569835000000001, 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16965 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:50.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633466+0000", 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-06 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633536+0000", 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0366999999999999e-05 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633546+0000", 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059e-05 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633552+0000", 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0129999999999999e-06 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646012+0000", 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012459822000000001 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646152+0000", 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013997200000000001 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646248+0000", 2024-09-12T18:13:50.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6335999999999994e-05 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648453+0000", 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022045770000000001 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648912+0000", 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045902200000000001 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648997+0000", 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970999999999997e-05 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649034+0000", 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7585e-05 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16969 5.5 5:a17db384:::benchmark_data_smithi062_23645_object16968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:50.311 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5649847169999997, 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015671503999999999, 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16969 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634179+0000", 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-06 2024-09-12T18:13:50.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634280+0000", 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010138500000000001 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634291+0000", 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634309+0000", 2024-09-12T18:13:50.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.836e-05 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647082+0000", 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012772149999999999 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647205+0000", 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012367500000000001 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647364+0000", 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015912200000000001 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649290+0000", 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019254960000000001 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649781+0000", 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049094099999999995 2024-09-12T18:13:50.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649812+0000", 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1007000000000003e-05 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649849+0000", 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7602999999999999e-05 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.317 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:19567 5.6 5:62441267:::benchmark_data_smithi062_23645_object19566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.6482261569999999, 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015428716, 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:50.318 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 19567 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550937+0000", 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551054+0000", 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116697 2024-09-12T18:13:50.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551064+0000", 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7759999999999992e-06 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551071+0000", 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:50.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551622+0000", 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055093700000000004 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551694+0000", 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1783e-05 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551770+0000", 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5945000000000006e-05 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.555763+0000", 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039931230000000003 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566239+0000", 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010475475999999999 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566317+0000", 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7885000000000004e-05 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:50.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566365+0000", 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8634000000000002e-05 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:50.324 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:50.326 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:50.326 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:50.325+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:50.358 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:13:50.358 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:13:50.358 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-12T18:13:50.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-12T18:13:50.390 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:13:50.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 10 16 30194 30178 188.595 168.312 0.0038263 0.00529675 2024-09-12T18:13:50.426 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:50.422+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:50.481 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:30379 5.c e29/21 5:38c88798:::benchmark_data_smithi062_23645_object30378:head v 29'1873, mlcod=29'1870)", 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.474369+0000", 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0082524650000000005, 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0082684400000000002, 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474369+0000", 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474369+0000", 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474369+0000", 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0900000000000001e-07 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474424+0000", 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4469000000000003e-05 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474435+0000", 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0906e-05 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474442+0000", 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8390000000000001e-06 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474489+0000", 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7256000000000003e-05 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474510+0000", 2024-09-12T18:13:50.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0784e-05 2024-09-12T18:13:50.488 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:30381 5.9 5:96cf7cdb:::benchmark_data_smithi062_23645_object30380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.474539+0000", 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0080824869999999993, 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0081361249999999993, 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.489 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 30381 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474539+0000", 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474539+0000", 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474540+0000", 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.031e-06 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474600+0000", 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0708999999999998e-05 2024-09-12T18:13:50.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474614+0000", 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3101999999999999e-05 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474621+0000", 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474675+0000", 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3359000000000002e-05 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474780+0000", 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010553200000000001 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474861+0000", 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0494999999999994e-05 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:30382 5.1 5:8e9d974c:::benchmark_data_smithi062_23645_object30381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.474667+0000", 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0079541709999999995, 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080480770000000007, 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.494 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 30382 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474667+0000", 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474667+0000", 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474668+0000", 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474773+0000", 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010529199999999999 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474785+0000", 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1338999999999999e-05 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474792+0000", 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2470000000000002e-06 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474834+0000", 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2614000000000002e-05 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.474917+0000", 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2142000000000001e-05 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475014+0000", 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7248000000000001e-05 2024-09-12T18:13:50.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477732+0000", 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0027177339999999999 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:30385 5.c e29/21 5:3a70a1dc:::benchmark_data_smithi062_23645_object30384:head v 29'1874, mlcod=29'1871)", 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.475459+0000", 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0071618300000000001, 2024-09-12T18:13:50.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007306313, 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475459+0000", 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475459+0000", 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475460+0000", 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9599999999999999e-07 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475521+0000", 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1378999999999996e-05 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475532+0000", 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0336999999999999e-05 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475539+0000", 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8900000000000001e-06 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476871+0000", 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0013324789999999999 2024-09-12T18:13:50.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476941+0000", 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0395000000000006e-05 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:30387 5.6 e29/21 5:648ef10a:::benchmark_data_smithi062_23645_object30386:head v 29'1940, mlcod=29'1938)", 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.475985+0000", 2024-09-12T18:13:50.503 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0066365560000000001, 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0068179410000000001, 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475985+0000", 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475985+0000", 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.475985+0000", 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9400000000000005e-07 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476034+0000", 2024-09-12T18:13:50.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8602e-05 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476043+0000", 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7930000000000003e-06 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476048+0000", 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8109999999999999e-06 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476117+0000", 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8029999999999997e-05 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476137+0000", 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0199000000000001e-05 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.507 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:30388 5.d e29/21 5:b1d281f4:::benchmark_data_smithi062_23645_object30387:head v 29'1889, mlcod=29'1887)", 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.476908+0000", 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0057131120000000002, 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0059454419999999996, 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476908+0000", 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476908+0000", 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.476909+0000", 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7400000000000003e-07 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477000+0000", 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1014999999999995e-05 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477008+0000", 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1259999999999998e-06 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477014+0000", 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0739999999999998e-06 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477093+0000", 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9124999999999999e-05 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477110+0000", 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6935e-05 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:30389 5.d e29/21 5:b182ba59:::benchmark_data_smithi062_23645_object30388:head v 29'1890, mlcod=29'1887)", 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.477674+0000", 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049467959999999998, 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052177179999999997, 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477674+0000", 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477674+0000", 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477675+0000", 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1099999999999995e-07 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477734+0000", 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9323000000000001e-05 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477741+0000", 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6189999999999996e-06 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477745+0000", 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4569999999999998e-06 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478278+0000", 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00053253800000000004 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478297+0000", 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8936e-05 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:30390 5.5 e29/21 5:a88862bf:::benchmark_data_smithi062_23645_object30389:head v 29'1948, mlcod=29'1946)", 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.477927+0000", 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0046941329999999996, 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0050175239999999998, 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477927+0000", 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477927+0000", 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477928+0000", 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9100000000000004e-07 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477976+0000", 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7988000000000002e-05 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477982+0000", 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0800000000000002e-06 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.477986+0000", 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1019999999999999e-06 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478975+0000", 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00098913499999999993 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478986+0000", 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0703000000000001e-05 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:30392 5.2 5:4986ca28:::benchmark_data_smithi062_23645_object30391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.478022+0000", 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0045990090000000003, 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049597230000000001, 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 30392 2024-09-12T18:13:50.520 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478022+0000", 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478022+0000", 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478023+0000", 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.077e-06 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478048+0000", 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4488999999999999e-05 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478056+0000", 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.208e-06 2024-09-12T18:13:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478060+0000", 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2610000000000004e-06 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478109+0000", 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8616999999999999e-05 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478250+0000", 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014092 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478386+0000", 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013613699999999999 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.482863+0000", 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0044771719999999997 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.524 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:30393 5.2 5:412f0e73:::benchmark_data_smithi062_23645_object30392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:50.478165+0000", 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004456443, 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0048656150000000002, 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:50.525 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 30393 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478165+0000", 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478165+0000", 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478165+0000", 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.63e-07 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478299+0000", 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013394700000000001 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478310+0000", 2024-09-12T18:13:50.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1137e-05 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.478314+0000", 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6729999999999998e-06 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.479673+0000", 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001359166 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.479824+0000", 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015108400000000001 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.480005+0000", 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000180407 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:50.483007+0000", 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030023020000000001 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.529 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:13:50.530 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 10 2024-09-12T18:13:50.530 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:50.531 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:50.532 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:50.530+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:50.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-12T18:13:50.631 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:50.630+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:50.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-12T18:13:50.725 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:50.725 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:13:50.725 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:13:50.725 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:13:50.725 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:50.733 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:50.730+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:50.747 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:50.834 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:50.830+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:50.935 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:50.933+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:50.950 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.655244426000003, 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:13:50.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:13:50.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:13:50.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 37.850951299999998, 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:13:50.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.959 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:50.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:13:50.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:13:50.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:13:50.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:13:50.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:13:50.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:50.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:13:50.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.966 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 37.850916124000001, 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:50.967 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:50.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:13:50.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:13:50.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:13:50.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:13:50.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.974 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.555320451, 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:13:50.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:13:50.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:13:50.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.555226776000001, 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.982 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:50.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.989 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.555157546, 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.555066780000001, 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:50.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:13:50.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:13:51.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.555005757, 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:51.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:13:51.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.554946997999998, 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:13:51.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:13:51.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.013 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.554883948000001, 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.014 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:13:51.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.020 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.021 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.021 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:51.021 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.554083574, 2024-09-12T18:13:51.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:13:51.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.027 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553945372000001, 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:13:51.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:13:51.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.034 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553882122000001, 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:13:51.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:13:51.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553783549999999, 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:51.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:13:51.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.046 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553482155000001, 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:51.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:13:51.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:13:51.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.052 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553384052999998, 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:13:51.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:13:51.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:51.058 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553291660999999, 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:51.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:13:51.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:13:51.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:51.064 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553204764, 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:51.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.553081142, 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.070 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:13:51.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:13:51.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.075 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.552689542, 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:13:51.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:51.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:51.080 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:51.081 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:51.081+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:51.082 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:51.182 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:51.182+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:51.233 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:51.233 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:51.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:32385 5.9 e29/21 5:98b5bc65:::benchmark_data_smithi062_23645_object32384:head v 29'2015, mlcod=29'2013)", 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.231147+0000", 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0040639120000000003, 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0040801750000000001, 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231147+0000", 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231147+0000", 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231148+0000", 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231203+0000", 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4889000000000003e-05 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231211+0000", 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9959999999999993e-06 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231216+0000", 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231270+0000", 2024-09-12T18:13:51.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4292999999999997e-05 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231288+0000", 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8615e-05 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.238 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:32388 5.8 5:1173c6f7:::benchmark_data_smithi062_23645_object32387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.231261+0000", 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.003950561, 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0040032449999999999, 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32388 2024-09-12T18:13:51.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231261+0000", 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231261+0000", 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231262+0000", 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.091e-06 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231288+0000", 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5868e-05 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231295+0000", 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.43e-06 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231299+0000", 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2549999999999999e-06 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231949+0000", 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00064968600000000001 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232062+0000", 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011350599999999999 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232184+0000", 2024-09-12T18:13:51.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000121697 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:32387 5.a e29/21 5:5b88dadd:::benchmark_data_smithi062_23645_object32386:head v 29'1934, mlcod=29'1931)", 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.231660+0000", 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.003551678, 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0036398720000000002, 2024-09-12T18:13:51.244 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231660+0000", 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231660+0000", 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231660+0000", 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6800000000000001e-07 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231725+0000", 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5407000000000006e-05 2024-09-12T18:13:51.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231737+0000", 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1533e-05 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231741+0000", 2024-09-12T18:13:51.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3630000000000004e-06 2024-09-12T18:13:51.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231792+0000", 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0803000000000001e-05 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231812+0000", 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0211999999999999e-05 2024-09-12T18:13:51.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:32389 5.b 5:d2f7d356:::benchmark_data_smithi062_23645_object32388:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.231742+0000", 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0034690110000000001, 2024-09-12T18:13:51.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035855729999999999, 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:51.252 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32389 2024-09-12T18:13:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231742+0000", 2024-09-12T18:13:51.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231742+0000", 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231743+0000", 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231815+0000", 2024-09-12T18:13:51.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1446999999999995e-05 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231826+0000", 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.132e-05 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.231832+0000", 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4930000000000003e-06 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232024+0000", 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000191165 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232172+0000", 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014835599999999999 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:51.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232327+0000", 2024-09-12T18:13:51.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015462700000000001 2024-09-12T18:13:51.259 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.259 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:32391 5.d 5:b82d543c:::benchmark_data_smithi062_23645_object32390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.232356+0000", 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0028553509999999999, 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030091139999999998, 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.260 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32391 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232356+0000", 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232356+0000", 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232357+0000", 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6300000000000004e-07 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232418+0000", 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1235000000000006e-05 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232429+0000", 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0694e-05 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232436+0000", 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7549999999999994e-06 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232489+0000", 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2991000000000001e-05 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232586+0000", 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6549e-05 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.232674+0000", 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.797e-05 2024-09-12T18:13:51.265 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:32377 5.d 5:b5d79809:::benchmark_data_smithi062_23645_object32376:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.229209+0000", 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0060026309999999996, 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061917159999999999, 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.266 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32377 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.229209+0000", 2024-09-12T18:13:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.229209+0000", 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.229210+0000", 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.229352+0000", 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014269700000000001 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.229365+0000", 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2587e-05 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.229373+0000", 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8429999999999993e-06 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230047+0000", 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067467500000000001 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230258+0000", 2024-09-12T18:13:51.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000210681 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230414+0000", 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015599900000000001 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.233596+0000", 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031819399999999999 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.271 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:32380 5.b 5:db5a149b:::benchmark_data_smithi062_23645_object32379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.230141+0000", 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0050703570000000002, 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052963050000000003, 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:51.272 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32380 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230141+0000", 2024-09-12T18:13:51.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230141+0000", 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230142+0000", 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.032e-06 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230248+0000", 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106353 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230259+0000", 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-05 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230267+0000", 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7970000000000001e-06 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230332+0000", 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4925000000000006e-05 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230456+0000", 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012443400000000001 2024-09-12T18:13:51.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230609+0000", 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152237 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.278 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:32381 5.8 5:1fd46e6e:::benchmark_data_smithi062_23645_object32380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:51.230285+0000", 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0049264549999999997, 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051889290000000001, 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:51.279 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32381 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230285+0000", 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.281 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230285+0000", 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230286+0000", 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5600000000000004e-07 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230327+0000", 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1359999999999997e-05 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230334+0000", 2024-09-12T18:13:51.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.888e-06 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230338+0000", 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9870000000000001e-06 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230386+0000", 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.778e-05 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230486+0000", 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0001004 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:51.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:51.230611+0000", 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012470999999999999 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:13:51.286 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 8 2024-09-12T18:13:51.287 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:51.289 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:51.289 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:51.286+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:51.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:13:51.389 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:51.386+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:51.399 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 11 16 32840 32824 186.483 165.375 0.00785387 0.00535703 2024-09-12T18:13:51.457 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:51.457 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:51.477 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:51.478 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:51.490 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:51.489+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:51.491 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:51.491 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:51.496 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:51.497 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:51.515 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:51.591 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:51.590+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:51.692 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:51.690+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:51.713 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:51.713 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:51.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:51.793 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:51.793+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:51.883 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:51.883 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:51.893 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:51.893+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:51.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:51.995 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:51.993+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:52.096 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:52.094+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:52.101 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:52.101 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:52.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:52.197 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:52.193+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:52.278 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:52.278 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:52.299 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:52.297+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:52.301 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:52.399 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:52.397+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:52.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 12 16 35357 35341 184.051 157.312 0.0053082 0.00542783 2024-09-12T18:13:52.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:13:52.451 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:52.451 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:52.465 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:52.510 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:52.509+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:52.601 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:52.600+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:52.672 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:52.672 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:52.692 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:52.701 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:52.702+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:52.802 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:52.800+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:52.857 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:52.857 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:52.879 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:52.903 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:52.901+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:53.005 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:53.004+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:53.038 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:53.038 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:53.062 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:53.106 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:53.104+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:53.208 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:53.208+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:53.215 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:53.215 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:53.238 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:53.307 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:53.308+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:53.391 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:53.391 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:53.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 13 16 37684 37668 181.078 145.438 0.00439696 0.00551724 2024-09-12T18:13:53.408 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:53.410+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:53.409 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:13:53.412 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:53.509 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:53.510+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:53.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:13:53.578 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:53.578 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:53.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:53.610 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:53.609+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:53.680 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:53.680 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:53.700 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:53.701 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:53.712 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:53.712+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:53.719 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:53.719 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:53.766 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:53.766 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:13:53.766 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:13:53.767 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:13:53.767 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:53.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:53.812 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:53.809+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:53.914 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:53.909+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:13:53.989 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.587459952, 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:13:53.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:53.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:53.994 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.583429722999998, 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:53.995 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:53.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:13:53.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:13:53.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.000 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.583259486999999, 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:13:54.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:13:54.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.583142727999999, 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:13:54.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:13:54.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.583073592000002, 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.014 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:13:54.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:13:54.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:13:54.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:13:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.582961839999999, 2024-09-12T18:13:54.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:54.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:13:54.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:13:54.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.582798017999998, 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:13:54.029 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:13:54.033 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.582737252000001, 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:13:54.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.582612955999998, 2024-09-12T18:13:54.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014554022, 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406033+0000", 2024-09-12T18:13:54.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406034+0000", 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3400000000000001e-06 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406054+0000", 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0046000000000001e-05 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406078+0000", 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3314000000000001e-05 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406093+0000", 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4983e-05 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409043+0000", 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029506549999999999 2024-09-12T18:13:54.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409285+0000", 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024186100000000001 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.420587+0000", 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011301823000000001 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.747774089, 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:54.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:13:54.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15911 5.2 e25/21 5:49718f9f:::benchmark_data_smithi062_23645_object15910:head v 25'1014, mlcod=25'1012)", 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7440378679999995, 2024-09-12T18:13:54.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014500318999999999, 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244608+0000", 2024-09-12T18:13:54.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244609+0000", 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244676+0000", 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7323999999999994e-05 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244686+0000", 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7159999999999998e-06 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244691+0000", 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0270000000000003e-06 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244741+0000", 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0235000000000003e-05 2024-09-12T18:13:54.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244774+0000", 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.269e-05 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259059+0000", 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014285525 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259108+0000", 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9011999999999998e-05 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.052 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15913 5.a 5:5c7723a1:::benchmark_data_smithi062_23645_object15912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7438606009999997, 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015699285, 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15913 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244786+0000", 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244888+0000", 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244894+0000", 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244899+0000", 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244972+0000", 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3316000000000001e-05 2024-09-12T18:13:54.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245084+0000", 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111703 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245200+0000", 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115406 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259521+0000", 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014321122 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260404+0000", 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088351800000000002 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260457+0000", 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3001000000000003e-05 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260485+0000", 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7424e-05 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.060 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15922 5.3 5:c9e976be:::benchmark_data_smithi062_23645_object15921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7430816690000004, 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015052953000000001, 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.061 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.062 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.062 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.062 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.062 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.062 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15922 2024-09-12T18:13:54.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:13:54.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245565+0000", 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2109999999999999e-06 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245594+0000", 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245601+0000", 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3670000000000002e-06 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245606+0000", 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.023e-06 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245652+0000", 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6811999999999998e-05 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245758+0000", 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105834 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245862+0000", 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010354200000000001 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259068+0000", 2024-09-12T18:13:54.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013205783 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260567+0000", 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014991570000000001 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260594+0000", 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7362e-05 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260617+0000", 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3105e-05 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15917 5.b e25/21 5:d520353b:::benchmark_data_smithi062_23645_object15916:head v 25'983, mlcod=25'981)", 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7430543089999997, 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015050452000000001, 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.068 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245704+0000", 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111766 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245735+0000", 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0534000000000003e-05 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245742+0000", 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6499999999999996e-06 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257961+0000", 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012218250999999999 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257987+0000", 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6352000000000001e-05 2024-09-12T18:13:54.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260621+0000", 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026337119999999999 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260642+0000", 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1467e-05 2024-09-12T18:13:54.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7420103489999992, 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.073 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:13:54.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:13:54.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.077 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.3595288019999998, 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.078 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:13:54.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:13:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.084 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16962 5.a 5:5bca3d75:::benchmark_data_smithi062_23645_object16961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.357538044, 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015114977, 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.085 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16962 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:54.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631109+0000", 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0240000000000001e-06 2024-09-12T18:13:54.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631271+0000", 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016195700000000001 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631282+0000", 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0746e-05 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631287+0000", 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631335+0000", 2024-09-12T18:13:54.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8134999999999999e-05 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631473+0000", 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013780300000000001 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631621+0000", 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148238 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633224+0000", 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001602942 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646094+0000", 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012870651 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646181+0000", 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780999999999995e-05 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646223+0000", 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1638999999999999e-05 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16965 5.5 5:a0639920:::benchmark_data_smithi062_23645_object16964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.3551814790000005, 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015569835000000001, 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.094 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16965 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:54.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:13:54.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633466+0000", 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-06 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633536+0000", 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0366999999999999e-05 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633546+0000", 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059e-05 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633552+0000", 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0129999999999999e-06 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646012+0000", 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012459822000000001 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646152+0000", 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013997200000000001 2024-09-12T18:13:54.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646248+0000", 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6335999999999994e-05 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648453+0000", 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022045770000000001 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648912+0000", 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045902200000000001 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648997+0000", 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970999999999997e-05 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649034+0000", 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7585e-05 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16969 5.5 5:a17db384:::benchmark_data_smithi062_23645_object16968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.3544680499999995, 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015671503999999999, 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16969 2024-09-12T18:13:54.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634179+0000", 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-06 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634280+0000", 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010138500000000001 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634291+0000", 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:13:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634309+0000", 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.836e-05 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647082+0000", 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012772149999999999 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647205+0000", 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012367500000000001 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647364+0000", 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015912200000000001 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649290+0000", 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019254960000000001 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649781+0000", 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049094099999999995 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649812+0000", 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1007000000000003e-05 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649849+0000", 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7602999999999999e-05 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:19567 5.6 5:62441267:::benchmark_data_smithi062_23645_object19566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.4377094899999996, 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015428716, 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:54.108 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 19567 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550937+0000", 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551054+0000", 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116697 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551064+0000", 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7759999999999992e-06 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551071+0000", 2024-09-12T18:13:54.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551622+0000", 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055093700000000004 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551694+0000", 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1783e-05 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551770+0000", 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5945000000000006e-05 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.555763+0000", 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039931230000000003 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566239+0000", 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010475475999999999 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566317+0000", 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7885000000000004e-05 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:13:54.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566365+0000", 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8634000000000002e-05 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:54.115 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:54.116 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:54.113+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:54.117 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:54.218 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:54.218+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:39776 5.7 5:e5529643:::benchmark_data_smithi062_23645_object39775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.272963+0000", 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0040761690000000001, 2024-09-12T18:13:54.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0041073560000000004, 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 39776 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.272963+0000", 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.272963+0000", 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.272963+0000", 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8100000000000001e-07 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.273044+0000", 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0501999999999996e-05 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.273058+0000", 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4260999999999999e-05 2024-09-12T18:13:54.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.273067+0000", 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0250000000000008e-06 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.273234+0000", 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000167011 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.273378+0000", 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143425 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.273531+0000", 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015364299999999999 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.281 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:39779 5.7 5:e096ec8f:::benchmark_data_smithi062_23645_object39778:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.274573+0000", 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0024661050000000001, 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025548290000000002, 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.282 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 39779 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274573+0000", 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274573+0000", 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274574+0000", 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4900000000000004e-07 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274651+0000", 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7315000000000001e-05 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274663+0000", 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2292e-05 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274671+0000", 2024-09-12T18:13:54.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5190000000000003e-06 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.274967+0000", 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000295846 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275098+0000", 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013165799999999999 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275286+0000", 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018819299999999999 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.287 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:39782 5.1 5:8a2e73e2:::benchmark_data_smithi062_23645_object39781:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.275557+0000", 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001481783, 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016254279999999999, 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.288 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 39782 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275557+0000", 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275557+0000", 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275558+0000", 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1310000000000001e-06 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275644+0000", 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5462000000000003e-05 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275666+0000", 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2039e-05 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275673+0000", 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.525e-06 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275736+0000", 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2434000000000006e-05 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275814+0000", 2024-09-12T18:13:54.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8276999999999996e-05 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275909+0000", 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5165000000000001e-05 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.293 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:39783 5.7 5:ec15ce97:::benchmark_data_smithi062_23645_object39782:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.275709+0000", 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0013300090000000001, 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0015133970000000001, 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 39783 2024-09-12T18:13:54.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275709+0000", 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275709+0000", 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275709+0000", 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8100000000000003e-07 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275781+0000", 2024-09-12T18:13:54.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1308000000000002e-05 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275789+0000", 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4090000000000003e-06 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275795+0000", 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.536e-06 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276751+0000", 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00095626700000000001 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276927+0000", 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017636999999999999 2024-09-12T18:13:54.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.277082+0000", 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015467500000000001 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.300 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:39784 5.f 5.b0cd8e8f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:54.300 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.275818+0000", 2024-09-12T18:13:54.300 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0012204379999999999, 2024-09-12T18:13:54.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001435918, 2024-09-12T18:13:54.300 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.300 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 39784 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275818+0000", 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275818+0000", 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275819+0000", 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1600000000000001e-07 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275857+0000", 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8064e-05 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275865+0000", 2024-09-12T18:13:54.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7970000000000001e-06 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275870+0000", 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3550000000000004e-06 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.304 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:39787 5.f 5.e042ad8f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.275879+0000", 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001160077, 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00140011, 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.305 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:54.306 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:54.306 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 39787 2024-09-12T18:13:54.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.306 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275879+0000", 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275879+0000", 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275879+0000", 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1699999999999998e-07 2024-09-12T18:13:54.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275904+0000", 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4593e-05 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275912+0000", 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1869999999999997e-06 2024-09-12T18:13:54.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.275917+0000", 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7079999999999996e-06 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.309 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:39786 5.d e30/21 5:b0edd5c3:::benchmark_data_smithi062_23645_object39785:head v 30'2480, mlcod=30'2478)", 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.276100+0000", 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00093842600000000002, 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001204157, 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276100+0000", 2024-09-12T18:13:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276100+0000", 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276101+0000", 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8700000000000005e-07 2024-09-12T18:13:54.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276157+0000", 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6075000000000001e-05 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276169+0000", 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1955e-05 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276176+0000", 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6529999999999997e-06 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276231+0000", 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4867999999999997e-05 2024-09-12T18:13:54.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276251+0000", 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9905999999999999e-05 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:39785 5.6 e30/21 5:6a6ead1c:::benchmark_data_smithi062_23645_object39784:head v 30'2510, mlcod=30'2508)", 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.276315+0000", 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00072377300000000004, 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001018134, 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276315+0000", 2024-09-12T18:13:54.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276315+0000", 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276316+0000", 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4799999999999997e-07 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276364+0000", 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8208999999999999e-05 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276377+0000", 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2704000000000001e-05 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276384+0000", 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0809999999999996e-06 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276460+0000", 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6077999999999999e-05 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276490+0000", 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0154999999999998e-05 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.318 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:39788 5.c e30/21 5:3532a26d:::benchmark_data_smithi062_23645_object39787:head v 30'2428, mlcod=30'2426)", 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:54.276833+0000", 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00020556700000000001, 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00053739200000000003, 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276833+0000", 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276833+0000", 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276834+0000", 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0200000000000001e-07 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276923+0000", 2024-09-12T18:13:54.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8854e-05 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276935+0000", 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2683999999999999e-05 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.276942+0000", 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4370000000000004e-06 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.277003+0000", 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1023000000000002e-05 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:54.277020+0000", 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6671999999999999e-05 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.322 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:13:54.323 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 9 2024-09-12T18:13:54.323 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:54.324 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:54.324 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:54.321+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:54.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 14 16 40091 40075 178.888 150.438 0.00844695 0.00558478 2024-09-12T18:13:54.425 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:54.426+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:54.526 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:54.526 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:13:54.526 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:13:54.526 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:13:54.526 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:54.526 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:54.521+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:54.548 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:54.638 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:54.637+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:54.728 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:54.730+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:54.761 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 42.466856960000001, 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.762 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:13:54.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.662563833999997, 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.769 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:13:54.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:13:54.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.662528657999999, 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.775 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:13:54.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:13:54.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:13:54.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.366932984999998, 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.782 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:13:54.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:13:54.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.36683931, 2024-09-12T18:13:54.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:13:54.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:13:54.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.366770079999998, 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:13:54.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:13:54.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.366679313999999, 2024-09-12T18:13:54.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:13:54.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:13:54.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:13:54.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.807 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.366618291000002, 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:13:54.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.366559532, 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.813 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:13:54.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:13:54.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.366496481999999, 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.819 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:13:54.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:13:54.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.365696108000002, 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.825 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:13:54.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:13:54.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:13:54.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.365557905999999, 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.831 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:13:54.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:13:54.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.365494655999999, 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:13:54.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:13:54.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:13:54.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:13:54.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:13:54.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:13:54.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:13:54.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.365396084, 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.845 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:13:54.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:13:54.850 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.365094688999999, 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:13:54.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:13:54.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.364996587, 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:13:54.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:13:54.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.364904195000001, 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:13:54.863 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:13:54.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.869 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.364817297999998, 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:13:54.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:13:54.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.364693676000002, 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:54.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:13:54.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:13:54.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.881 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.364302076000001, 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:13:54.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.885 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.886 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.886 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:54.886 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:54.886 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:54.887 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:54.884+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:54.888 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:54.989 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:54.985+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:55.043 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:55.043 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:55.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.043 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:41719 5.d 5:b9abea71:::benchmark_data_smithi062_23645_object41718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.040667+0000", 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0039187839999999998, 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0039407390000000004, 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 41719 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040667+0000", 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040667+0000", 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040667+0000", 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2399999999999998e-07 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040709+0000", 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1953000000000003e-05 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040717+0000", 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0830000000000004e-06 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040723+0000", 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1009999999999997e-06 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040868+0000", 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144795 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041027+0000", 2024-09-12T18:13:55.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015851799999999999 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041179+0000", 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152855 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:41720 5.e 5:72523136:::benchmark_data_smithi062_23645_object41719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.048 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.040737+0000", 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.003848317, 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003948226, 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 41720 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040737+0000", 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040737+0000", 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040738+0000", 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9299999999999997e-07 2024-09-12T18:13:55.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040899+0000", 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016104800000000001 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040908+0000", 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8540000000000003e-06 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040916+0000", 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9330000000000001e-06 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040985+0000", 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9448000000000003e-05 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041117+0000", 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000131963 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041266+0000", 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000149192 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044035+0000", 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027686469999999999 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:41723 5.8 5:1a7b7d2c:::benchmark_data_smithi062_23645_object41722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.040974+0000", 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.003611464, 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003759751, 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 41723 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.054 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040974+0000", 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040974+0000", 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.040975+0000", 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.47e-07 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041027+0000", 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2534000000000002e-05 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041036+0000", 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6070000000000008e-06 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041046+0000", 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9150000000000008e-06 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041097+0000", 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0936000000000002e-05 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041216+0000", 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119769 2024-09-12T18:13:55.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041303+0000", 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6533000000000007e-05 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044147+0000", 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028438159999999999 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:41724 5.9 e30/21 5:9d8e07ef:::benchmark_data_smithi062_23645_object41723:head v 30'2546, mlcod=30'2543)", 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.041461+0000", 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0031242370000000002, 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033494839999999998, 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041461+0000", 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041461+0000", 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041462+0000", 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041510+0000", 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8313999999999999e-05 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041519+0000", 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9420000000000001e-06 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041525+0000", 2024-09-12T18:13:55.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2269999999999998e-06 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041580+0000", 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4818000000000003e-05 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.041598+0000", 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8437e-05 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.062 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:41722 5.f e30/21 5:fac7b264:::benchmark_data_smithi062_23645_object41721:head v 30'2661, mlcod=30'2659)", 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.042555+0000", 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0020303690000000002, 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002307084, 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042555+0000", 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042555+0000", 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042555+0000", 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4700000000000002e-07 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042591+0000", 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5636000000000002e-05 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042611+0000", 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9616e-05 2024-09-12T18:13:55.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042617+0000", 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4200000000000004e-06 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042684+0000", 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7080000000000001e-05 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042710+0000", 2024-09-12T18:13:55.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5576e-05 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:41725 5.a e30/21 5:5803225c:::benchmark_data_smithi062_23645_object41724:head v 30'2518, mlcod=30'2515)", 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.042877+0000", 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0017080369999999999, 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020118839999999998, 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.067 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042877+0000", 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042877+0000", 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042878+0000", 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9800000000000003e-07 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042925+0000", 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6526000000000001e-05 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042934+0000", 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5829999999999996e-06 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042940+0000", 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.042985+0000", 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4509999999999999e-05 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043004+0000", 2024-09-12T18:13:55.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9479000000000001e-05 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:41729 5.d 5:b181bbf1:::benchmark_data_smithi062_23645_object41728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.043147+0000", 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0014380490000000001, 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017717150000000001, 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.071 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 41729 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043147+0000", 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043147+0000", 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043148+0000", 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043207+0000", 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8146999999999997e-05 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043231+0000", 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4848e-05 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043237+0000", 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1839999999999998e-06 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043298+0000", 2024-09-12T18:13:55.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1147000000000003e-05 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043426+0000", 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000128412 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043560+0000", 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013412499999999999 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.075 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:41727 5.f e30/21 5:f76138e8:::benchmark_data_smithi062_23645_object41726:head v 30'2662, mlcod=30'2659)", 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.043274+0000", 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0013110929999999999, 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016909850000000001, 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043274+0000", 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043274+0000", 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043275+0000", 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0999999999999999e-07 2024-09-12T18:13:55.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043303+0000", 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7985000000000001e-05 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043308+0000", 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2950000000000001e-06 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043312+0000", 2024-09-12T18:13:55.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9049999999999999e-06 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044411+0000", 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001099193 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044436+0000", 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4783999999999999e-05 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.079 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:41730 5.9 e30/21 5:99c5a99d:::benchmark_data_smithi062_23645_object41729:head v 30'2547, mlcod=30'2544)", 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.043824+0000", 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00076122500000000003, 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0011674599999999999, 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043824+0000", 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043824+0000", 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043825+0000", 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8599999999999998e-07 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043854+0000", 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9059000000000001e-05 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043874+0000", 2024-09-12T18:13:55.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0293999999999999e-05 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043881+0000", 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.443e-06 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043935+0000", 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3918000000000001e-05 2024-09-12T18:13:55.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.043951+0000", 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6943999999999999e-05 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.084 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:41732 5.a e30/21 5:533366b8:::benchmark_data_smithi062_23645_object41731:head v 30'2519, mlcod=30'2515)", 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.044763+0000", 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9998221, 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000254913, 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044763+0000", 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044763+0000", 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044764+0000", 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.44e-07 2024-09-12T18:13:55.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044795+0000", 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1149999999999998e-05 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044804+0000", 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2480000000000002e-06 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044812+0000", 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1779999999999997e-06 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044854+0000", 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2851e-05 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044872+0000", 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8034999999999999e-05 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:41717 5.d 5:b4d7e1a2:::benchmark_data_smithi062_23645_object41716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:55.038757+0000", 2024-09-12T18:13:55.089 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0058279079999999997, 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062900430000000004, 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 41717 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.090 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038757+0000", 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038757+0000", 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038758+0000", 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8700000000000005e-07 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038854+0000", 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5290000000000004e-05 2024-09-12T18:13:55.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038860+0000", 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5069999999999997e-06 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038864+0000", 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1479999999999999e-06 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.038916+0000", 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.039037+0000", 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120418 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.039157+0000", 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012008200000000001 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:55.044751+0000", 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055943269999999996 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.095 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.096 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:13:55.096 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 11 2024-09-12T18:13:55.096 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:55.097 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:55.098 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:55.098+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:55.198 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:55.197+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:55.296 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:55.296 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:13:55.296 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:13:55.296 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:13:55.296 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:55.298 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:55.298+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:55.316 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:55.399 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:55.397+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:55.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 15 16 42608 42592 177.448 157.312 0.00496745 0.00562997 2024-09-12T18:13:55.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:13:55.501 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:55.502+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133693268000002, 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.525 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:13:55.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:13:55.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133577905999999, 2024-09-12T18:13:55.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:55.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:13:55.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.538 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133496940000001, 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:13:55.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:55.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:13:55.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133392428000001, 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:55.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:13:55.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:13:55.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:13:55.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:13:55.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:13:55.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133308485000001, 2024-09-12T18:13:55.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:55.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:13:55.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:13:55.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133185539000003, 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.560 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:13:55.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.566 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133114030000002, 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:13:55.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:13:55.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.133049130000003, 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.573 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:13:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:13:55.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.132979663999997, 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.578 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:13:55.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.118561503000002, 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.583 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:13:55.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.587 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15908 5.0 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 10.284783453999999, 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018670684, 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.588 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15908 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239941+0000", 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6400000000000001e-07 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239986+0000", 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5466999999999997e-05 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239996+0000", 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6209999999999999e-06 2024-09-12T18:13:55.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240002+0000", 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.229e-06 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240369+0000", 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036721600000000002 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240554+0000", 2024-09-12T18:13:55.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018448100000000001 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240680+0000", 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012593700000000001 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.242166+0000", 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014860170000000001 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258545+0000", 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01637885 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258579+0000", 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.468e-05 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258611+0000", 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1322000000000003e-05 2024-09-12T18:13:55.593 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15917 5.b 5:d520353b:::benchmark_data_smithi062_23645_object15916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 10.27912751, 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015705908000000001, 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.594 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15917 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:55.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245597+0000", 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245642+0000", 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5484e-05 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245647+0000", 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2399999999999998e-06 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245651+0000", 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3469999999999999e-06 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245695+0000", 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4249999999999998e-05 2024-09-12T18:13:55.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245806+0000", 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110752 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245920+0000", 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114156 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255011+0000", 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090915860000000005 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261216+0000", 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062048700000000004 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261251+0000", 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4854999999999997e-05 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261302+0000", 2024-09-12T18:13:55.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0766999999999997e-05 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:55.603 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 10.279060555999999, 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:13:55.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:13:55.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15923 5.4 5:217c37e3:::benchmark_data_smithi062_23645_object15922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 10.277772589, 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017388715999999999, 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.610 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15923 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:55.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246952+0000", 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.95e-07 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247021+0000", 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9080999999999998e-05 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247032+0000", 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0577999999999999e-05 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247039+0000", 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3699999999999997e-06 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253374+0000", 2024-09-12T18:13:55.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063354919999999999 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253534+0000", 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159421 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253632+0000", 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8021000000000002e-05 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255738+0000", 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021061550000000002 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264249+0000", 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085105400000000005 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264301+0000", 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1996999999999997e-05 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264340+0000", 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9066000000000002e-05 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16961 5.b 5:d94b6522:::benchmark_data_smithi062_23645_object16960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:55.616 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.8931869070000005, 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016331854, 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16961 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631676+0000", 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013913799999999999 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631689+0000", 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2483000000000001e-05 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631694+0000", 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1610000000000002e-06 2024-09-12T18:13:55.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631778+0000", 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4529000000000003e-05 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631935+0000", 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156279 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632093+0000", 2024-09-12T18:13:55.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000157792 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634146+0000", 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002053301 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647775+0000", 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013628695 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647829+0000", 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4945999999999999e-05 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647868+0000", 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8914e-05 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.622 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16963 5.4 5:2fa071ac:::benchmark_data_smithi062_23645_object16962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.8930182739999992, 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016816028, 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16963 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631706+0000", 2024-09-12T18:13:55.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631736+0000", 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0224000000000001e-05 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631741+0000", 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5910000000000003e-06 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631745+0000", 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631788+0000", 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2823e-05 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631918+0000", 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000129586 2024-09-12T18:13:55.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632010+0000", 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2215999999999999e-05 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.633704+0000", 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001693784 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648445+0000", 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014741316000000001 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648480+0000", 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4620999999999999e-05 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648521+0000", 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1631999999999997e-05 2024-09-12T18:13:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16971 5.4 5:271b2960:::benchmark_data_smithi062_23645_object16970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.8903274040000007, 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015406705, 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.629 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16971 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634397+0000", 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0189999999999999e-06 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634500+0000", 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103398 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634511+0000", 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0733e-05 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634519+0000", 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4850000000000003e-06 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634589+0000", 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0180999999999998e-05 2024-09-12T18:13:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634736+0000", 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000147443 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634879+0000", 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000142943 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637632+0000", 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002753237 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649640+0000", 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012007261999999999 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649742+0000", 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102231 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649803+0000", 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0773000000000002e-05 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16972 5.0 5:0a18df3f:::benchmark_data_smithi062_23645_object16971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.8901784329999991, 2024-09-12T18:13:55.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015621523999999999, 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16972 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:55.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634546+0000", 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634588+0000", 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2580999999999998e-05 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634597+0000", 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6959999999999994e-06 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634603+0000", 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7690000000000002e-06 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634654+0000", 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1607000000000002e-05 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634826+0000", 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017138099999999999 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635023+0000", 2024-09-12T18:13:55.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019718000000000001 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637067+0000", 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002043703 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650031+0000", 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012964260999999999 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650113+0000", 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2522999999999996e-05 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650167+0000", 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3151e-05 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.641 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16973 5.e 5:7478c9cc:::benchmark_data_smithi062_23645_object16972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.8901074520000005, 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015645486, 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16973 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634617+0000", 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:13:55.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634659+0000", 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2555000000000002e-05 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634667+0000", 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634673+0000", 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3640000000000004e-06 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634739+0000", 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6229000000000006e-05 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634900+0000", 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016037000000000001 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635079+0000", 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017936699999999999 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637311+0000", 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0022314629999999999 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650191+0000", 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012880302 2024-09-12T18:13:55.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650232+0000", 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0595e-05 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650261+0000", 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9957000000000001e-05 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:38784 5.b 5:d629bc1c:::benchmark_data_smithi062_23645_object38783:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.670332945, 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015913716000000001, 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 38784 2024-09-12T18:13:55.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854546+0000", 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015517999999999999 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854556+0000", 2024-09-12T18:13:55.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6709999999999994e-06 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854564+0000", 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4359999999999996e-06 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861215+0000", 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066519179999999997 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861337+0000", 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000121332 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861493+0000", 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156565 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.864866+0000", 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033727150000000001 2024-09-12T18:13:55.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870220+0000", 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053535709999999997 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870259+0000", 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9341000000000002e-05 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:55.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870304+0000", 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5226999999999999e-05 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:55.654 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:55.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:55.656 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:55.654+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:55.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:13:55.756 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:55.756+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:43630 5.b e30/21 5:dccbefea:::benchmark_data_smithi062_23645_object43629:head v 30'2699, mlcod=30'2696)", 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.815214+0000", 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0046721979999999998, 2024-09-12T18:13:55.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046869219999999996, 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815214+0000", 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815214+0000", 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815215+0000", 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815244+0000", 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9345000000000001e-05 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815252+0000", 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7079999999999997e-06 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815259+0000", 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.109e-06 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815308+0000", 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8662000000000003e-05 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815324+0000", 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6036999999999999e-05 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43635 5.a 5:57754dc4:::benchmark_data_smithi062_23645_object43634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.815858+0000", 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0040282629999999998, 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040873070000000001, 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.824 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43635 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815858+0000", 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815858+0000", 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815859+0000", 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.105e-06 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815917+0000", 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7311000000000001e-05 2024-09-12T18:13:55.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815932+0000", 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5211000000000001e-05 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815939+0000", 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0330000000000003e-06 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815998+0000", 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9188000000000003e-05 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816128+0000", 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130393 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816257+0000", 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012896399999999999 2024-09-12T18:13:55.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818756+0000", 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024981500000000002 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819929+0000", 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011735809999999999 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.829 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43636 5.6 5:6979f2be:::benchmark_data_smithi062_23645_object43635:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.815958+0000", 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0039281510000000004, 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004042258, 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.830 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43636 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815958+0000", 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815958+0000", 2024-09-12T18:13:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815959+0000", 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3900000000000004e-07 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.815995+0000", 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6195999999999997e-05 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816003+0000", 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0960000000000001e-06 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816009+0000", 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4970000000000001e-06 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816070+0000", 2024-09-12T18:13:55.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1191000000000004e-05 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816204+0000", 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133633 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816338+0000", 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134072 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819610+0000", 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032724120000000002 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43637 5.3 5:c633ec9b:::benchmark_data_smithi062_23645_object43636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.816124+0000", 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0037622950000000001, 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039580889999999997, 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.835 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43637 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816124+0000", 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816124+0000", 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816125+0000", 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8899999999999998e-07 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816179+0000", 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4338000000000001e-05 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816186+0000", 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9349999999999997e-06 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816191+0000", 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5199999999999999e-06 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816227+0000", 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6473999999999997e-05 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816308+0000", 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1255999999999996e-05 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816424+0000", 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115165 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43639 5.c 5:32c715e5:::benchmark_data_smithi062_23645_object43638:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.816364+0000", 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035221720000000001, 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037751719999999998, 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43639 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816364+0000", 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816364+0000", 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816373+0000", 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3780000000000001e-06 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816464+0000", 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1685000000000001e-05 2024-09-12T18:13:55.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816474+0000", 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3819999999999993e-06 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816481+0000", 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4030000000000001e-06 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816630+0000", 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014933599999999999 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816742+0000", 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111437 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816853+0000", 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011111399999999999 2024-09-12T18:13:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820111+0000", 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032574969999999998 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43641 5.3 5:c5be3b0a:::benchmark_data_smithi062_23645_object43640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.816499+0000", 2024-09-12T18:13:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0033872889999999999, 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036807580000000001, 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43641 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816499+0000", 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816499+0000", 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816500+0000", 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9699999999999995e-07 2024-09-12T18:13:55.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816538+0000", 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8588999999999999e-05 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816546+0000", 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6210000000000004e-06 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816552+0000", 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5439999999999998e-06 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818096+0000", 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001543951 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818223+0000", 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012693000000000001 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818345+0000", 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012200400000000001 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43642 5.c 5:385d1b12:::benchmark_data_smithi062_23645_object43641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.816756+0000", 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003130463, 2024-09-12T18:13:55.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034769969999999999, 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43642 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816756+0000", 2024-09-12T18:13:55.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816756+0000", 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816757+0000", 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.085e-06 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816787+0000", 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9805e-05 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816797+0000", 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0213e-05 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.816805+0000", 2024-09-12T18:13:55.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5299999999999999e-06 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818489+0000", 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001684606 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818599+0000", 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010992099999999999 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818719+0000", 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119327 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:43638 5.b e30/21 5:d049585b:::benchmark_data_smithi062_23645_object43637:head v 30'2700, mlcod=30'2697)", 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.817813+0000", 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002073039, 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024636800000000002, 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.855 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.817813+0000", 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.817813+0000", 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.817814+0000", 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4099999999999998e-07 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.817844+0000", 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0190000000000001e-05 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.817854+0000", 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7880000000000001e-06 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.817862+0000", 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6830000000000008e-06 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818139+0000", 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027707300000000002 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.818156+0000", 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7271000000000001e-05 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:43640 5.b e30/21 5:da37343c:::benchmark_data_smithi062_23645_object43639:head v 30'2701, mlcod=30'2697)", 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.819558+0000", 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000328499, 2024-09-12T18:13:55.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00074584900000000003, 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819558+0000", 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819558+0000", 2024-09-12T18:13:55.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819559+0000", 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819587+0000", 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7891000000000001e-05 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819601+0000", 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4734e-05 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819609+0000", 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6820000000000003e-06 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819725+0000", 2024-09-12T18:13:55.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011574399999999999 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.819742+0000", 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7102e-05 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43647 5.a 5:5e30816e:::benchmark_data_smithi062_23645_object43646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.863 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.820038+0000", 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998488, 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000296989, 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43647 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820038+0000", 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820038+0000", 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820039+0000", 2024-09-12T18:13:55.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5319999999999999e-06 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820134+0000", 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420999999999996e-05 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820151+0000", 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7569999999999999e-05 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820159+0000", 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1720000000000007e-06 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820216+0000", 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7071000000000003e-05 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:43648 5.c 5:3d6f188d:::benchmark_data_smithi062_23645_object43647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:55.867 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.820177+0000", 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997091, 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018875599999999999, 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43648 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:55.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820177+0000", 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820177+0000", 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820178+0000", 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:13:55.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820207+0000", 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8819999999999999e-05 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820214+0000", 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2350000000000002e-06 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:55.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820219+0000", 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3959999999999997e-06 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.820267+0000", 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.757e-05 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 11 2024-09-12T18:13:55.871 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:55.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:55.873 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:55.872+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:55.878 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:13:55.878 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:13:55.878 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:13:55.878 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:13:55.878 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:13:55.878 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:13:55.900 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:55.901 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:55.919 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:55.920 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:55.939 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:55.939 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:55.974 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:55.974+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:56.033 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:56.033 INFO:teuthology.orchestra.run.smithi176.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:13:56.033 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:56.071 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:56.072 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:56.075 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:56.072+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:56.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:56.175 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:56.174+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:56.276 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:56.276+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:56.287 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:56.287 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:56.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:56.377 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:56.373+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:56.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 16 16 45007 44991 175.728 149.938 0.00673928 0.0056859 2024-09-12T18:13:56.463 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:56.463 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:56.478 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:56.476+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:56.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:56.579 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:56.576+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:56.678 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:56.678 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:56.679 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:56.677+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:56.700 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:56.774 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:13:56.780 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:56.782+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:56.881 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:56.882+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:56.894 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:56.894 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:56.916 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:56.982 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:56.981+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:57.071 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:57.071 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:57.084 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:57.084+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:57.094 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:57.185 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:57.186+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:57.243 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:57.243 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:57.265 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:57.286 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:57.285+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:57.387 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:57.385+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:57.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 17 16 47374 47358 174.092 147.938 0.00803063 0.00573889 2024-09-12T18:13:57.460 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:57.460 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:57.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:57.488 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:57.490+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:57.589 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:57.585+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:57.644 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:57.644 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:57.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:57.690 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:57.689+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:57.791 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:57.790+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:57.820 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:57.820 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:57.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:57.892 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:57.890+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:57.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:13:57.993 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:13:57.993 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:13:57.995 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:57.992+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:58.013 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:13:58.094 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:58.093+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:58.127 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:13:58.127 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:13:58.147 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:13:58.147 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:13:58.167 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:13:58.168 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:49141 5.f 5:fafc18bf:::benchmark_data_smithi062_23645_object49140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:58.170107+0000", 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001256655, 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0012841720000000001, 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 49141 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170107+0000", 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170107+0000", 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170108+0000", 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8899999999999998e-07 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170185+0000", 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6860999999999995e-05 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170197+0000", 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2208000000000001e-05 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170206+0000", 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6249999999999996e-06 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170265+0000", 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9253999999999999e-05 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170383+0000", 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000118403 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170517+0000", 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013324699999999999 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:49140 5.3 e31/21 5:c51d7ec9:::benchmark_data_smithi062_23645_object49139:head v 31'3080, mlcod=31'3078)", 2024-09-12T18:13:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:58.170045+0000", 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0013191100000000001, 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0014228229999999999, 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170045+0000", 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170045+0000", 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170045+0000", 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:13:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170264+0000", 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021907299999999999 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170273+0000", 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3170000000000002e-06 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170279+0000", 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8229999999999997e-06 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170333+0000", 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3316999999999998e-05 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170350+0000", 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6784000000000001e-05 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:49142 5.7 5:e168ec60:::benchmark_data_smithi062_23645_object49141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:58.170989+0000", 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00037445799999999998, 2024-09-12T18:13:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00053313999999999998, 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 49142 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170989+0000", 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170989+0000", 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.170990+0000", 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.22e-06 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171066+0000", 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5190000000000003e-05 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171079+0000", 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3580999999999999e-05 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171209+0000", 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012934700000000001 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171362+0000", 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015381999999999999 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171500+0000", 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013745200000000001 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:49143 5.7 5.709c0257 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:58.171456+0000", 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.999908, 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9845000000000004e-05, 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:13:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 49143 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171456+0000", 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171456+0000", 2024-09-12T18:13:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171457+0000", 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0449999999999999e-06 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171486+0000", 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9434999999999999e-05 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171496+0000", 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5999999999999996e-06 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:58.171503+0000", 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3560000000000004e-06 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:13:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 4 2024-09-12T18:13:58.189 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:58.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:13:58.195 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:58.193+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:58.296 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:58.293+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:58.385 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:58.386 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:13:58.386 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:13:58.386 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:13:58.386 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:58.396 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:58.393+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:58.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 18 16 49678 49662 172.419 144 0.00474975 0.00579442 2024-09-12T18:13:58.408 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:13:58.497 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:58.496+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:58.598 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:58.597+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:58.600 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 46.306251572999997, 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.601 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:13:58.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.606 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.607 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.607 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:13:58.607 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:13:58.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.608 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.608 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.608 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:13:58.608 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:58.610 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 45.501958447, 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 45.501923271000003, 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:13:58.617 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:13:58.623 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.206327598000001, 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.624 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:13:58.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:13:58.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.206233922999999, 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.630 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:58.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:13:58.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.206164692999998, 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:13:58.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:13:58.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:13:58.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.206073926999998, 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.642 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:13:58.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.647 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.206012903999998, 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:13:58.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:13:58.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.205954145, 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:58.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:13:58.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.205891094999998, 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:13:58.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:13:58.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.665 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.205090720999998, 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:13:58.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:13:58.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:13:58.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204952519000003, 2024-09-12T18:13:58.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:13:58.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:13:58.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:13:58.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:58.679 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204889268999999, 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:13:58.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:13:58.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.685 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204790697, 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:13:58.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:13:58.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204489301999999, 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:13:58.691 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:13:58.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:13:58.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204391200000003, 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.697 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:13:58.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204298807999997, 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.703 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:13:58.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:13:58.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:13:58.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:13:58.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.710 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204211911000002, 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:13:58.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:13:58.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.204088288999998, 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:13:58.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.722 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.203696688999997, 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:13:58.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:13:58.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:13:58.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:13:58.727 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:13:58.728 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:58.728+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:58.729 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:13:58.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:13:58.830 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:58.825+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:58.885 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:58.885 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:58.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.885 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:50758 5.b 5:d1eda7de:::benchmark_data_smithi062_23645_object50757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.885 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.883506+0000", 2024-09-12T18:13:58.885 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0030213449999999999, 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003048542, 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 50758 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883506+0000", 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883506+0000", 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883507+0000", 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4700000000000001e-07 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883631+0000", 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012382300000000001 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883643+0000", 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1956e-05 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883649+0000", 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8190000000000003e-06 2024-09-12T18:13:58.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883706+0000", 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6385000000000003e-05 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883850+0000", 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014401 2024-09-12T18:13:58.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883987+0000", 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013744399999999999 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:50759 5.8 5:12448fb9:::benchmark_data_smithi062_23645_object50758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.883664+0000", 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0028637860000000001, 2024-09-12T18:13:58.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029344589999999999, 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 50759 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883664+0000", 2024-09-12T18:13:58.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883664+0000", 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883664+0000", 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0399999999999995e-07 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883693+0000", 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8704000000000002e-05 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883701+0000", 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9230000000000002e-06 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883707+0000", 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7540000000000003e-06 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885957+0000", 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0022499339999999999 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.886110+0000", 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152812 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.886241+0000", 2024-09-12T18:13:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013131899999999999 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:50761 5.a e31/21 5:57f21afc:::benchmark_data_smithi062_23645_object50760:head v 31'3116, mlcod=31'3112)", 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.883943+0000", 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0025845360000000001, 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026890960000000002, 2024-09-12T18:13:58.895 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883943+0000", 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883943+0000", 2024-09-12T18:13:58.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883944+0000", 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8400000000000004e-07 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883986+0000", 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2858000000000002e-05 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883999+0000", 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2907e-05 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884004+0000", 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4750000000000004e-06 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884052+0000", 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8341999999999999e-05 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884069+0000", 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7164999999999999e-05 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:50763 5.0 5:0fb95745:::benchmark_data_smithi062_23645_object50762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.884755+0000", 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0017722980000000001, 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001905569, 2024-09-12T18:13:58.899 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 50763 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884755+0000", 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884755+0000", 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884756+0000", 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4600000000000003e-07 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884841+0000", 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5081999999999996e-05 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884850+0000", 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2749999999999995e-06 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.884854+0000", 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2529999999999998e-06 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885941+0000", 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0010869810000000001 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.886117+0000", 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000175897 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.886255+0000", 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013830900000000001 2024-09-12T18:13:58.903 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:50764 5.f e31/21 5:f8726af5:::benchmark_data_smithi062_23645_object50763:head v 31'3211, mlcod=31'3209)", 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.885454+0000", 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.001073182, 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001239939, 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885454+0000", 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885454+0000", 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885455+0000", 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:13:58.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885510+0000", 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4944000000000001e-05 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885526+0000", 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6503000000000001e-05 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885532+0000", 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1989999999999997e-06 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885583+0000", 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1075000000000001e-05 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885595+0000", 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2136999999999999e-05 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.907 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(client.4581.0:50754 5.0 e31/21)", 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.885931+0000", 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.000596932, 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00078775799999999995, 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885931+0000", 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885931+0000", 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885931+0000", 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3200000000000004e-07 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885936+0000", 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5090000000000004e-06 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885945+0000", 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2019999999999993e-06 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.885953+0000", 2024-09-12T18:13:58.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6359999999999994e-06 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:50754 5.0 5:0832c10d:::benchmark_data_smithi062_23645_object50753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.879822+0000", 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0067055639999999998, 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069210010000000004, 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:58.911 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 50754 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879822+0000", 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879822+0000", 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879823+0000", 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3e-07 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879912+0000", 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9565000000000001e-05 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879920+0000", 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879924+0000", 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2259999999999999e-06 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.879965+0000", 2024-09-12T18:13:58.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0284000000000003e-05 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.880093+0000", 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012816600000000001 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.880187+0000", 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4503e-05 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:50757 5.8 5:14992396:::benchmark_data_smithi062_23645_object50756:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.883330+0000", 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0031971090000000001, 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034488420000000001, 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 50757 2024-09-12T18:13:58.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883330+0000", 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883330+0000", 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883331+0000", 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1699999999999997e-07 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883468+0000", 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013655300000000001 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883479+0000", 2024-09-12T18:13:58.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0898e-05 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883486+0000", 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1350000000000003e-06 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883566+0000", 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9745000000000003e-05 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883710+0000", 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014383500000000001 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883856+0000", 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000146181 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.920 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:50755 5.9 e31/21 5:9151e8c5:::benchmark_data_smithi062_23645_object50754:head v 31'3129, mlcod=31'3127)", 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:58.883432+0000", 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0030955319999999998, 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033787790000000002, 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883432+0000", 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883432+0000", 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883433+0000", 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7400000000000003e-07 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883555+0000", 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012214600000000001 2024-09-12T18:13:58.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883562+0000", 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7519999999999996e-06 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883569+0000", 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3400000000000003e-06 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:58.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883615+0000", 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5714999999999999e-05 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:58.883631+0000", 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6518999999999999e-05 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 9 2024-09-12T18:13:58.924 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:58.926 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:13:58.931 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:58.928+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:59.031 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:59.028+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:59.085 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:59.085 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:13:59.085 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:13:59.085 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:13:59.085 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:59.103 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:13:59.133 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:59.129+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:59.233 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:59.233+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:59.253 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.861490316000001, 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.254 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:13:59.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:13:59.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.861374953999999, 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:13:59.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:13:59.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:13:59.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.861293988, 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:13:59.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:59.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:13:59.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.273 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.861189476, 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:13:59.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:13:59.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.861105533, 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:59.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:13:59.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:13:59.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:13:59.287 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.288 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.860982587000002, 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:13:59.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:13:59.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:13:59.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.860911078000001, 2024-09-12T18:13:59.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:13:59.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:13:59.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.860846178000003, 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:59.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:13:59.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.860776712000003, 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:13:59.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:13:59.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.846358551000002, 2024-09-12T18:13:59.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:13:59.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15908 5.0 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 14.012580502, 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018670684, 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.317 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15908 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:13:59.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239941+0000", 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6400000000000001e-07 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239986+0000", 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5466999999999997e-05 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239996+0000", 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6209999999999999e-06 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240002+0000", 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.229e-06 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240369+0000", 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036721600000000002 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240554+0000", 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018448100000000001 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240680+0000", 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012593700000000001 2024-09-12T18:13:59.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.242166+0000", 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014860170000000001 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258545+0000", 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01637885 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258579+0000", 2024-09-12T18:13:59.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.468e-05 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258611+0000", 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1322000000000003e-05 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15917 5.b 5:d520353b:::benchmark_data_smithi062_23645_object15916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:59.323 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 14.006924558, 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015705908000000001, 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15917 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:59.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245597+0000", 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245642+0000", 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5484e-05 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245647+0000", 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2399999999999998e-06 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245651+0000", 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3469999999999999e-06 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245695+0000", 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4249999999999998e-05 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245806+0000", 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110752 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245920+0000", 2024-09-12T18:13:59.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114156 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255011+0000", 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090915860000000005 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261216+0000", 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062048700000000004 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261251+0000", 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4854999999999997e-05 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261302+0000", 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0766999999999997e-05 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:59.329 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 14.006857604, 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:13:59.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.335 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15923 5.4 5:217c37e3:::benchmark_data_smithi062_23645_object15922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 14.005569637000001, 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017388715999999999, 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.336 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15923 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246952+0000", 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.95e-07 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247021+0000", 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9080999999999998e-05 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247032+0000", 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0577999999999999e-05 2024-09-12T18:13:59.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247039+0000", 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3699999999999997e-06 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253374+0000", 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063354919999999999 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253534+0000", 2024-09-12T18:13:59.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159421 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253632+0000", 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8021000000000002e-05 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255738+0000", 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021061550000000002 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264249+0000", 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085105400000000005 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264301+0000", 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1996999999999997e-05 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264340+0000", 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9066000000000002e-05 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.341 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16961 5.b 5:d94b6522:::benchmark_data_smithi062_23645_object16960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.620983955, 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016331854, 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.342 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16961 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631676+0000", 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013913799999999999 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631689+0000", 2024-09-12T18:13:59.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2483000000000001e-05 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631694+0000", 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1610000000000002e-06 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631778+0000", 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4529000000000003e-05 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631935+0000", 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156279 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632093+0000", 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000157792 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634146+0000", 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002053301 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647775+0000", 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013628695 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647829+0000", 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4945999999999999e-05 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647868+0000", 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8914e-05 2024-09-12T18:13:59.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16963 5.4 5:2fa071ac:::benchmark_data_smithi062_23645_object16962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.620815322, 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016816028, 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.348 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16963 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631706+0000", 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631736+0000", 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0224000000000001e-05 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631741+0000", 2024-09-12T18:13:59.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5910000000000003e-06 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631745+0000", 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631788+0000", 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2823e-05 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631918+0000", 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000129586 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632010+0000", 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2215999999999999e-05 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.633704+0000", 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001693784 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648445+0000", 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014741316000000001 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648480+0000", 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4620999999999999e-05 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648521+0000", 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1631999999999997e-05 2024-09-12T18:13:59.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16971 5.4 5:271b2960:::benchmark_data_smithi062_23645_object16970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.618124452, 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015406705, 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.354 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16971 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634396+0000", 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634397+0000", 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0189999999999999e-06 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634500+0000", 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103398 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634511+0000", 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0733e-05 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634519+0000", 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4850000000000003e-06 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634589+0000", 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0180999999999998e-05 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634736+0000", 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000147443 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634879+0000", 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000142943 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637632+0000", 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002753237 2024-09-12T18:13:59.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649640+0000", 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012007261999999999 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649742+0000", 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102231 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.649803+0000", 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0773000000000002e-05 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16972 5.0 5:0a18df3f:::benchmark_data_smithi062_23645_object16971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.617975481, 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015621523999999999, 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.360 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16972 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634546+0000", 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634588+0000", 2024-09-12T18:13:59.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2580999999999998e-05 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634597+0000", 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6959999999999994e-06 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634603+0000", 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7690000000000002e-06 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634654+0000", 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1607000000000002e-05 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634826+0000", 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017138099999999999 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635023+0000", 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019718000000000001 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637067+0000", 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002043703 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650031+0000", 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012964260999999999 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650113+0000", 2024-09-12T18:13:59.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2522999999999996e-05 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650167+0000", 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3151e-05 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16973 5.e 5:7478c9cc:::benchmark_data_smithi062_23645_object16972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.6179045, 2024-09-12T18:13:59.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015645486, 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16973 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634617+0000", 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634659+0000", 2024-09-12T18:13:59.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2555000000000002e-05 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634667+0000", 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634673+0000", 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3640000000000004e-06 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634739+0000", 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6229000000000006e-05 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634900+0000", 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016037000000000001 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635079+0000", 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017936699999999999 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637311+0000", 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0022314629999999999 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650191+0000", 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012880302 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650232+0000", 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0595e-05 2024-09-12T18:13:59.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650261+0000", 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9957000000000001e-05 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:38784 5.b 5:d629bc1c:::benchmark_data_smithi062_23645_object38783:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.3981299930000004, 2024-09-12T18:13:59.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015913716000000001, 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 38784 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854546+0000", 2024-09-12T18:13:59.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015517999999999999 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854556+0000", 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6709999999999994e-06 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854564+0000", 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4359999999999996e-06 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:13:59.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861215+0000", 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066519179999999997 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861337+0000", 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000121332 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861493+0000", 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156565 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.864866+0000", 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033727150000000001 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870220+0000", 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053535709999999997 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870259+0000", 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9341000000000002e-05 2024-09-12T18:13:59.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870304+0000", 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5226999999999999e-05 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:13:59.378 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:13:59.380 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:13:59.380 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:59.377+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:59.400 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 19 16 51925 51909 170.735 140.438 0.00493907 0.00585207 2024-09-12T18:13:59.481 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:13:59.477+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:13:59.538 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:13:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:52226 5.3 5:c2620675:::benchmark_data_smithi062_23645_object52225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.532939+0000", 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0059538589999999997, 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059814279999999996, 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52226 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532939+0000", 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532939+0000", 2024-09-12T18:13:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532940+0000", 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109999999999999e-06 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532988+0000", 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8152000000000002e-05 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.533001+0000", 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2499e-05 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.533008+0000", 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3259999999999998e-06 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.533328+0000", 2024-09-12T18:13:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032009999999999997 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.533450+0000", 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012237200000000001 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.533572+0000", 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121455 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.536878+0000", 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033058979999999998 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:52229 5.6 5:6d2d25de:::benchmark_data_smithi062_23645_object52228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.534034+0000", 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0048587880000000002, 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049636469999999999, 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52229 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534034+0000", 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534034+0000", 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534035+0000", 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.102e-06 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534102+0000", 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6601999999999997e-05 2024-09-12T18:13:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534111+0000", 2024-09-12T18:13:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8890000000000008e-06 2024-09-12T18:13:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534116+0000", 2024-09-12T18:13:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3349999999999997e-06 2024-09-12T18:13:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534209+0000", 2024-09-12T18:13:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3596000000000003e-05 2024-09-12T18:13:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534316+0000", 2024-09-12T18:13:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010626 2024-09-12T18:13:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534409+0000", 2024-09-12T18:13:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3688000000000002e-05 2024-09-12T18:13:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538341+0000", 2024-09-12T18:13:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039318219999999997 2024-09-12T18:13:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:52230 5.6 5:6ecb3887:::benchmark_data_smithi062_23645_object52229:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.534586+0000", 2024-09-12T18:13:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0043063190000000003, 2024-09-12T18:13:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044803000000000004, 2024-09-12T18:13:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52230 2024-09-12T18:13:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534586+0000", 2024-09-12T18:13:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534586+0000", 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534587+0000", 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7699999999999992e-07 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534658+0000", 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0916999999999999e-05 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534666+0000", 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.534672+0000", 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.536619+0000", 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019462889999999999 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.536711+0000", 2024-09-12T18:13:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2204e-05 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.536790+0000", 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8836000000000002e-05 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538739+0000", 2024-09-12T18:13:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019488159999999999 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:52233 5.3 5:c8cc0d2d:::benchmark_data_smithi062_23645_object52232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.537018+0000", 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001874751, 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021198499999999999, 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52233 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537018+0000", 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537018+0000", 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537019+0000", 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1060000000000001e-06 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537049+0000", 2024-09-12T18:13:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0122000000000001e-05 2024-09-12T18:13:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537059+0000", 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3510000000000008e-06 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537065+0000", 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2689999999999996e-06 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537121+0000", 2024-09-12T18:13:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6143000000000001e-05 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537243+0000", 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122457 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537373+0000", 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012992200000000001 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:52232 5.b e31/21 5:d8f5ab54:::benchmark_data_smithi062_23645_object52231:head v 31'3211, mlcod=31'3209)", 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.537176+0000", 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00171627, 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020200550000000002, 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537176+0000", 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537176+0000", 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537177+0000", 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4499999999999997e-07 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537233+0000", 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6592000000000003e-05 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537241+0000", 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7470000000000005e-06 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537246+0000", 2024-09-12T18:13:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9899999999999997e-06 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537281+0000", 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4647999999999998e-05 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537292+0000", 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1245e-05 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:52234 5.1 e31/21 5:8ccc66a3:::benchmark_data_smithi062_23645_object52233:head v 31'3313, mlcod=31'3311)", 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.537529+0000", 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001364072, 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017158589999999999, 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537529+0000", 2024-09-12T18:13:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537529+0000", 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537529+0000", 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6599999999999996e-07 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537680+0000", 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015041800000000001 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537688+0000", 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7350000000000002e-06 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537694+0000", 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9889999999999997e-06 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537746+0000", 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1795000000000001e-05 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537765+0000", 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8575000000000001e-05 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:52235 5.7 e31/21 5:e06e51e9:::benchmark_data_smithi062_23645_object52234:head v 31'3193, mlcod=31'3190)", 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.538285+0000", 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000607702, 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001007155, 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538285+0000", 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538285+0000", 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538286+0000", 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538342+0000", 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6647999999999997e-05 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538350+0000", 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7800000000000001e-06 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538355+0000", 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8080000000000004e-06 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538409+0000", 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4543999999999998e-05 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538422+0000", 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2985e-05 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:52237 5.3 5.2a73b853 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.538623+0000", 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000269387, 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00072305000000000004, 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52237 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538623+0000", 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538623+0000", 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538624+0000", 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538687+0000", 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2426000000000002e-05 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538698+0000", 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1240000000000001e-05 2024-09-12T18:13:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.538705+0000", 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8510000000000001e-06 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.539348+0000", 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00064307999999999998 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:52212 5.a 5:542efe0c:::benchmark_data_smithi062_23645_object52211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:59.528318+0000", 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010575009, 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011089180000000001, 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52212 2024-09-12T18:13:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.528318+0000", 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.528318+0000", 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:13:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.528318+0000", 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4099999999999999e-07 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.528348+0000", 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9430000000000001e-05 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.528354+0000", 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6800000000000004e-06 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.528360+0000", 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6779999999999997e-06 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532458+0000", 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004097664 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532597+0000", 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139636 2024-09-12T18:13:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.532775+0000", 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000178042 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:59.537971+0000", 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051952020000000003 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:13:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:13:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 9 2024-09-12T18:13:59.597 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:59.598 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:13:59.598 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:59.596+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:59.698 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:13:59.697+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:13:59.795 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:13:59.795 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:13:59.796 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:13:59.796 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:13:59.796 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:13:59.796 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:13:59.800 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:59.796+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:13:59.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:13:59.901 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:13:59.900+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:00.003 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:00.001+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:00.010 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:00.010 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:00.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:00.010 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:00.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.010 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.607489305999998, 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.011 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:00.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:00.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:00.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:00.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.603459076999997, 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.019 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:14:00.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:14:00.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:14:00.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.603288841000001, 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.026 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:00.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:00.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.603172082, 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.032 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:00.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:00.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.603102946, 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:00.038 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:00.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.602991193999998, 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.044 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:00.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:00.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.602827372, 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:00.050 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:00.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:00.054 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.602766606000003, 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:00.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.767803443, 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.063 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15913 5.a 5:5c7723a1:::benchmark_data_smithi062_23645_object15912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.763889955, 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015699285, 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15913 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244786+0000", 2024-09-12T18:14:00.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244888+0000", 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244894+0000", 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244899+0000", 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244972+0000", 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3316000000000001e-05 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245084+0000", 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111703 2024-09-12T18:14:00.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245200+0000", 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115406 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259521+0000", 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014321122 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260404+0000", 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088351800000000002 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260457+0000", 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3001000000000003e-05 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260485+0000", 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7424e-05 2024-09-12T18:14:00.069 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15922 5.3 5:c9e976be:::benchmark_data_smithi062_23645_object15921:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.763111023, 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015052953000000001, 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.070 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15922 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245564+0000", 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245565+0000", 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2109999999999999e-06 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245594+0000", 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8756999999999999e-05 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245601+0000", 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3670000000000002e-06 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245606+0000", 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.023e-06 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245652+0000", 2024-09-12T18:14:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6811999999999998e-05 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245758+0000", 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105834 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245862+0000", 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010354200000000001 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259068+0000", 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013205783 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260567+0000", 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014991570000000001 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260594+0000", 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7362e-05 2024-09-12T18:14:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260617+0000", 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3105e-05 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15917 5.b e25/21 5:d520353b:::benchmark_data_smithi062_23645_object15916:head v 25'983, mlcod=25'981)", 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.763083663, 2024-09-12T18:14:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015050452000000001, 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245592+0000", 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245704+0000", 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111766 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245735+0000", 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0534000000000003e-05 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245742+0000", 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6499999999999996e-06 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257961+0000", 2024-09-12T18:14:00.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012218250999999999 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257987+0000", 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6352000000000001e-05 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260621+0000", 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026337119999999999 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260642+0000", 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1467e-05 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.762039702999999, 2024-09-12T18:14:00.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:00.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:00.086 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.379558156, 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:00.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:00.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.092 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16962 5.a 5:5bca3d75:::benchmark_data_smithi062_23645_object16961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.377567398, 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015114977, 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.093 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16962 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631109+0000", 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0240000000000001e-06 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631271+0000", 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016195700000000001 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631282+0000", 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0746e-05 2024-09-12T18:14:00.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631287+0000", 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631335+0000", 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8134999999999999e-05 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631473+0000", 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013780300000000001 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631621+0000", 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148238 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633224+0000", 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001602942 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646094+0000", 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012870651 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646181+0000", 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780999999999995e-05 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646223+0000", 2024-09-12T18:14:00.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1638999999999999e-05 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16965 5.5 5:a0639920:::benchmark_data_smithi062_23645_object16964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.375210833000001, 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015569835000000001, 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.099 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16965 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633466+0000", 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-06 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633536+0000", 2024-09-12T18:14:00.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0366999999999999e-05 2024-09-12T18:14:00.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633546+0000", 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059e-05 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633552+0000", 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0129999999999999e-06 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646012+0000", 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012459822000000001 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646152+0000", 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013997200000000001 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646248+0000", 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6335999999999994e-05 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648453+0000", 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022045770000000001 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648912+0000", 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045902200000000001 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648997+0000", 2024-09-12T18:14:00.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970999999999997e-05 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649034+0000", 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7585e-05 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16969 5.5 5:a17db384:::benchmark_data_smithi062_23645_object16968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:00.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.374497404, 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015671503999999999, 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16969 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634179+0000", 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-06 2024-09-12T18:14:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634280+0000", 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010138500000000001 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634291+0000", 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634309+0000", 2024-09-12T18:14:00.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.836e-05 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647082+0000", 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012772149999999999 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647205+0000", 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012367500000000001 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647364+0000", 2024-09-12T18:14:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015912200000000001 2024-09-12T18:14:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649290+0000", 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019254960000000001 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649781+0000", 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049094099999999995 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649812+0000", 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1007000000000003e-05 2024-09-12T18:14:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649849+0000", 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7602999999999999e-05 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:19567 5.6 5:62441267:::benchmark_data_smithi062_23645_object19566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:14:00.115 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.457738844, 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015428716, 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 19567 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550937+0000", 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551054+0000", 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116697 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551064+0000", 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7759999999999992e-06 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551071+0000", 2024-09-12T18:14:00.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551622+0000", 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055093700000000004 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551694+0000", 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1783e-05 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551770+0000", 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5945000000000006e-05 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.555763+0000", 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039931230000000003 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566239+0000", 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010475475999999999 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566317+0000", 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7885000000000004e-05 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566365+0000", 2024-09-12T18:14:00.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8634000000000002e-05 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:39823 5.3 5:c7741fa1:::benchmark_data_smithi062_23645_object39822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:54.290433+0000", 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.7182420440000001, 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015058500000000001, 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 39823 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.290433+0000", 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.290433+0000", 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.290434+0000", 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018e-06 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.290506+0000", 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1667000000000003e-05 2024-09-12T18:14:00.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.290518+0000", 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1758e-05 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.290532+0000", 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4603000000000001e-05 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.296760+0000", 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062276720000000001 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.296913+0000", 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015255100000000001 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.297055+0000", 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014232000000000001 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.300558+0000", 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035035779999999998 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.305333+0000", 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047741850000000002 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.305432+0000", 2024-09-12T18:14:00.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.912e-05 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:54.305492+0000", 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0028000000000002e-05 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:42180 5.3 5:cb8cf6ca:::benchmark_data_smithi062_23645_object42179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:55.221989+0000", 2024-09-12T18:14:00.128 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.7866867790000001, 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014604142000000001, 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42180 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:00.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.221989+0000", 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.221989+0000", 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.221989+0000", 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1600000000000001e-07 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.222076+0000", 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6967999999999998e-05 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.222085+0000", 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6649999999999992e-06 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.222091+0000", 2024-09-12T18:14:00.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9320000000000001e-06 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.227528+0000", 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054371999999999997 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.227649+0000", 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120717 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.227767+0000", 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118192 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.229679+0000", 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001911804 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.236512+0000", 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068337700000000003 2024-09-12T18:14:00.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.236556+0000", 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3421999999999999e-05 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:55.236593+0000", 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6755999999999998e-05 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.134 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:00.135 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:00.135 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:00.136 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:00.133+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:00.136 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:00.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:00.237 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:00.237+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:00.292 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:00.292 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:00.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.292 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53838 5.7 5:ef837940:::benchmark_data_smithi062_23645_object53837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.292 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.281181+0000", 2024-09-12T18:14:00.292 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.011274641, 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011294972, 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53838 2024-09-12T18:14:00.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281181+0000", 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281181+0000", 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281182+0000", 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1900000000000002e-07 2024-09-12T18:14:00.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281212+0000", 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0426e-05 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281220+0000", 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2980000000000003e-06 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281226+0000", 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.674e-06 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281285+0000", 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281431+0000", 2024-09-12T18:14:00.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000145909 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.281569+0000", 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000138345 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.285938+0000", 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0043690489999999998 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.300 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53845 5.9 5:91cf1cc0:::benchmark_data_smithi062_23645_object53844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.283934+0000", 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00852172, 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0085892690000000001, 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53845 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.283934+0000", 2024-09-12T18:14:00.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.283934+0000", 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.283935+0000", 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9899999999999999e-07 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.283979+0000", 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3968000000000003e-05 2024-09-12T18:14:00.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.284028+0000", 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.284036+0000", 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5739999999999998e-06 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.285912+0000", 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0018762049999999999 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286030+0000", 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000118631 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286150+0000", 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119766 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288418+0000", 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022679169999999999 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.307 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53850 5.1 5:88cd0b12:::benchmark_data_smithi062_23645_object53849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.286121+0000", 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0063348370000000003, 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0064431590000000004, 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53850 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286121+0000", 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286121+0000", 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286123+0000", 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.615e-06 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286221+0000", 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8071000000000003e-05 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286236+0000", 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5637999999999998e-05 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286247+0000", 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0891e-05 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288200+0000", 2024-09-12T18:14:00.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019532960000000002 2024-09-12T18:14:00.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288344+0000", 2024-09-12T18:14:00.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014361199999999999 2024-09-12T18:14:00.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288483+0000", 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000139083 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.292335+0000", 2024-09-12T18:14:00.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0038515429999999998 2024-09-12T18:14:00.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53852 5.7 5:e8a52746:::benchmark_data_smithi062_23645_object53851:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.286900+0000", 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.005555305, 2024-09-12T18:14:00.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0057035810000000001, 2024-09-12T18:14:00.316 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.316 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.316 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53852 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286900+0000", 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286900+0000", 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286901+0000", 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.286994+0000", 2024-09-12T18:14:00.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2664999999999995e-05 2024-09-12T18:14:00.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.287004+0000", 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0441e-05 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.287009+0000", 2024-09-12T18:14:00.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8210000000000001e-06 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.287065+0000", 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5995999999999997e-05 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.287186+0000", 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000121122 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.287373+0000", 2024-09-12T18:14:00.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018620900000000001 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53855 5.7 5:e14cc358:::benchmark_data_smithi062_23645_object53854:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.324 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.288994+0000", 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0034618919999999998, 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003645222, 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.325 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53855 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288994+0000", 2024-09-12T18:14:00.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288994+0000", 2024-09-12T18:14:00.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.288995+0000", 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289073+0000", 2024-09-12T18:14:00.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7639000000000007e-05 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289084+0000", 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799e-05 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289092+0000", 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8480000000000001e-06 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289222+0000", 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129851 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289372+0000", 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000150259 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289498+0000", 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012560199999999999 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:53854 5.3 e32/21 5:cc0552c2:::benchmark_data_smithi062_23645_object53853:head v 32'3405, mlcod=32'3403)", 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.289157+0000", 2024-09-12T18:14:00.331 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0032990459999999999, 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035161469999999998, 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289157+0000", 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289157+0000", 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289157+0000", 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3000000000000001e-07 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289194+0000", 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6650000000000003e-05 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289205+0000", 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0985000000000001e-05 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289209+0000", 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5340000000000001e-06 2024-09-12T18:14:00.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289254+0000", 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4246999999999998e-05 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289271+0000", 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7816e-05 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53856 5.7 5:e8831709:::benchmark_data_smithi062_23645_object53855:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.289108+0000", 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0033475200000000001, 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035959730000000001, 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.336 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53856 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289108+0000", 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289108+0000", 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289109+0000", 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289240+0000", 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000130581 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289248+0000", 2024-09-12T18:14:00.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6279999999999994e-06 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289252+0000", 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9639999999999997e-06 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.291181+0000", 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019286559999999999 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.291300+0000", 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011909900000000001 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.291424+0000", 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000124022 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.340 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:53838 5.7 e32/21)", 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.289287+0000", 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.003168274, 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003447823, 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289287+0000", 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289287+0000", 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289288+0000", 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289291+0000", 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0960000000000001e-06 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289298+0000", 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5069999999999997e-06 2024-09-12T18:14:00.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.289301+0000", 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7589999999999999e-06 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:53857 5.5 e32/21 5:af6e3274:::benchmark_data_smithi062_23645_object53856:head v 32'3461, mlcod=32'3459)", 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.290154+0000", 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0023015660000000001, 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026036990000000001, 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.345 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290154+0000", 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290154+0000", 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290155+0000", 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8500000000000001e-07 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290217+0000", 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1755999999999996e-05 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290223+0000", 2024-09-12T18:14:00.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8560000000000001e-06 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290229+0000", 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0669999999999999e-06 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290271+0000", 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290287+0000", 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6161999999999999e-05 2024-09-12T18:14:00.350 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:53859 5.d e32/21 5:b7ac92d7:::benchmark_data_smithi062_23645_object53858:head v 32'3398, mlcod=32'3396)", 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.290371+0000", 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020843900000000002, 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024134959999999998, 2024-09-12T18:14:00.351 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290371+0000", 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290371+0000", 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290372+0000", 2024-09-12T18:14:00.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290416+0000", 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3986000000000002e-05 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290422+0000", 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0009999999999998e-06 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290426+0000", 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:00.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290462+0000", 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6715999999999999e-05 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290474+0000", 2024-09-12T18:14:00.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1734e-05 2024-09-12T18:14:00.357 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.357 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.357 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53860 5.9 5:9c978c1d:::benchmark_data_smithi062_23645_object53859:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.290505+0000", 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0019502460000000001, 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023084609999999999, 2024-09-12T18:14:00.358 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53860 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.359 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290505+0000", 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290505+0000", 2024-09-12T18:14:00.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290506+0000", 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9100000000000003e-07 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290572+0000", 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5730999999999998e-05 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290583+0000", 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0801999999999999e-05 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290589+0000", 2024-09-12T18:14:00.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3500000000000002e-06 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290645+0000", 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6159000000000002e-05 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290769+0000", 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123662 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:00.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290900+0000", 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013089500000000001 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:53861 5.7 5.4a332c87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:00.290604+0000", 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0018514930000000001, 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002241856, 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:00.364 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 53861 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:00.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290604+0000", 2024-09-12T18:14:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290604+0000", 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290605+0000", 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290644+0000", 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9371e-05 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290652+0000", 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.447e-06 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:00.290657+0000", 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2329999999999997e-06 2024-09-12T18:14:00.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.369 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:00.369 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.369 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:00.369 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:00.369 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 12 2024-09-12T18:14:00.369 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:00.371 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:00.371 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:00.368+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:00.372 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:00.373 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:00.373 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:00.373 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:00.383 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:00.383 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:00.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:2024-09-12T18:14:00.402596+0000 min lat: 0.0015127 max lat: 0.0773558 avg lat: 0.00591178 2024-09-12T18:14:00.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:14:00.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 20 16 54106 54090 169.014 136.312 0.00372968 0.00591178 2024-09-12T18:14:00.471 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:00.468+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:00.536 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:00.537 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:00.556 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:00.573 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:00.572+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:00.674 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:00.672+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:00.709 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:00.710 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:00.733 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:00.780 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:00.781+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:00.875 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:00.873+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:00.886 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:00.886 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:00.906 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:00.976 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:00.976+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:01.053 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:14:01.053 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:01.053 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:14:01.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:14:01.076 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:01.077+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:01.100 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:01.101 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:01.121 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:01.177 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:01.176+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:01.278 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:01.277+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:01.319 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:01.319 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:01.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:01.388 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:01.388+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:01.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:14:01.390 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:14:01.390 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 32, 2024-09-12T18:14:01.390 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-09-12T18:13:00.942825+0000", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-09-12T18:13:59.787349+0000", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-09-12T18:13:10.269506+0000", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-09-12T18:13:01.815814+0000", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:01.391 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 5, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "luminous", 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-09-12T18:14:01.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:10.380891+0000", 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:01.393 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:01.394 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:01.395 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:01.396 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:01.397 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:01.398 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-09-12T18:14:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:16.182185+0000", 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 8193, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:01.400 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:01.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 2, 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 15, 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:01.402 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:01.403 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:14:01.404 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:20.398999+0000", 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:01.406 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:01.407 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "18", 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:01.408 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:01.410 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:14:01.411 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:01.412 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:21.732662+0000", 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:01.413 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:01.414 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:01.415 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:01.416 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1699999570846558, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1699999570846558, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1699999570846558, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1699999570846558, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.419 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 5, 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:38.126670+0000", 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:01.420 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 16, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 16, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 16, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 16, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 16, 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:01.421 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "23", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:01.422 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:01.423 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:01.424 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "rados": {} 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.425 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.426 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "d5348027-f4dc-457f-8b4e-a4341015d874", 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 26, 2024-09-12T18:14:01.427 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6800", 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6801", 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.428 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6802", 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6803", 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.429 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6806", 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.430 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6807", 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6804", 2024-09-12T18:14:01.431 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6805", 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.129:6801/1368744816", 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.129:6803/1368744816", 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.129:6807/1368744816", 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.129:6805/1368744816", 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:14:01.433 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "939481c0-5bf6-4136-b772-e0ba4c215bf1", 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:01.434 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6800", 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6801", 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.435 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6802", 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.436 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6803", 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6806", 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6807", 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6804", 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.438 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6805", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.151:6801/1445669154", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.151:6803/1445669154", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.151:6807/1445669154", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.151:6805/1445669154", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:01.439 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "66fc0ac1-f14f-48bf-a557-110b23bff1d2", 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:01.440 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6800", 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.441 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6801", 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6802", 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.442 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6803", 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6806", 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.443 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6807", 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6804", 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6805", 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.176:6801/752868242", 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.176:6803/752868242", 2024-09-12T18:14:01.445 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.176:6807/752868242", 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.176:6805/752868242", 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:01.446 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.730957+0000", 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:01.447 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.793073+0000", 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.762001+0000", 2024-09-12T18:14:01.448 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [ 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.39", 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: 0, 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: 1 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-09-12T18:14:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:01.450 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:01.451 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:14:01.452 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 21 16 56324 56308 167.566 138.625 0.0102912 0.00596254 2024-09-12T18:14:01.453 INFO:tasks.thrashosds.thrasher:j is {'epoch': 32, 'fsid': '5c1106a1-8b30-400f-94eb-0bea28eb5927', 'created': '2024-09-12T18:13:00.942825+0000', 'modified': '2024-09-12T18:13:59.787349+0000', 'last_up_change': '2024-09-12T18:13:10.269506+0000', 'last_in_change': '2024-09-12T18:13:01.815814+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:13:10.380891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:13:16.182185+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:13:20.398999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:13:21.732662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:13:38.126670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'd5348027-f4dc-457f-8b4e-a4341015d874', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 1368744816}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 1368744816}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 1368744816}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 1368744816}]}, 'public_addr': '172.21.15.129:6801/1368744816', 'cluster_addr': '172.21.15.129:6803/1368744816', 'heartbeat_back_addr': '172.21.15.129:6807/1368744816', 'heartbeat_front_addr': '172.21.15.129:6805/1368744816', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '939481c0-5bf6-4136-b772-e0ba4c215bf1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 1445669154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 1445669154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 1445669154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 1445669154}]}, 'public_addr': '172.21.15.151:6801/1445669154', 'cluster_addr': '172.21.15.151:6803/1445669154', 'heartbeat_back_addr': '172.21.15.151:6807/1445669154', 'heartbeat_front_addr': '172.21.15.151:6805/1445669154', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '66fc0ac1-f14f-48bf-a557-110b23bff1d2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6800', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6801', 'nonce': 752868242}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6802', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6803', 'nonce': 752868242}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6806', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6807', 'nonce': 752868242}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6804', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6805', 'nonce': 752868242}]}, 'public_addr': '172.21.15.176:6801/752868242', 'cluster_addr': '172.21.15.176:6803/752868242', 'heartbeat_back_addr': '172.21.15.176:6807/752868242', 'heartbeat_front_addr': '172.21.15.176:6805/752868242', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.730957+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.793073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.762001+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.39', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:14:01.454 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.39 2024-09-12T18:14:01.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 4.39 2024-09-12T18:14:01.479 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:01.476+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:01.499 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:01.499 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:01.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:01.580 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:01.577+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:01.681 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:01.680+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:01.721 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:01.721 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:01.742 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:01.782 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:01.781+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:01.804 INFO:teuthology.orchestra.run.smithi062.stderr:clear 4.39 pg_upmap mapping 2024-09-12T18:14:01.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:14:01.883 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:01.880+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:01.933 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:01.933 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:01.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:01.996 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:01.996+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:02.086 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:02.081+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:02.115 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:02.115 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:02.138 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:02.226 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:02.225+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:02.287 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:02.285+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:02.336 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:02.336 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:02.357 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:02.388 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:02.385+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:02.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 22 16 58496 58480 166.119 135.75 0.0119321 0.0060148 2024-09-12T18:14:02.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:02.489 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:02.488+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:02.553 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:02.553 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:02.564 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:02.576 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:02.582 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:02.589 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:02.588+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:02.601 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:02.690 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:02.688+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:02.725 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:59194 5.9 e33/21 5:923d63de:::benchmark_data_smithi062_23645_object59193:head v 33'3732, mlcod=33'3728)", 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:02.723368+0000", 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.003423752, 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034403849999999998, 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723368+0000", 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723368+0000", 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723369+0000", 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:02.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723423+0000", 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4404999999999998e-05 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723429+0000", 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1630000000000001e-06 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723433+0000", 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2220000000000004e-06 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723512+0000", 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8614000000000003e-05 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.723526+0000", 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3971000000000001e-05 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.729 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:59199 5.9 e33/21 5:961a09f5:::benchmark_data_smithi062_23645_object59198:head v 33'3733, mlcod=33'3729)", 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:02.726013+0000", 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00077908899999999995, 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00083053499999999998, 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726013+0000", 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726013+0000", 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726013+0000", 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4499999999999997e-07 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726069+0000", 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6243999999999999e-05 2024-09-12T18:14:02.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726076+0000", 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8179999999999998e-06 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726080+0000", 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7359999999999999e-06 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:02.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726126+0000", 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6455999999999997e-05 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.726140+0000", 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3871e-05 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:59195 5.4 5:2d72bfbb:::benchmark_data_smithi062_23645_object59194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:14:02.733 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:02.721254+0000", 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0055378959999999996, 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056243070000000003, 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 59195 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:02.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721254+0000", 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721254+0000", 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721255+0000", 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.409e-06 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721287+0000", 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1816000000000002e-05 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721298+0000", 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0502999999999999e-05 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721305+0000", 2024-09-12T18:14:02.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4680000000000003e-06 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721349+0000", 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4263e-05 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721449+0000", 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100041 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:02.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721550+0000", 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100716 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.725378+0000", 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003828134 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:59193 5.9 e33/21 5:94760865:::benchmark_data_smithi062_23645_object59192:head v 33'3731, mlcod=33'3728)", 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:02.721335+0000", 2024-09-12T18:14:02.738 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0054570019999999999, 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056076959999999997, 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721335+0000", 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:02.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721335+0000", 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721336+0000", 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0800000000000004e-07 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721370+0000", 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4950999999999998e-05 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721379+0000", 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0490000000000004e-06 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721386+0000", 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9189999999999999e-06 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721441+0000", 2024-09-12T18:14:02.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4219999999999999e-05 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.721461+0000", 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9972000000000001e-05 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:59201 5.8 5:1d7b6691:::benchmark_data_smithi062_23645_object59200:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:02.722502+0000", 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0042893410000000003, 2024-09-12T18:14:02.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045048639999999999, 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 59201 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722502+0000", 2024-09-12T18:14:02.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722502+0000", 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722503+0000", 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2600000000000001e-07 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722595+0000", 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1232999999999999e-05 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722606+0000", 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1389000000000001e-05 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722611+0000", 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.181e-06 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722653+0000", 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1644000000000003e-05 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722744+0000", 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1404999999999996e-05 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.722839+0000", 2024-09-12T18:14:02.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4712999999999999e-05 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:02.725393+0000", 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00255426 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 5 2024-09-12T18:14:02.747 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:02.748 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:02.793 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:02.793+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:14:02.891 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:02.889+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:02.908 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:02.908 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:14:02.908 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:14:02.908 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:14:02.908 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:02.928 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:02.992 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:02.992+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:03.093 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:03.093+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:03.133 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:03.133 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:14:03.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:14:03.133 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741653309, 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:03.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:14:03.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:03.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:14:03.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.140 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741537946999998, 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:14:03.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:14:03.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:14:03.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:14:03.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.147 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741456980999999, 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.148 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:14:03.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.154 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741352468999999, 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.155 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:14:03.156 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.157 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:14:03.158 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:14:03.158 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.158 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.158 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:03.158 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:14:03.158 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.159 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:14:03.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.161 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741268525999999, 2024-09-12T18:14:03.162 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.163 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:14:03.164 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.166 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:14:03.168 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.169 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.169 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.169 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:14:03.169 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:14:03.169 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.169 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741145580000001, 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:14:03.170 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.171 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.172 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:14:03.173 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.174 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:14:03.175 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.176 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.177 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741074071, 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.178 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:14:03.179 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.180 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:14:03.181 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.182 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:14:03.183 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.741009171000002, 2024-09-12T18:14:03.184 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:03.185 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.186 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:14:03.187 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:14:03.188 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:03.189 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.740939705000002, 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.190 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:14:03.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:14:03.194 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.726521544000001, 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.195 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:14:03.196 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.197 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.198 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15908 5.0 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.892743495000001, 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018670684, 2024-09-12T18:14:03.199 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15908 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.200 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.201 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239941+0000", 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6400000000000001e-07 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239986+0000", 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5466999999999997e-05 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239996+0000", 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6209999999999999e-06 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.202 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240002+0000", 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.229e-06 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240369+0000", 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036721600000000002 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240554+0000", 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018448100000000001 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.203 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240680+0000", 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012593700000000001 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.242166+0000", 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014860170000000001 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258545+0000", 2024-09-12T18:14:03.204 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01637885 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258579+0000", 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.468e-05 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258611+0000", 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1322000000000003e-05 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.205 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15917 5.b 5:d520353b:::benchmark_data_smithi062_23645_object15916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.887087551, 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015705908000000001, 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.206 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15917 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245596+0000", 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.207 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245597+0000", 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245642+0000", 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5484e-05 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245647+0000", 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2399999999999998e-06 2024-09-12T18:14:03.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245651+0000", 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3469999999999999e-06 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245695+0000", 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4249999999999998e-05 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245806+0000", 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110752 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245920+0000", 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114156 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255011+0000", 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090915860000000005 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261216+0000", 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062048700000000004 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261251+0000", 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4854999999999997e-05 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.261302+0000", 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0766999999999997e-05 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.887020596999999, 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.212 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:14:03.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15923 5.4 5:217c37e3:::benchmark_data_smithi062_23645_object15922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.88573263, 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017388715999999999, 2024-09-12T18:14:03.218 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15923 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246952+0000", 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.95e-07 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247021+0000", 2024-09-12T18:14:03.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9080999999999998e-05 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247032+0000", 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0577999999999999e-05 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247039+0000", 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3699999999999997e-06 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253374+0000", 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063354919999999999 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253534+0000", 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159421 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253632+0000", 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8021000000000002e-05 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255738+0000", 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021061550000000002 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264249+0000", 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085105400000000005 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264301+0000", 2024-09-12T18:14:03.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1996999999999997e-05 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264340+0000", 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9066000000000002e-05 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16961 5.b 5:d94b6522:::benchmark_data_smithi062_23645_object16960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:03.224 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.501146947999999, 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016331854, 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16961 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:14:03.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631676+0000", 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013913799999999999 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631689+0000", 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2483000000000001e-05 2024-09-12T18:14:03.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631694+0000", 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1610000000000002e-06 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631778+0000", 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4529000000000003e-05 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631935+0000", 2024-09-12T18:14:03.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156279 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632093+0000", 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000157792 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634146+0000", 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002053301 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647775+0000", 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013628695 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647829+0000", 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4945999999999999e-05 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647868+0000", 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8914e-05 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.231 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16963 5.4 5:2fa071ac:::benchmark_data_smithi062_23645_object16962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.500978315000001, 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016816028, 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.232 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16963 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631706+0000", 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631736+0000", 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0224000000000001e-05 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631741+0000", 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5910000000000003e-06 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631745+0000", 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631788+0000", 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2823e-05 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631918+0000", 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000129586 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632010+0000", 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2215999999999999e-05 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.633704+0000", 2024-09-12T18:14:03.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001693784 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648445+0000", 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014741316000000001 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648480+0000", 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4620999999999999e-05 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648521+0000", 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1631999999999997e-05 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16972 5.0 5:0a18df3f:::benchmark_data_smithi062_23645_object16971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.498138474000001, 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015621523999999999, 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.238 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16972 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634545+0000", 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634546+0000", 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634588+0000", 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2580999999999998e-05 2024-09-12T18:14:03.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634597+0000", 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6959999999999994e-06 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634603+0000", 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7690000000000002e-06 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634654+0000", 2024-09-12T18:14:03.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1607000000000002e-05 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634826+0000", 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017138099999999999 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635023+0000", 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019718000000000001 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637067+0000", 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002043703 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650031+0000", 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012964260999999999 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650113+0000", 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2522999999999996e-05 2024-09-12T18:14:03.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650167+0000", 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3151e-05 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16973 5.e 5:7478c9cc:::benchmark_data_smithi062_23645_object16972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.498067493000001, 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015645486, 2024-09-12T18:14:03.244 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16973 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634616+0000", 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634617+0000", 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634659+0000", 2024-09-12T18:14:03.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2555000000000002e-05 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634667+0000", 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5970000000000003e-06 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634673+0000", 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3640000000000004e-06 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634739+0000", 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6229000000000006e-05 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634900+0000", 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016037000000000001 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.635079+0000", 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017936699999999999 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.637311+0000", 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0022314629999999999 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650191+0000", 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012880302 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650232+0000", 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0595e-05 2024-09-12T18:14:03.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.650261+0000", 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9957000000000001e-05 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:38784 5.b 5:d629bc1c:::benchmark_data_smithi062_23645_object38783:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.2782929860000003, 2024-09-12T18:14:03.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015913716000000001, 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 38784 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854391+0000", 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854546+0000", 2024-09-12T18:14:03.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015517999999999999 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854556+0000", 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6709999999999994e-06 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.854564+0000", 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4359999999999996e-06 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861215+0000", 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066519179999999997 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861337+0000", 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000121332 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.861493+0000", 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156565 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.864866+0000", 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033727150000000001 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870220+0000", 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053535709999999997 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870259+0000", 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9341000000000002e-05 2024-09-12T18:14:03.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:53.870304+0000", 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5226999999999999e-05 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:52545 5.4 5:2e4ac178:::benchmark_data_smithi062_23645_object52544:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:59.675426+0000", 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.4572574170000001, 2024-09-12T18:14:03.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015710978, 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 52545 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.675426+0000", 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.675426+0000", 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.675427+0000", 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1060000000000001e-06 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:03.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.675566+0000", 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000139295 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.675577+0000", 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0239e-05 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.675590+0000", 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3736e-05 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.676997+0000", 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014067159999999999 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.677110+0000", 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011274599999999999 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.677191+0000", 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0916999999999998e-05 2024-09-12T18:14:03.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.680247+0000", 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030566410000000001 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.691081+0000", 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010833068 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.691113+0000", 2024-09-12T18:14:03.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2251e-05 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:59.691137+0000", 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4263000000000001e-05 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:03.262 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:03.263 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:03.260+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:03.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:03.364 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:03.361+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:03.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 23 16 60683 60667 164.839 136.688 0.010714 0.00606183 2024-09-12T18:14:03.419 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:60709 5.5 5:a43973b7:::benchmark_data_smithi062_23645_object60708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.415014+0000", 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049518840000000001, 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00497943, 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 60709 2024-09-12T18:14:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415014+0000", 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415014+0000", 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415015+0000", 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2139999999999999e-06 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415125+0000", 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110177 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415136+0000", 2024-09-12T18:14:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1172000000000001e-05 2024-09-12T18:14:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415144+0000", 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4390000000000003e-06 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415198+0000", 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4625e-05 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415344+0000", 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014589200000000001 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415501+0000", 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156427 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419290+0000", 2024-09-12T18:14:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037889070000000002 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60708 5.e e34/21 5:725cb647:::benchmark_data_smithi062_23645_object60707:head v 34'3780, mlcod=34'3775)", 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.415314+0000", 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0046514809999999998, 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047325359999999999, 2024-09-12T18:14:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415314+0000", 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415314+0000", 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415315+0000", 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415355+0000", 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0596999999999998e-05 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415364+0000", 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6649999999999992e-06 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415370+0000", 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416910+0000", 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001540257 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416930+0000", 2024-09-12T18:14:03.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0458e-05 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60706 5.7 e34/21 5:ecc62285:::benchmark_data_smithi062_23645_object60705:head v 34'3712, mlcod=34'3710)", 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.415224+0000", 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047414279999999998, 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048532590000000004, 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.431 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415224+0000", 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415224+0000", 2024-09-12T18:14:03.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415225+0000", 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2e-07 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415413+0000", 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018855799999999999 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415420+0000", 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.216e-06 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415426+0000", 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1390000000000003e-06 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415468+0000", 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2326000000000001e-05 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415486+0000", 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7887999999999999e-05 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60711 5.8 e34/21 5:1b582d4a:::benchmark_data_smithi062_23645_object60710:head v 34'3783, mlcod=34'3781)", 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.415764+0000", 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0042020920000000002, 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043407910000000001, 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415764+0000", 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415764+0000", 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415764+0000", 2024-09-12T18:14:03.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8599999999999998e-07 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415817+0000", 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2506000000000002e-05 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415829+0000", 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2632e-05 2024-09-12T18:14:03.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415837+0000", 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2119999999999997e-06 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.415879+0000", 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2772999999999999e-05 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417025+0000", 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001145973 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:60712 5.6 5:608315b9:::benchmark_data_smithi062_23645_object60711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.416320+0000", 2024-09-12T18:14:03.441 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003645929, 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038463590000000001, 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 60712 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416320+0000", 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416320+0000", 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416320+0000", 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2600000000000002e-07 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416399+0000", 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8250999999999993e-05 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416407+0000", 2024-09-12T18:14:03.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8449999999999992e-06 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416414+0000", 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5339999999999996e-06 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.416976+0000", 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000562179 2024-09-12T18:14:03.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417141+0000", 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016489200000000001 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417274+0000", 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013294399999999999 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419992+0000", 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027178739999999999 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60713 5.7 e34/21 5:e57924f2:::benchmark_data_smithi062_23645_object60712:head v 34'3713, mlcod=34'3710)", 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.417779+0000", 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0021870029999999999, 2024-09-12T18:14:03.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002430195, 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417779+0000", 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417779+0000", 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417779+0000", 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5900000000000003e-07 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417837+0000", 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8087000000000001e-05 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417844+0000", 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5880000000000003e-06 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.417848+0000", 2024-09-12T18:14:03.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2679999999999996e-06 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.418066+0000", 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021808299999999999 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.418082+0000", 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6137000000000002e-05 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.451 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60716 5.0 e34/21 5:07b67dc4:::benchmark_data_smithi062_23645_object60715:head v 34'3764, mlcod=34'3762)", 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.419479+0000", 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000487116, 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075806599999999995, 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.452 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419479+0000", 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419479+0000", 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419479+0000", 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.84e-07 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419543+0000", 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3886000000000005e-05 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419555+0000", 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2262000000000001e-05 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419559+0000", 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3490000000000002e-06 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419588+0000", 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8518999999999999e-05 2024-09-12T18:14:03.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419598+0000", 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0188e-05 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.456 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:60719 5.5 5:afdcf5c7:::benchmark_data_smithi062_23645_object60718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.419639+0000", 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00032680900000000001, 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063102000000000004, 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 60719 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.457 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419639+0000", 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419639+0000", 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419640+0000", 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3300000000000001e-07 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419715+0000", 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4943000000000004e-05 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419722+0000", 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3499999999999999e-06 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419726+0000", 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5589999999999999e-06 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419767+0000", 2024-09-12T18:14:03.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0448000000000003e-05 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419895+0000", 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127706 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.420018+0000", 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123705 2024-09-12T18:14:03.461 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60714 5.7 e34/21 5:e69ce44a:::benchmark_data_smithi062_23645_object60713:head v 34'3714, mlcod=34'3710)", 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.419959+0000", 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.4659999999999996e-06, 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000343844, 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.462 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419959+0000", 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419959+0000", 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419959+0000", 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2399999999999999e-07 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.419995+0000", 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5746e-05 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.420000+0000", 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1479999999999997e-06 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.420004+0000", 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8199999999999998e-06 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.420028+0000", 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3693000000000002e-05 2024-09-12T18:14:03.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.420038+0000", 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8500000000000006e-06 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60704 5.e e34/21 5:7e8f73b6:::benchmark_data_smithi062_23645_object60703:head v 34'3779, mlcod=34'3775)", 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.413234+0000", 2024-09-12T18:14:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0067312090000000002, 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070965960000000002, 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413234+0000", 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413234+0000", 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413235+0000", 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413297+0000", 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2265000000000001e-05 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413306+0000", 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5909999999999996e-06 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413312+0000", 2024-09-12T18:14:03.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.648e-06 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.414068+0000", 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000756692 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.414084+0000", 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5685999999999999e-05 2024-09-12T18:14:03.470 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:60705 5.2 e34/21 5:44151a5e:::benchmark_data_smithi062_23645_object60704:head v 34'3843, mlcod=34'3841)", 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.413568+0000", 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0063980069999999998, 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067908949999999999, 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.471 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413568+0000", 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413568+0000", 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413568+0000", 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0500000000000003e-07 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413638+0000", 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9691999999999996e-05 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413646+0000", 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5920000000000003e-06 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413651+0000", 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1309999999999997e-06 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413689+0000", 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8538999999999998e-05 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.413705+0000", 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5843000000000001e-05 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.475 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:03.476 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 11 2024-09-12T18:14:03.476 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:03.477 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:03.477+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:03.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:03.578 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:03.577+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:03.633 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:03.633 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:03.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:03.700 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:03.700+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:03.780 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:03.776+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.411679810000003, 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.407649581000001, 2024-09-12T18:14:03.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:14:03.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:14:03.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:14:03.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:03.827 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.407479344999999, 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:03.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:03.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.833 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.407362585999998, 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:03.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:03.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:03.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:03.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:03.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:03.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.407293449999997, 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:03.842 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.407181698000002, 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.848 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.407017875999998, 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:03.854 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:03.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:03.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.40695711, 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:03.859 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:03.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.571993946999999, 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:03.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:03.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:03.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:03.868 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15913 5.a 5:5c7723a1:::benchmark_data_smithi062_23645_object15912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.568080459000001, 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015699285, 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.869 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15913 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244786+0000", 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244888+0000", 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244894+0000", 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:03.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244899+0000", 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244972+0000", 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3316000000000001e-05 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245084+0000", 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111703 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245200+0000", 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115406 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259521+0000", 2024-09-12T18:14:03.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014321122 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260404+0000", 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088351800000000002 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260457+0000", 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3001000000000003e-05 2024-09-12T18:14:03.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260485+0000", 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7424e-05 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:03.876 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.566230207, 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:03.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:03.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.183748659999999, 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:03.881 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:03.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:03.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16962 5.a 5:5bca3d75:::benchmark_data_smithi062_23645_object16961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.888 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.181757902000001, 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015114977, 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16962 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.889 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631108+0000", 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631109+0000", 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0240000000000001e-06 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631271+0000", 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016195700000000001 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631282+0000", 2024-09-12T18:14:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0746e-05 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631287+0000", 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631335+0000", 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8134999999999999e-05 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631473+0000", 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013780300000000001 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631621+0000", 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148238 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633224+0000", 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001602942 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646094+0000", 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012870651 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646181+0000", 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780999999999995e-05 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646223+0000", 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1638999999999999e-05 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16965 5.5 5:a0639920:::benchmark_data_smithi062_23645_object16964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.179401337000002, 2024-09-12T18:14:03.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015569835000000001, 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16965 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:03.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633466+0000", 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-06 2024-09-12T18:14:03.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633536+0000", 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0366999999999999e-05 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633546+0000", 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059e-05 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633552+0000", 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0129999999999999e-06 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646012+0000", 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012459822000000001 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646152+0000", 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013997200000000001 2024-09-12T18:14:03.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646248+0000", 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6335999999999994e-05 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648453+0000", 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022045770000000001 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648912+0000", 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045902200000000001 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648997+0000", 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970999999999997e-05 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649034+0000", 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7585e-05 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16969 5.5 5:a17db384:::benchmark_data_smithi062_23645_object16968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:03.902 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.178687908000001, 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015671503999999999, 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16969 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634179+0000", 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-06 2024-09-12T18:14:03.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634280+0000", 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010138500000000001 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634291+0000", 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634309+0000", 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.836e-05 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647082+0000", 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012772149999999999 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647205+0000", 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012367500000000001 2024-09-12T18:14:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647364+0000", 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015912200000000001 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649290+0000", 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019254960000000001 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649781+0000", 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049094099999999995 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649812+0000", 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1007000000000003e-05 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649849+0000", 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7602999999999999e-05 2024-09-12T18:14:03.908 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:19567 5.6 5:62441267:::benchmark_data_smithi062_23645_object19566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.261929347999999, 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015428716, 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.909 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 19567 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550936+0000", 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.550937+0000", 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551054+0000", 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116697 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551064+0000", 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7759999999999992e-06 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551071+0000", 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551622+0000", 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055093700000000004 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551694+0000", 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1783e-05 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.551770+0000", 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5945000000000006e-05 2024-09-12T18:14:03.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.555763+0000", 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039931230000000003 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566239+0000", 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010475475999999999 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566317+0000", 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7885000000000004e-05 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:46.566365+0000", 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8634000000000002e-05 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:61129 5.1 e34/21 5:8eb73760:::benchmark_data_smithi062_23645_object61128:head v 34'3864, mlcod=34'3862)", 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.19903088399999999, 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017014511, 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613902+0000", 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6225999999999999e-05 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613910+0000", 2024-09-12T18:14:03.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3389999999999993e-06 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613917+0000", 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999999e-06 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613972+0000", 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4729999999999999e-05 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613990+0000", 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8097999999999999e-05 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630793+0000", 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016803604 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630849+0000", 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6137999999999997e-05 2024-09-12T18:14:03.920 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61312 5.3 5:cf9f1323:::benchmark_data_smithi062_23645_object61311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.705313+0000", 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.10755232000000001, 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015722628999999998, 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61312 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705313+0000", 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705313+0000", 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705314+0000", 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705464+0000", 2024-09-12T18:14:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014927699999999999 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705473+0000", 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6709999999999994e-06 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705482+0000", 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.67e-06 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.712402+0000", 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069205710000000004 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.712496+0000", 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3540000000000002e-05 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.712611+0000", 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001149 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716492+0000", 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038808459999999999 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.720943+0000", 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004451623 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.720996+0000", 2024-09-12T18:14:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3097999999999999e-05 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721036+0000", 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9601999999999998e-05 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61334 5.3 5:c7866da4:::benchmark_data_smithi062_23645_object61333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.716983+0000", 2024-09-12T18:14:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.095883207999999998, 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015454413, 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61334 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716983+0000", 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716983+0000", 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716984+0000", 2024-09-12T18:14:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2299999999999999e-07 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.717097+0000", 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113083 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.717107+0000", 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0172e-05 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.717114+0000", 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9249999999999998e-06 2024-09-12T18:14:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721225+0000", 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041112340000000001 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721343+0000", 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118391 2024-09-12T18:14:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721625+0000", 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181300000000001 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724326+0000", 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002701143 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732348+0000", 2024-09-12T18:14:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080216630000000001 2024-09-12T18:14:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732398+0000", 2024-09-12T18:14:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9920999999999999e-05 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732437+0000", 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9144999999999999e-05 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.088113514000000004, 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:03.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:03.947 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:03.945+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:04.047 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:04.045+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:04.101 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:04.101 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:04.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.101 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:62135 5.f 5:f438298b:::benchmark_data_smithi062_23645_object62134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.101 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.099269+0000", 2024-09-12T18:14:04.101 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002568051, 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025982129999999998, 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 62135 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099269+0000", 2024-09-12T18:14:04.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099269+0000", 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099270+0000", 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.144e-06 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099304+0000", 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4353000000000001e-05 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099313+0000", 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2930000000000006e-06 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099321+0000", 2024-09-12T18:14:04.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.79e-06 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099376+0000", 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5093000000000003e-05 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099475+0000", 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8393999999999993e-05 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099573+0000", 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8436000000000004e-05 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:62139 5.2 5:4561cd02:::benchmark_data_smithi062_23645_object62138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.099949+0000", 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0018873640000000001, 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019915269999999999, 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.106 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 62139 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099949+0000", 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099949+0000", 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099950+0000", 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3500000000000005e-07 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100004+0000", 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3597000000000002e-05 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100017+0000", 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3281999999999999e-05 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100025+0000", 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1259999999999998e-06 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100103+0000", 2024-09-12T18:14:04.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7464000000000002e-05 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100232+0000", 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012914900000000001 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100373+0000", 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000140872 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:62141 5.d e34/21 5:b7d75684:::benchmark_data_smithi062_23645_object62140:head v 34'3914, mlcod=34'3911)", 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.101762+0000", 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.4431000000000006e-05, 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021878800000000001, 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101762+0000", 2024-09-12T18:14:04.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101762+0000", 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101763+0000", 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.057e-06 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101844+0000", 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0810999999999996e-05 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101856+0000", 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2186e-05 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101865+0000", 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5779999999999999e-06 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101915+0000", 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0080999999999997e-05 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101935+0000", 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9740000000000001e-05 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:62126 5.9 5:9928b67c:::benchmark_data_smithi062_23645_object62125:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.094749+0000", 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0070871320000000003, 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0072690610000000003, 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 62126 2024-09-12T18:14:04.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.094749+0000", 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.094749+0000", 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.094750+0000", 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.094810+0000", 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9821000000000002e-05 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.094823+0000", 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2887e-05 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.094840+0000", 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6901e-05 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.097230+0000", 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002389993 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.097358+0000", 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012758999999999999 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.097507+0000", 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014991599999999999 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101873+0000", 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0043653989999999998 2024-09-12T18:14:04.119 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:62128 5.1 5:8e7bf100:::benchmark_data_smithi062_23645_object62127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.095464+0000", 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0063726119999999997, 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0066000030000000001, 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.120 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 62128 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095464+0000", 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095464+0000", 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095465+0000", 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3699999999999999e-07 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095531+0000", 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6618000000000005e-05 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095542+0000", 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.076e-05 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095550+0000", 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.097216+0000", 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001665536 2024-09-12T18:14:04.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.097387+0000", 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017137700000000001 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.097524+0000", 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013677399999999999 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.101984+0000", 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0044603519999999999 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:62129 5.9 5:901ce088:::benchmark_data_smithi062_23645_object62128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.095964+0000", 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0058724470000000003, 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0061387990000000003, 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.125 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 62129 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095964+0000", 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095964+0000", 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.095965+0000", 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8700000000000005e-07 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096045+0000", 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0255999999999999e-05 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096059+0000", 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3356999999999999e-05 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096069+0000", 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0034000000000001e-05 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099812+0000", 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003742993 2024-09-12T18:14:04.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099936+0000", 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012393199999999999 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100066+0000", 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013015999999999999 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:62130 5.1 5:814fdfd4:::benchmark_data_smithi062_23645_object62129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:04.096413+0000", 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0054240130000000001, 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0057270760000000002, 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.130 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 62130 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096413+0000", 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096413+0000", 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096414+0000", 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2200000000000002e-07 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096461+0000", 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7241999999999999e-05 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096472+0000", 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1092e-05 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.096481+0000", 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8659999999999995e-06 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.099804+0000", 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033235399999999998 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100009+0000", 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020491699999999999 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:04.100170+0000", 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00016097999999999999 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:04.134 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:14:04.135 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:04.136 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:04.182 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:04.181+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:04.252 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:04.248+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:04.289 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:04.289 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:04.289 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:04.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:04.350 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:04.349+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:04.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 24 16 62805 62789 163.496 132.625 0.00991852 0.00611182 2024-09-12T18:14:04.451 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:04.448+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:04.509 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:04.509 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:04.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:04.509 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:04.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.509 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.214733797999997, 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:04.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:04.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:04.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 51.410440672, 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.517 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:14:04.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:14:04.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 51.410405496000003, 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.523 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:04.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.114809823000002, 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:04.529 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:04.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.534 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.114716147999999, 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.535 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:04.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:04.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:04.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:04.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:04.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.541 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.114646917999998, 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:04.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:04.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.114556151999999, 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.548 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.550 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.551 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:04.552 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:04.553 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.114495128999998, 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.554 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.555 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.556 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.557 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.558 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:04.559 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.11443637, 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.560 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.561 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.562 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.563 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:04.564 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.565 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.114373319999999, 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.566 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.567 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.568 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.569 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.113572945999998, 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.572 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.573 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:04.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.577 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.113434744000003, 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.578 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.581 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:04.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.113371493999999, 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:04.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:04.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:04.589 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.113272922, 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:04.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:14:04.593 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.594 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.112971526999999, 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.595 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.596 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.597 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:04.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.600 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.112873424999997, 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.601 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:04.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:04.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:04.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:04.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.608 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.608 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.608 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.609 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.112781032999997, 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.610 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:04.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.615 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.112694136000002, 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.112570513999998, 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.621 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:04.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:04.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.626 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 41.112178913999998, 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:04.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:04.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:04.631 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:04.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:04.633 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:04.629+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:04.634 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:04.733 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:04.729+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:63609 5.a e34/21 5:5721ea7c:::benchmark_data_smithi062_23645_object63608:head v 34'3926, mlcod=34'3924)", 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.784770+0000", 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0030911089999999999, 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031079929999999999, 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784770+0000", 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784770+0000", 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784771+0000", 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0599999999999999e-07 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784812+0000", 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0605000000000002e-05 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784827+0000", 2024-09-12T18:14:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5356999999999999e-05 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784834+0000", 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4379999999999998e-06 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784882+0000", 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7286000000000001e-05 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.784897+0000", 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5037e-05 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:63613 5.b 5:d19e29b3:::benchmark_data_smithi062_23645_object63612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.785486+0000", 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0023752959999999998, 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00242859, 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 63613 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785486+0000", 2024-09-12T18:14:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785486+0000", 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785487+0000", 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4499999999999995e-07 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785541+0000", 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4302000000000003e-05 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785552+0000", 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0882e-05 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785573+0000", 2024-09-12T18:14:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1291e-05 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785631+0000", 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7914000000000002e-05 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785811+0000", 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017993300000000001 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785991+0000", 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017961999999999999 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:63614 5.b 5.e2d5eb0b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.785787+0000", 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0020741510000000002, 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021718330000000002, 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 63614 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785787+0000", 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785787+0000", 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785788+0000", 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0299999999999998e-07 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785845+0000", 2024-09-12T18:14:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7596999999999998e-05 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785858+0000", 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2799000000000001e-05 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785866+0000", 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7729999999999999e-06 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:63615 5.4 5:21dadc12:::benchmark_data_smithi062_23645_object63614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.785880+0000", 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0019807890000000002, 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002108356, 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 63615 2024-09-12T18:14:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785880+0000", 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785880+0000", 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785881+0000", 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9400000000000005e-07 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785962+0000", 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0774999999999998e-05 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785972+0000", 2024-09-12T18:14:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0579e-05 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785978+0000", 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7579999999999998e-06 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786024+0000", 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6115000000000001e-05 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786170+0000", 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014561500000000001 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786309+0000", 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013959399999999999 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:63616 5.e 5:71f6828e:::benchmark_data_smithi062_23645_object63615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.785991+0000", 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0018701029999999999, 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002032861, 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 63616 2024-09-12T18:14:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785991+0000", 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785991+0000", 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785992+0000", 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786030+0000", 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8541999999999998e-05 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786038+0000", 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8299999999999996e-06 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786044+0000", 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1720000000000004e-06 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786086+0000", 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2038e-05 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786221+0000", 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000134855 2024-09-12T18:14:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786357+0000", 2024-09-12T18:14:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013589200000000001 2024-09-12T18:14:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:63612 5.9 e34/21 5:9b085166:::benchmark_data_smithi062_23645_object63611:head v 34'3986, mlcod=34'3983)", 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.785918+0000", 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0019430789999999999, 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002138558, 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785918+0000", 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785918+0000", 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.785918+0000", 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2599999999999998e-07 2024-09-12T18:14:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786087+0000", 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016813599999999999 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786094+0000", 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786131+0000", 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.68e-05 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786187+0000", 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5954e-05 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786205+0000", 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8168999999999998e-05 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:63617 5.0 5:02aa6e35:::benchmark_data_smithi062_23645_object63616:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.786512+0000", 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.001349423, 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015734130000000001, 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 63617 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786512+0000", 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786512+0000", 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786513+0000", 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7199999999999998e-07 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786610+0000", 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7633999999999994e-05 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786622+0000", 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2111e-05 2024-09-12T18:14:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786629+0000", 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.951e-06 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786685+0000", 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5730999999999999e-05 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786794+0000", 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000109438 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.786915+0000", 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120244 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:63619 5.e 5.9522b00e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:04.787721+0000", 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.000140326, 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000397286, 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 63619 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.787721+0000", 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.787721+0000", 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.787722+0000", 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7599999999999996e-07 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.787803+0000", 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1026000000000007e-05 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.787817+0000", 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4164e-05 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:04.787826+0000", 2024-09-12T18:14:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9970000000000004e-06 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 8 2024-09-12T18:14:04.825 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:04.826 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:04.826 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:04.827 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:04.827 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:04.827 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:04.834 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:04.832+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:04.841 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:04.842 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:04.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:14:04.937 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:04.933+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:04.984 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:04.984 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:05.004 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:05.036 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:05.036+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:05.137 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:05.133+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:05.199 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:05.199 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:05.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:05.264 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:05.264+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:05.339 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:05.337+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:05.375 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:05.375 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:05.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:05.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 25 16 64922 64906 162.248 132.312 0.00318592 0.00615862 2024-09-12T18:14:05.439 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:05.437+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:05.541 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:05.541+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:05.599 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:05.599 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:05.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:05.668 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:05.668+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:05.743 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:05.741+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:05.773 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:05.773 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:05.795 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:05.829 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:14:05.844 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:05.841+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:05.945 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:05.944+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:05.947 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:05.947 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:05.967 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:06.045 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:06.041+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:06.123 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:06.123 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:06.143 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:06.186 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:06.185+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:06.250 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:06.249+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:06.338 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:06.339 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:06.351 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:06.349+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:06.361 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:06.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 26 16 67000 66984 161.003 129.875 0.00864521 0.00620604 2024-09-12T18:14:06.453 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:06.449+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:06.516 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:06.516 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:06.537 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:06.581 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:06.581+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:06.657 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:06.653+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:06.694 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:06.694 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:06.716 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:06.761 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:06.761+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:06.828 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:14:06.828 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:06.828 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-12T18:14:06.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-12T18:14:06.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:06.862 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:06.857+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:06.907 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:06.907 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:06.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:06.962 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:06.961+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:07.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-12T18:14:07.029 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:07.029 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:07.053 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:07.053 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:07.066 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:07.061+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:07.072 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:07.073 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:07.087 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:07.087 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:07.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.087 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68415 5.e e35/21 5:779888fe:::benchmark_data_smithi062_23645_object68414:head v 35'4282, mlcod=35'4280)", 2024-09-12T18:14:07.087 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.082041+0000", 2024-09-12T18:14:07.087 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0057663749999999998, 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057874720000000001, 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082041+0000", 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082041+0000", 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082041+0000", 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.34e-07 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082157+0000", 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115643 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082163+0000", 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.998e-06 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082166+0000", 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1240000000000001e-06 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082207+0000", 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1369999999999999e-05 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.082225+0000", 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7683e-05 2024-09-12T18:14:07.091 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68410 5.1 e35/21 5:81146ce1:::benchmark_data_smithi062_23645_object68409:head v 35'4330, mlcod=35'4327)", 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.083853+0000", 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0039544130000000004, 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040301640000000001, 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.092 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083853+0000", 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083853+0000", 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083853+0000", 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9999999999999998e-07 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083903+0000", 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9636999999999999e-05 2024-09-12T18:14:07.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083915+0000", 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2081e-05 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083919+0000", 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9400000000000004e-06 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083954+0000", 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5469999999999998e-05 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.083970+0000", 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5804e-05 2024-09-12T18:14:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68419 5.8 e35/21 5:17f794a5:::benchmark_data_smithi062_23645_object68418:head v 35'4329, mlcod=35'4326)", 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.084661+0000", 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031463699999999999, 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032734230000000001, 2024-09-12T18:14:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084661+0000", 2024-09-12T18:14:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084661+0000", 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084661+0000", 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084723+0000", 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1533999999999997e-05 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084730+0000", 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.255e-06 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084734+0000", 2024-09-12T18:14:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9389999999999999e-06 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084765+0000", 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1217999999999998e-05 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.084776+0000", 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0329000000000001e-05 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68420 5.7 e35/21 5:e974e945:::benchmark_data_smithi062_23645_object68419:head v 35'4177, mlcod=35'4175)", 2024-09-12T18:14:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.085168+0000", 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0026392630000000002, 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002813758, 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085168+0000", 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085168+0000", 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085168+0000", 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085221+0000", 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2978e-05 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085229+0000", 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1779999999999997e-06 2024-09-12T18:14:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085232+0000", 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.36e-06 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085279+0000", 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6751e-05 2024-09-12T18:14:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.085290+0000", 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1302e-05 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68418 5.1 e35/21 5:897a18ba:::benchmark_data_smithi062_23645_object68417:head v 35'4331, mlcod=35'4328)", 2024-09-12T18:14:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.086182+0000", 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001625718, 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018497590000000001, 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086182+0000", 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086182+0000", 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086200+0000", 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8541000000000001e-05 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086242+0000", 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2277999999999997e-05 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086255+0000", 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2765999999999999e-05 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086261+0000", 2024-09-12T18:14:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7309999999999998e-06 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086296+0000", 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4789999999999997e-05 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086306+0000", 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0721e-05 2024-09-12T18:14:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68422 5.2 e35/21 5:48c5cc25:::benchmark_data_smithi062_23645_object68421:head v 35'4306, mlcod=35'4304)", 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.086429+0000", 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0013779179999999999, 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001649305, 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086429+0000", 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086429+0000", 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086430+0000", 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9900000000000001e-07 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086500+0000", 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0412000000000003e-05 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086509+0000", 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086514+0000", 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0209999999999999e-06 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086555+0000", 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0858000000000001e-05 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086579+0000", 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3764000000000002e-05 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68423 5.e e35/21 5:776346c1:::benchmark_data_smithi062_23645_object68422:head v 35'4283, mlcod=35'4280)", 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.086588+0000", 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0012194879999999999, 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001541583, 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086588+0000", 2024-09-12T18:14:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086588+0000", 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086588+0000", 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4700000000000002e-07 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086641+0000", 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2893999999999999e-05 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086648+0000", 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1969999999999999e-06 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086653+0000", 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1159999999999998e-06 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086696+0000", 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2953e-05 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.086713+0000", 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6441000000000001e-05 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68421 5.8 e35/21 5:17542f1b:::benchmark_data_smithi062_23645_object68420:head v 35'4330, mlcod=35'4326)", 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.087086+0000", 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00072141800000000004, 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010971430000000001, 2024-09-12T18:14:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087086+0000", 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087086+0000", 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087086+0000", 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8299999999999997e-07 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087152+0000", 2024-09-12T18:14:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5265000000000006e-05 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087158+0000", 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7910000000000001e-06 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087163+0000", 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.84e-06 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087202+0000", 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8138e-05 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087218+0000", 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6314999999999999e-05 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:68425 5.7 e35/21 5:ed152fb5:::benchmark_data_smithi062_23645_object68424:head v 35'4178, mlcod=35'4175)", 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.087767+0000", 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.0745999999999999e-05, 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047183700000000002, 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087767+0000", 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087767+0000", 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087767+0000", 2024-09-12T18:14:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000005e-07 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087834+0000", 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6625999999999995e-05 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087844+0000", 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0281e-05 2024-09-12T18:14:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087849+0000", 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8590000000000004e-06 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087905+0000", 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5481e-05 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.087921+0000", 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6359e-05 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 9 2024-09-12T18:14:07.131 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:07.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:07.167 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:07.165+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:07.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-12T18:14:07.269 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:07.268+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:07.288 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:07.288 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:07.288 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:07.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:07.396 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:07.396+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:07.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 27 16 69089 69073 159.875 130.562 0.00602896 0.00624982 2024-09-12T18:14:07.472 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:07.469+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.104380435000003, 2024-09-12T18:14:07.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:07.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:07.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.100350206000002, 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.511 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:14:07.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.100179969999999, 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:07.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:07.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.100063210999998, 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:07.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:07.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.099994074999998, 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:07.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.099882323000003, 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.534 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:07.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:07.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.099718500999998, 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:07.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:07.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.099657735000001, 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:07.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.264694572, 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:07.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:07.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:15913 5.a 5:5c7723a1:::benchmark_data_smithi062_23645_object15912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.260781084000001, 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015699285, 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 15913 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244785+0000", 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244786+0000", 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244888+0000", 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244894+0000", 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244899+0000", 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9350000000000002e-06 2024-09-12T18:14:07.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244972+0000", 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3316000000000001e-05 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245084+0000", 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111703 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.245200+0000", 2024-09-12T18:14:07.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115406 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259521+0000", 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014321122 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260404+0000", 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088351800000000002 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260457+0000", 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3001000000000003e-05 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.260485+0000", 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7424e-05 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:07.560 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.258930832000001, 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:07.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:07.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.876449285, 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.565 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:07.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:07.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:07.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16965 5.5 5:a0639920:::benchmark_data_smithi062_23645_object16964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.872101961999999, 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015569835000000001, 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16965 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633464+0000", 2024-09-12T18:14:07.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633466+0000", 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-06 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633536+0000", 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0366999999999999e-05 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633546+0000", 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059e-05 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.633552+0000", 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0129999999999999e-06 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646012+0000", 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012459822000000001 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646152+0000", 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013997200000000001 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.646248+0000", 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6335999999999994e-05 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648453+0000", 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022045770000000001 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648912+0000", 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045902200000000001 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648997+0000", 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970999999999997e-05 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649034+0000", 2024-09-12T18:14:07.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7585e-05 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16969 5.5 5:a17db384:::benchmark_data_smithi062_23645_object16968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.871388533000001, 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015671503999999999, 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16969 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634178+0000", 2024-09-12T18:14:07.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634179+0000", 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.119e-06 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634280+0000", 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010138500000000001 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634291+0000", 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.634309+0000", 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.836e-05 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647082+0000", 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012772149999999999 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647205+0000", 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012367500000000001 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.647364+0000", 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015912200000000001 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649290+0000", 2024-09-12T18:14:07.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019254960000000001 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649781+0000", 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049094099999999995 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649812+0000", 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1007000000000003e-05 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.649849+0000", 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7602999999999999e-05 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:61129 5.1 e34/21 5:8eb73760:::benchmark_data_smithi062_23645_object61128:head v 34'3864, mlcod=34'3862)", 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.891731509, 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017014511, 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613902+0000", 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6225999999999999e-05 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613910+0000", 2024-09-12T18:14:07.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3389999999999993e-06 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613917+0000", 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999999e-06 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613972+0000", 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4729999999999999e-05 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613990+0000", 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8097999999999999e-05 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630793+0000", 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016803604 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630849+0000", 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6137999999999997e-05 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.587 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61312 5.3 5:cf9f1323:::benchmark_data_smithi062_23645_object61311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.705313+0000", 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.800252945, 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015722628999999998, 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61312 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705313+0000", 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705313+0000", 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705314+0000", 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705464+0000", 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014927699999999999 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705473+0000", 2024-09-12T18:14:07.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6709999999999994e-06 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.705482+0000", 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.67e-06 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.712402+0000", 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069205710000000004 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.712496+0000", 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3540000000000002e-05 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.712611+0000", 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001149 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716492+0000", 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038808459999999999 2024-09-12T18:14:07.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.720943+0000", 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004451623 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.720996+0000", 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3097999999999999e-05 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721036+0000", 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9601999999999998e-05 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61334 5.3 5:c7866da4:::benchmark_data_smithi062_23645_object61333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.716983+0000", 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.7885838330000001, 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015454413, 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61334 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716983+0000", 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716983+0000", 2024-09-12T18:14:07.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.716984+0000", 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2299999999999999e-07 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.717097+0000", 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113083 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.717107+0000", 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0172e-05 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.717114+0000", 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9249999999999998e-06 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721225+0000", 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041112340000000001 2024-09-12T18:14:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721343+0000", 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118391 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.721625+0000", 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181300000000001 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724326+0000", 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002701143 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732348+0000", 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080216630000000001 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732398+0000", 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9920999999999999e-05 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732437+0000", 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9144999999999999e-05 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.7808141389999999, 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.600 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:07.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:07.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:68555 5.3 5:c0a78847:::benchmark_data_smithi062_23645_object68554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.144962+0000", 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.36060479000000001, 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015839717, 2024-09-12T18:14:07.606 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 68555 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.144962+0000", 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.144962+0000", 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.144963+0000", 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.333e-06 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.145085+0000", 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121635 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.145095+0000", 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0548e-05 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.145102+0000", 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7089999999999996e-06 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.148994+0000", 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00389187 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.149123+0000", 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012925299999999999 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.149250+0000", 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127162 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.154838+0000", 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055874699999999998 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.160728+0000", 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058908090000000003 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.160761+0000", 2024-09-12T18:14:07.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2965e-05 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.160801+0000", 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9962999999999997e-05 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:69118 5.c 5:3c73a29c:::benchmark_data_smithi062_23645_object69117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.089128394, 2024-09-12T18:14:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016585826000000001, 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69118 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:07.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416439+0000", 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:07.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416520+0000", 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1144999999999996e-05 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416530+0000", 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0345e-05 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416537+0000", 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8290000000000002e-06 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:07.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.419825+0000", 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032876820000000001 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.421805+0000", 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019806490000000001 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.422103+0000", 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029764100000000002 2024-09-12T18:14:07.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.426179+0000", 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040759409999999996 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.432963+0000", 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067841280000000004 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433002+0000", 2024-09-12T18:14:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9190000000000003e-05 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433024+0000", 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:07.618 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:07.620 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:07.620 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:07.616+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:07.720 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:07.717+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:69854 5.9 5:9302a0a9:::benchmark_data_smithi062_23645_object69853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:07.771567+0000", 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0054033989999999997, 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0054230099999999998, 2024-09-12T18:14:07.776 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 69854 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771567+0000", 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771567+0000", 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771568+0000", 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3850000000000001e-06 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:07.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771632+0000", 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4008000000000001e-05 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771641+0000", 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8550000000000008e-06 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771648+0000", 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3590000000000002e-06 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771792+0000", 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014390299999999999 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771917+0000", 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012535899999999999 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.772060+0000", 2024-09-12T18:14:07.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014249299999999999 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776002+0000", 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0039421630000000003 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:69855 5.2 5:4dfab5b2:::benchmark_data_smithi062_23645_object69854:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:07.771778+0000", 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0051923230000000004, 2024-09-12T18:14:07.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052578080000000001, 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 69855 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771778+0000", 2024-09-12T18:14:07.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771778+0000", 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771778+0000", 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:07.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771811+0000", 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771819+0000", 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4069999999999993e-06 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771827+0000", 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.503e-06 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.771892+0000", 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5133000000000001e-05 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.772014+0000", 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000121588 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.772347+0000", 2024-09-12T18:14:07.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033294999999999999 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.775523+0000", 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0031766070000000001 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:69859 5.7 5:ea7700f9:::benchmark_data_smithi062_23645_object69858:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:07.786 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:07.774050+0000", 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0029198079999999999, 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003033244, 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 69859 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774050+0000", 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774050+0000", 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774051+0000", 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2130000000000001e-06 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774097+0000", 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5719000000000001e-05 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774110+0000", 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2921e-05 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774118+0000", 2024-09-12T18:14:07.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5170000000000002e-06 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774176+0000", 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8811000000000003e-05 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774268+0000", 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1856999999999998e-05 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:07.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774351+0000", 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2744999999999995e-05 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:69858 5.c e35/21 5:3dc2bd7e:::benchmark_data_smithi062_23645_object69857:head v 35'4266, mlcod=35'4263)", 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:07.774299+0000", 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0026707269999999999, 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028231480000000002, 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:07.791 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774299+0000", 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774299+0000", 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774300+0000", 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774348+0000", 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7922e-05 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774361+0000", 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3681e-05 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774368+0000", 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1510000000000001e-06 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774782+0000", 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00041464399999999998 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774802+0000", 2024-09-12T18:14:07.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9811999999999999e-05 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:69860 5.7 5:e3fa5602:::benchmark_data_smithi062_23645_object69859:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:07.774919+0000", 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020513649999999999, 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002233554, 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:07.795 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 69860 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774919+0000", 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774919+0000", 2024-09-12T18:14:07.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.774919+0000", 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3200000000000004e-07 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.775068+0000", 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148226 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.775076+0000", 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6570000000000003e-06 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.775084+0000", 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4209999999999998e-06 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776529+0000", 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0014455920000000001 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776645+0000", 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000115765 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776743+0000", 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8122999999999995e-05 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.799 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:69861 5.6 e35/21 5:6803b18b:::benchmark_data_smithi062_23645_object69860:head v 35'4366, mlcod=35'4364)", 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:07.776625+0000", 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00034463499999999998, 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00056048100000000004, 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776625+0000", 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776625+0000", 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776626+0000", 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776682+0000", 2024-09-12T18:14:07.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6481999999999999e-05 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776693+0000", 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0267e-05 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776700+0000", 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9759999999999998e-06 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:07.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776740+0000", 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0475999999999997e-05 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:07.776757+0000", 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6456999999999998e-05 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 6 2024-09-12T18:14:07.803 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:07.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:07.821 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:07.820+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:07.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:14:07.922 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:07.921+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:08.002 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:08.002 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:08.002 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:08.002 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:08.002 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:08.023 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:08.024 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:08.021+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:08.128 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:08.121+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:08.224 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:08.224+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:08.228 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:08.228 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:08.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:08.228 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:08.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 55.933165670999998, 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.229 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:08.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 55.128872545, 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.236 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:14:08.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.241 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 55.128837369000003, 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:08.242 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:08.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:08.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.833241696000002, 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.248 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:08.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.254 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.833148021, 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:08.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:08.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.833078790999998, 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:08.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:08.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.266 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.832988024999999, 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:08.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:08.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.832927001999998, 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:08.272 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:08.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:08.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.832868243, 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:08.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.832805192999999, 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:08.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.291 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.832004818999998, 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:08.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831866617000003, 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:08.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:08.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831803366999999, 2024-09-12T18:14:08.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:08.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:08.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831704795, 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.309 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:14:08.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:14:08.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831403399999999, 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:08.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:08.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.320 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831305297999997, 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:08.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.326 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831212905999998, 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:08.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831126009000002, 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:08.332 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:08.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:08.337 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.831002386999998, 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:08.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:08.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 44.830610786999998, 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:08.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.347 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.348 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.348 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:08.348 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:08.348 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:08.349 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:08.345+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:08.350 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:08.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 28 16 71207 71191 158.892 132.375 0.00416098 0.00628882 2024-09-12T18:14:08.450 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:08.448+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:08.503 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:71414 5.8 5:13dddc62:::benchmark_data_smithi062_23645_object71413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.502929+0000", 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0013922330000000001, 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001412211, 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.504 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 71414 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502929+0000", 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502929+0000", 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502929+0000", 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3300000000000001e-07 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503015+0000", 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5425000000000003e-05 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503022+0000", 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7329999999999997e-06 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503026+0000", 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.459e-06 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503884+0000", 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00085797300000000005 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503979+0000", 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4895999999999994e-05 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.504079+0000", 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010038 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.508 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:71416 5.0 5:0ce94d59:::benchmark_data_smithi062_23645_object71415:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.503738+0000", 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00058288999999999997, 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00064666500000000004, 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 71416 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503738+0000", 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503738+0000", 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503739+0000", 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.02e-07 2024-09-12T18:14:08.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503871+0000", 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013228900000000001 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503880+0000", 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2210000000000003e-06 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503887+0000", 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5100000000000004e-06 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.503961+0000", 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4466000000000002e-05 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.504071+0000", 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011000100000000001 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.504194+0000", 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012253200000000001 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:71407 5.e 5:787ea170:::benchmark_data_smithi062_23645_object71406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.499229+0000", 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0050916980000000004, 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051917819999999998, 2024-09-12T18:14:08.513 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 71407 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.499229+0000", 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.499229+0000", 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.499230+0000", 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3399999999999997e-07 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.499331+0000", 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101424 2024-09-12T18:14:08.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.499346+0000", 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4944e-05 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.499355+0000", 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3089999999999996e-06 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501224+0000", 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001869288 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501351+0000", 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127129 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501504+0000", 2024-09-12T18:14:08.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015256100000000001 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:71411 5.8 5:106490ea:::benchmark_data_smithi062_23645_object71410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:08.518 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.501417+0000", 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0029040709999999998, 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030401920000000002, 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 71411 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501417+0000", 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501417+0000", 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501418+0000", 2024-09-12T18:14:08.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6800000000000009e-07 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501479+0000", 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0788000000000001e-05 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501486+0000", 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8180000000000004e-06 2024-09-12T18:14:08.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501491+0000", 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9810000000000003e-06 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501543+0000", 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1916999999999998e-05 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501621+0000", 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8129999999999999e-05 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501703+0000", 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2106000000000003e-05 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:71409 5.9 e35/21 5:9f80245c:::benchmark_data_smithi062_23645_object71408:head v 35'4473, mlcod=35'4470)", 2024-09-12T18:14:08.523 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.501685+0000", 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0026357960000000001, 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028044419999999999, 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501685+0000", 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501685+0000", 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501686+0000", 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.99e-07 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501739+0000", 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3122999999999999e-05 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501747+0000", 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6729999999999998e-06 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501755+0000", 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.712e-06 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501799+0000", 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3968000000000003e-05 2024-09-12T18:14:08.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.501818+0000", 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8431999999999999e-05 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:71410 5.f e35/21 5:ff4fcad9:::benchmark_data_smithi062_23645_object71409:head v 35'4550, mlcod=35'4548)", 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.502368+0000", 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0019532960000000002, 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021485499999999999, 2024-09-12T18:14:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502368+0000", 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502368+0000", 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502368+0000", 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1399999999999997e-07 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502422+0000", 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3572000000000001e-05 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502430+0000", 2024-09-12T18:14:08.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6510000000000007e-06 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502436+0000", 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3369999999999999e-06 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502506+0000", 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0242999999999998e-05 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.502523+0000", 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7076999999999999e-05 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 6 2024-09-12T18:14:08.531 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:08.532 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:08.578 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:08.577+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:08.651 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:08.648+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:08.681 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:08.681 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:14:08.681 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:14:08.681 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:14:08.681 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:08.701 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:08.752 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:08.749+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:08.853 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:08.853+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:08.860 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512703807999998, 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.905 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:08.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:14:08.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:14:08.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:14:08.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:14:08.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:14:08.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:14:08.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512588446000002, 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.916 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:14:08.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:14:08.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:14:08.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.922 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512507479999996, 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:14:08.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:14:08.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512402968000004, 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.930 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:14:08.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:14:08.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:14:08.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.937 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512319024999996, 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.938 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:14:08.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:14:08.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:14:08.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512196078999999, 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:14:08.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:14:08.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:14:08.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:14:08.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:14:08.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:14:08.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512124569999997, 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:14:08.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:14:08.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:14:08.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.962 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.512059669999999, 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:14:08.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:14:08.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.967 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.511990204, 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:14:08.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.497572042999998, 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:14:08.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15908 5.0 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:14:08.977 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.663793993999999, 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018670684, 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15908 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239940+0000", 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239941+0000", 2024-09-12T18:14:08.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6400000000000001e-07 2024-09-12T18:14:08.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239986+0000", 2024-09-12T18:14:08.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5466999999999997e-05 2024-09-12T18:14:08.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.239996+0000", 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6209999999999999e-06 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240002+0000", 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.229e-06 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240369+0000", 2024-09-12T18:14:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036721600000000002 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240554+0000", 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018448100000000001 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.240680+0000", 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012593700000000001 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.242166+0000", 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014860170000000001 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258545+0000", 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01637885 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258579+0000", 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.468e-05 2024-09-12T18:14:08.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.258611+0000", 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1322000000000003e-05 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.658071096, 2024-09-12T18:14:08.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:08.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:14:08.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.990 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15923 5.4 5:217c37e3:::benchmark_data_smithi062_23645_object15922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.656783129000001, 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017388715999999999, 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.991 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15923 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246951+0000", 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246952+0000", 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.95e-07 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247021+0000", 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9080999999999998e-05 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:08.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247032+0000", 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0577999999999999e-05 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.247039+0000", 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3699999999999997e-06 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253374+0000", 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063354919999999999 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253534+0000", 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159421 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.253632+0000", 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8021000000000002e-05 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255738+0000", 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021061550000000002 2024-09-12T18:14:08.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264249+0000", 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085105400000000005 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264301+0000", 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1996999999999997e-05 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:08.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.264340+0000", 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9066000000000002e-05 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16961 5.b 5:d94b6522:::benchmark_data_smithi062_23645_object16960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:08.997 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.272197447, 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016331854, 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16961 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631537+0000", 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:14:08.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631676+0000", 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013913799999999999 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631689+0000", 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2483000000000001e-05 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631694+0000", 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1610000000000002e-06 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631778+0000", 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4529000000000003e-05 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631935+0000", 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000156279 2024-09-12T18:14:09.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632093+0000", 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000157792 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.634146+0000", 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002053301 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647775+0000", 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013628695 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647829+0000", 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4945999999999999e-05 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.647868+0000", 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8914e-05 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:16963 5.4 5:2fa071ac:::benchmark_data_smithi062_23645_object16962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.272028813999999, 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016816028, 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:09.004 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 16963 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631705+0000", 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631706+0000", 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2300000000000002e-07 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631736+0000", 2024-09-12T18:14:09.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0224000000000001e-05 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631741+0000", 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5910000000000003e-06 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631745+0000", 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631788+0000", 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2823e-05 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.631918+0000", 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000129586 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.632010+0000", 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2215999999999999e-05 2024-09-12T18:14:09.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.633704+0000", 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001693784 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648445+0000", 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014741316000000001 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648480+0000", 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4620999999999999e-05 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.648521+0000", 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1631999999999997e-05 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:60531 5.8 5:1fadc516:::benchmark_data_smithi062_23645_object60530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:09.010 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:03.329225+0000", 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.5745086070000003, 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016627389999999999, 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 60531 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.329225+0000", 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.329225+0000", 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.329226+0000", 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5400000000000001e-07 2024-09-12T18:14:09.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.329326+0000", 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100145 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.329334+0000", 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5109999999999997e-06 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.329338+0000", 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8539999999999999e-06 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.337844+0000", 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085069389999999998 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.337972+0000", 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012795600000000001 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.338050+0000", 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7853000000000002e-05 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.344446+0000", 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063954249999999997 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.345758+0000", 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001312775 2024-09-12T18:14:09.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.345817+0000", 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8730999999999997e-05 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:03.345853+0000", 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5546999999999997e-05 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:69316 5.8 5:13dba801:::benchmark_data_smithi062_23645_object69315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:07.512904+0000", 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.3908299340000001, 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016304242, 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.017 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 69316 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.512904+0000", 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.512904+0000", 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.512905+0000", 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0580000000000001e-06 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.512962+0000", 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7145999999999998e-05 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.512976+0000", 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4183e-05 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.512986+0000", 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7690000000000008e-06 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.519145+0000", 2024-09-12T18:14:09.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061587159999999998 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.519289+0000", 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014441399999999999 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.519400+0000", 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110896 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.522880+0000", 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034793469999999998 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.529044+0000", 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061646629999999999 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.529141+0000", 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786000000000005e-05 2024-09-12T18:14:09.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.529208+0000", 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7263999999999998e-05 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:69616 5.e 5:7d63c09a:::benchmark_data_smithi062_23645_object69615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:07.656673+0000", 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.2470610360000001, 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016093224, 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 69616 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.024 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.656673+0000", 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.656673+0000", 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.656673+0000", 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5499999999999999e-07 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.656702+0000", 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9187999999999999e-05 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.656708+0000", 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5779999999999998e-06 2024-09-12T18:14:09.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.656712+0000", 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0620000000000002e-06 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.662198+0000", 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054856269999999999 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.662290+0000", 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2057000000000003e-05 2024-09-12T18:14:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.662438+0000", 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014782400000000001 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.665371+0000", 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029336739999999998 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.672658+0000", 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072863600000000004 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.672720+0000", 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2582000000000005e-05 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:07.672766+0000", 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5917000000000001e-05 2024-09-12T18:14:09.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:70544 5.0 5:0490f13d:::benchmark_data_smithi062_23645_object70543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.091710+0000", 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.81202401499999999, 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018137675999999998, 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:09.030 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 70544 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.091710+0000", 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:09.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.091710+0000", 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.091711+0000", 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0979999999999999e-06 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.091762+0000", 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1405e-05 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.091774+0000", 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1768e-05 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.091781+0000", 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5490000000000003e-06 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.097493+0000", 2024-09-12T18:14:09.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057117660000000001 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.097636+0000", 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014311799999999999 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.097791+0000", 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015543600000000001 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.103501+0000", 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057100750000000002 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.109737+0000", 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062353299999999999 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.109794+0000", 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7361000000000002e-05 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.109848+0000", 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3770000000000002e-05 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:70548 5.0 5:0caafeae:::benchmark_data_smithi062_23645_object70547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:08.092724+0000", 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.81101015700000001, 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017250148, 2024-09-12T18:14:09.036 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 70548 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.092724+0000", 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.092724+0000", 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.092725+0000", 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1900000000000001e-07 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:09.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.092856+0000", 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013141499999999999 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.092866+0000", 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5380000000000008e-06 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.092873+0000", 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1269999999999997e-06 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.099601+0000", 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067278219999999996 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.099683+0000", 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2565999999999995e-05 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.099769+0000", 2024-09-12T18:14:09.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5566e-05 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.103724+0000", 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0039549399999999997 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.109857+0000", 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061335169999999998 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:09.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.109920+0000", 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3252999999999999e-05 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:08.109974+0000", 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3485e-05 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:09.042 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:09.044 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:09.044 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:09.041+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:09.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:09.144 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:09.141+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:09.200 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:09.200 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72854 5.3 5:cf9797eb:::benchmark_data_smithi062_23645_object72853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.195876+0000", 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0051076380000000003, 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051340220000000002, 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72854 2024-09-12T18:14:09.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.195876+0000", 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.195876+0000", 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.195876+0000", 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.195964+0000", 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7083000000000006e-05 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.195973+0000", 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4020000000000008e-06 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.195978+0000", 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2719999999999997e-06 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.197723+0000", 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001745026 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.197812+0000", 2024-09-12T18:14:09.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9060000000000005e-05 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.197902+0000", 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9610000000000004e-05 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:09.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199608+0000", 2024-09-12T18:14:09.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00170648 2024-09-12T18:14:09.206 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.206 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.206 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72855 5.2 e36/21 5:41820ae0:::benchmark_data_smithi062_23645_object72854:head v 36'4588, mlcod=36'4585)", 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.198224+0000", 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027594109999999998, 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028572580000000001, 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198224+0000", 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198224+0000", 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198225+0000", 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198282+0000", 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7192999999999999e-05 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198292+0000", 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0475000000000001e-05 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198298+0000", 2024-09-12T18:14:09.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8610000000000003e-06 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198337+0000", 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9304999999999997e-05 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198351+0000", 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570999999999999e-05 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72856 5.4 e36/21 5:2ef38d49:::benchmark_data_smithi062_23645_object72855:head v 36'4608, mlcod=36'4606)", 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.198245+0000", 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027385539999999998, 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028850220000000001, 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198245+0000", 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198245+0000", 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198246+0000", 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9500000000000001e-07 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198302+0000", 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6443000000000002e-05 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198311+0000", 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0389999999999993e-06 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198317+0000", 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2199999999999997e-06 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198383+0000", 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5446999999999999e-05 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.198401+0000", 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8649000000000001e-05 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.214 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72857 5.5 5:a2eef8ee:::benchmark_data_smithi062_23645_object72856:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.199326+0000", 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001657735, 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001855949, 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72857 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199326+0000", 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199326+0000", 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199327+0000", 2024-09-12T18:14:09.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2580000000000001e-06 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199427+0000", 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100133 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199436+0000", 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4150000000000005e-06 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199444+0000", 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1640000000000004e-06 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199491+0000", 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7623999999999997e-05 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199611+0000", 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120183 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199740+0000", 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857600000000001 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72860 5.6 5:6d72c45d:::benchmark_data_smithi062_23645_object72859:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.199708+0000", 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0012755830000000001, 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015370130000000001, 2024-09-12T18:14:09.219 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72860 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199708+0000", 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199708+0000", 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199708+0000", 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199875+0000", 2024-09-12T18:14:09.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016637299999999999 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199889+0000", 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4069e-05 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199896+0000", 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6750000000000002e-06 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199963+0000", 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6217999999999995e-05 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200058+0000", 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5434999999999997e-05 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200168+0000", 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010984099999999999 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.223 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72858 5.0 e36/21 5:0054ef51:::benchmark_data_smithi062_23645_object72857:head v 36'4538, mlcod=36'4536)", 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.199910+0000", 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001073615, 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001392152, 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199910+0000", 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199910+0000", 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199910+0000", 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:14:09.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199969+0000", 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8684000000000003e-05 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199979+0000", 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6469999999999993e-06 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199985+0000", 2024-09-12T18:14:09.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9510000000000003e-06 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200028+0000", 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3034000000000002e-05 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200043+0000", 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5841e-05 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.227 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72863 5.5 5.7de7f565 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.199989+0000", 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00099419500000000002, 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001358525, 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72863 2024-09-12T18:14:09.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199989+0000", 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199989+0000", 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.199990+0000", 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0599999999999999e-07 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200103+0000", 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113065 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200112+0000", 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000001e-06 2024-09-12T18:14:09.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200120+0000", 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2719999999999997e-06 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72859 5.8 e36/21 5:183b1feb:::benchmark_data_smithi062_23645_object72858:head v 36'4608, mlcod=36'4606)", 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.200105+0000", 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00087811300000000003, 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001288314, 2024-09-12T18:14:09.231 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200105+0000", 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200105+0000", 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:09.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200106+0000", 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3000000000000001e-07 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200163+0000", 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7027000000000001e-05 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200171+0000", 2024-09-12T18:14:09.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0690000000000002e-06 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200176+0000", 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6439999999999997e-06 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200210+0000", 2024-09-12T18:14:09.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4041999999999997e-05 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.200221+0000", 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0985000000000001e-05 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 8 2024-09-12T18:14:09.235 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:09.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:09.245 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:09.241+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:09.305 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:09.305 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:09.324 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:09.324 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:09.343 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:09.343 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:09.346 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:09.345+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:09.394 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:09.394 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:09.401 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 29 16 73279 73263 157.878 129.5 0.00565063 0.0063292 2024-09-12T18:14:09.416 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:09.447 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:09.445+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:09.548 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:09.544+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:09.567 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:09.567 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:09.587 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:09.649 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:09.648+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:09.738 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:09.738 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:09.749 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:09.749+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:09.760 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:09.850 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:09.849+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:09.911 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:09.911 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:09.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:09.951 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:09.949+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:10.052 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:10.049+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:10.129 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:10.130 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:10.149 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:10.153 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:10.149+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:10.255 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:10.253+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:10.305 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:10.306 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:10.325 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:10.373 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:10.373+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:10.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 30 16 75332 75316 156.892 128.312 0.00637371 0.00636902 2024-09-12T18:14:10.455 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:10.453+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:10.523 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:10.523 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:10.545 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:10.556 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:10.553+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:10.657 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:10.653+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:10.693 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:10.693 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:10.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:10.757 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:10.756+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:10.858 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:10.856+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:10.874 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:10.874 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:10.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:14:10.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:10.985 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:10.983+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:11.061 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:11.060+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:11.091 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:11.091 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:11.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:11.162 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:11.160+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:11.264 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:11.260+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:11.303 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:11.303 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:11.325 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:11.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:11.370 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:11.369+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:11.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 31 16 77390 77374 155.979 128.625 0.00879198 0.00640631 2024-09-12T18:14:11.464 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:11.463+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:11.486 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:11.486 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:11.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:11.530 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:11.550 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:11.550 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:11.569 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:11.570 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:11.598 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:11.597+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:11.666 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:11.664+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:11.706 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:11.706 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:11.706 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:11.706 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:11.706 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:11.725 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:11.768 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:11.765+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:11.868 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:11.867+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:11.869 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:14:11.928 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 59.633650981000002, 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.929 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:11.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:11.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:11.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.829357854999998, 2024-09-12T18:14:11.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021818285, 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 51 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:11.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098454+0000", 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098455+0000", 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098461+0000", 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8429999999999998e-06 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098470+0000", 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4839999999999993e-06 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098477+0000", 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:14:11.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115838+0000", 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017361126000000001 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.115984+0000", 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014586199999999999 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.116199+0000", 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021447799999999999 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118859+0000", 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026599969999999999 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120031+0000", 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00117259 2024-09-12T18:14:11.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120206+0000", 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000174255 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.120272+0000", 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6457000000000004e-05 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.829322679000001, 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:11.945 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533727005999999, 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:11.951 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533633330999997, 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:11.957 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.958 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.958 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.958 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:11.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:11.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:11.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.965 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533564101000003, 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:11.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.971 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533473334999996, 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:11.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.977 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533412312000003, 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:11.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:11.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.982 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:11.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533353552999998, 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.984 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:11.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.989 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.533290503000003, 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:11.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:11.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:11.995 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.532490129000003, 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:11.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:11.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:12.001 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.532351927000001, 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:12.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:12.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.532288676999997, 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.008 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:12.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:12.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:12.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:31 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.532190104999998, 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022118623, 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.014 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395622+0000", 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395623+0000", 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395651+0000", 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8257000000000001e-05 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395672+0000", 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0599e-05 2024-09-12T18:14:12.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395689+0000", 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7113999999999999e-05 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397384+0000", 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001695373 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397571+0000", 2024-09-12T18:14:12.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018655500000000001 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400302+0000", 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002731139 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409129+0000", 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0088269219999999992 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417509+0000", 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.008380719 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417643+0000", 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013301200000000001 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417740+0000", 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7652999999999995e-05 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.531888709999997, 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.020 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:12.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:12.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.531790608000001, 2024-09-12T18:14:12.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.032 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.531698216000002, 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:12.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:12.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:12.038 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.531611319, 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:12.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.531487697000003, 2024-09-12T18:14:12.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:12.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:12.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.531096097000002, 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:12.050 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:12.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:12.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:12.054 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:12.056 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:12.053+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:12.056 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:12.156 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:12.155+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(client.4581.0:79122 5.f e37/21 5:fd6434f6:::benchmark_data_smithi062_23645_object79121:head v 37'5039, mlcod=37'5037)", 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.210485+0000", 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0015356549999999999, 2024-09-12T18:14:12.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015509479999999999, 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210485+0000", 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210485+0000", 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210486+0000", 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.16e-07 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210547+0000", 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1132999999999999e-05 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210557+0000", 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2459999999999992e-06 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210564+0000", 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5939999999999996e-06 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210610+0000", 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6248999999999997e-05 2024-09-12T18:14:12.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210623+0000", 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2989e-05 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:79127 5.0 5:0f688564:::benchmark_data_smithi062_23645_object79126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.211561+0000", 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.000459665, 2024-09-12T18:14:12.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051123800000000001, 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 79127 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211561+0000", 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211561+0000", 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211563+0000", 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2929999999999999e-06 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211619+0000", 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6097999999999997e-05 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211628+0000", 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3589999999999997e-06 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211633+0000", 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8980000000000004e-06 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211677+0000", 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3649999999999997e-05 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211781+0000", 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103896 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211864+0000", 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2948000000000006e-05 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.220 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:79128 5.0 5.f52f99b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.211692+0000", 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00032946499999999998, 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000428837, 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 79128 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211692+0000", 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211692+0000", 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211692+0000", 2024-09-12T18:14:12.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211749+0000", 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6919999999999997e-05 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211755+0000", 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.173e-06 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.211760+0000", 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:79108 5.d 5:bfd3029c:::benchmark_data_smithi062_23645_object79107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.203543+0000", 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0084784470000000001, 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0086079639999999992, 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.224 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 79108 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203543+0000", 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203543+0000", 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203544+0000", 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.052e-06 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203615+0000", 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0921999999999996e-05 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203657+0000", 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1865e-05 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203677+0000", 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0214e-05 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203726+0000", 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9274999999999998e-05 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203864+0000", 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013824200000000001 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203994+0000", 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012994300000000001 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.206552+0000", 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025577249999999998 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:79109 5.4 5:210360b4:::benchmark_data_smithi062_23645_object79108:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.203704+0000", 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0083174719999999994, 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084852169999999998, 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 79109 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.230 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203704+0000", 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203704+0000", 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203704+0000", 2024-09-12T18:14:12.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8400000000000004e-07 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203742+0000", 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7568999999999999e-05 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203753+0000", 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1026000000000001e-05 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.203760+0000", 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8759999999999999e-06 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205420+0000", 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001660129 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205545+0000", 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000125442 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205727+0000", 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018181999999999999 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210366+0000", 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046392739999999997 2024-09-12T18:14:12.234 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:79114 5.4 5:2f4b6182:::benchmark_data_smithi062_23645_object79113:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.205766+0000", 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0062548389999999999, 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064589030000000002, 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.235 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 79114 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205766+0000", 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205766+0000", 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205767+0000", 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0139999999999999e-06 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205944+0000", 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000176699 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205956+0000", 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2150000000000001e-05 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.205962+0000", 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5380000000000002e-06 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.208255+0000", 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002293509 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.208417+0000", 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016224800000000001 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.208576+0000", 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015807199999999999 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.210423+0000", 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018476720000000001 2024-09-12T18:14:12.239 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.240 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.240 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.240 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.240 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:14:12.240 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 6 2024-09-12T18:14:12.240 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:12.241 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:12.289 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:12.288+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:12.349 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:14:12.349 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:12.349 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:14:12.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:14:12.358 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:12.355+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:12.394 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:12.394 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:14:12.394 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:14:12.395 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:14:12.395 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:12.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 32 16 79525 79509 155.275 133.438 0.00431263 0.00643529 2024-09-12T18:14:12.417 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:12.460 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:12.455+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:12.560 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:12.555+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:12.614 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:12.614 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:14:12.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:14:12.614 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221906580999999, 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:12.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:14:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:14:12.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221791219000004, 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.621 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:14:12.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.627 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221710252999998, 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:14:12.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:14:12.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:12.634 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221605740999998, 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:14:12.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221521797999998, 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:14:12.641 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:14:12.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.647 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221398852, 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:14:12.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:14:12.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:14:12.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.654 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221327342999999, 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:14:12.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:14:12.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221262443000001, 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:12.661 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:12.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:14:12.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.221192977000001, 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:14:12.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:14:12.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:14:12.672 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.206774815999999, 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:14:12.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:14:12.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.677 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 27.367273869000002, 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.678 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:14:12.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:14:12.683 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72759 5.4 5:2a23e3dd:::benchmark_data_smithi062_23645_object72758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.4647348199999999, 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019309862000000001, 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.684 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72759 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148203+0000", 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.08e-06 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148395+0000", 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000192313 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148404+0000", 2024-09-12T18:14:12.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148410+0000", 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2430000000000002e-06 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150393+0000", 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019825250000000002 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150467+0000", 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3622999999999996e-05 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150561+0000", 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4191999999999995e-05 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.153681+0000", 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031201340000000001 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167403+0000", 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013722447 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167464+0000", 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0825000000000001e-05 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167512+0000", 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7593999999999999e-05 2024-09-12T18:14:12.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72760 5.4 5:2406a1e8:::benchmark_data_smithi062_23645_object72759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.148429+0000", 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.4645077130000002, 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019266359, 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.690 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72760 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148429+0000", 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148429+0000", 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148430+0000", 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3399999999999998e-07 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148468+0000", 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8217999999999999e-05 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148480+0000", 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1766000000000001e-05 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148486+0000", 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.879e-06 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.151980+0000", 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034941619999999999 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.152088+0000", 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108355 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.152238+0000", 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014954700000000001 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.154102+0000", 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018641899999999999 2024-09-12T18:14:12.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167591+0000", 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013488763000000001 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167648+0000", 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6981999999999998e-05 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167695+0000", 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7663000000000001e-05 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72983 5.0 5:094817b2:::benchmark_data_smithi062_23645_object72982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.357304525, 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020466501000000002, 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.696 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72983 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255633+0000", 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8200000000000001e-07 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255698+0000", 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5612999999999997e-05 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255705+0000", 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8040000000000004e-06 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255715+0000", 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8579999999999995e-06 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264776+0000", 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090614019999999997 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264857+0000", 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0699999999999996e-05 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264945+0000", 2024-09-12T18:14:12.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8412000000000007e-05 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274553+0000", 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096073900000000004 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276047+0000", 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001493879 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276076+0000", 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8988000000000001e-05 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276099+0000", 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3073000000000001e-05 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72986 5.0 5:07446845:::benchmark_data_smithi062_23645_object72985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.702 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.353331136, 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019504352999999999, 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72986 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259607+0000", 2024-09-12T18:14:12.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.097e-06 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259667+0000", 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0408999999999997e-05 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259679+0000", 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2216e-05 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259685+0000", 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6210000000000001e-06 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266213+0000", 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00652785 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266348+0000", 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013515399999999999 2024-09-12T18:14:12.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266508+0000", 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159851 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.277410+0000", 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902159999999999 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279012+0000", 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016019610000000001 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279065+0000", 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3263999999999997e-05 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279110+0000", 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.477e-05 2024-09-12T18:14:12.708 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72992 5.0 5:00f4008c:::benchmark_data_smithi062_23645_object72991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.351630627, 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022141033000000001, 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.709 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72992 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:12.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261307+0000", 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2200000000000003e-07 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261386+0000", 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8980999999999995e-05 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261395+0000", 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9900000000000003e-06 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261402+0000", 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0049999999999998e-06 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.269633+0000", 2024-09-12T18:14:12.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082313960000000002 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.269790+0000", 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015663600000000001 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.270114+0000", 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032398799999999999 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.277416+0000", 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.007301676 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283386+0000", 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059702440000000004 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283420+0000", 2024-09-12T18:14:12.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3936000000000002e-05 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283447+0000", 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7359e-05 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72993 5.0 5:027dc36e:::benchmark_data_smithi062_23645_object72992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.349674287, 2024-09-12T18:14:12.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024378153999999999, 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72993 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263263+0000", 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8100000000000002e-07 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263354+0000", 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1252e-05 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263365+0000", 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0471e-05 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263374+0000", 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8820000000000007e-06 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272483+0000", 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091092410000000006 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272619+0000", 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013574 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272784+0000", 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000165241 2024-09-12T18:14:12.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.281089+0000", 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083047180000000009 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287569+0000", 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064803020000000003 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287616+0000", 2024-09-12T18:14:12.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6863999999999997e-05 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287641+0000", 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4762000000000001e-05 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:73000 5.8 5:106cd630:::benchmark_data_smithi062_23645_object72999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:12.721 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.3475925069999999, 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022436998999999999, 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 73000 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:12.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265345+0000", 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4799999999999998e-07 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265399+0000", 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3993000000000003e-05 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265406+0000", 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6059999999999997e-06 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265410+0000", 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9650000000000002e-06 2024-09-12T18:14:12.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274589+0000", 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091783000000000003 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274719+0000", 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013009799999999999 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274877+0000", 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015795199999999999 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283374+0000", 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084975529999999997 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287690+0000", 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00431622 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287741+0000", 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0225000000000001e-05 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287781+0000", 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0538999999999999e-05 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.727 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:73005 5.0 5:0491cc9f:::benchmark_data_smithi062_23645_object73004:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.268681+0000", 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.3442561799999999, 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019107402999999998, 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 73005 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268681+0000", 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268681+0000", 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268682+0000", 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.017e-06 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268763+0000", 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0982000000000005e-05 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268774+0000", 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1698999999999999e-05 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268780+0000", 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.322e-06 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274694+0000", 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059147480000000001 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274793+0000", 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8793000000000001e-05 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274883+0000", 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9660999999999994e-05 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.281093+0000", 2024-09-12T18:14:12.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062106519999999997 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287703+0000", 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066091040000000002 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287750+0000", 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7854e-05 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287788+0000", 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7571000000000003e-05 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:73007 5.0 5:0ea84c13:::benchmark_data_smithi062_23645_object73006:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.268792+0000", 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.3441448729999999, 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019132521999999999, 2024-09-12T18:14:12.734 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 73007 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268792+0000", 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268792+0000", 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268792+0000", 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8400000000000005e-07 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:12.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268851+0000", 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8907999999999999e-05 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268859+0000", 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4719999999999998e-06 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.268863+0000", 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0790000000000002e-06 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276121+0000", 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072579150000000002 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276197+0000", 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6013999999999994e-05 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276277+0000", 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0097000000000002e-05 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.285441+0000", 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091640520000000007 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287839+0000", 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002397723 2024-09-12T18:14:12.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287886+0000", 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7234000000000002e-05 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287924+0000", 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8544000000000002e-05 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.740 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:12.741 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:12.741 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:12.742 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:12.741+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:12.743 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:14:12.743 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:14:12.743 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 37, 2024-09-12T18:14:12.743 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:14:12.743 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-09-12T18:13:00.942825+0000", 2024-09-12T18:14:12.743 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-09-12T18:14:11.859949+0000", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-09-12T18:13:10.269506+0000", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-09-12T18:13:01.815814+0000", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5799936, 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:14:12.744 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 5, 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:10.380891+0000", 2024-09-12T18:14:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:12.746 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.747 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:12.748 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:12.749 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:12.750 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 2, 2024-09-12T18:14:12.751 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 2, 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:16.182185+0000", 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 8193, 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:14:12.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-09-12T18:14:12.753 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:12.754 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 2, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 15, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:12.755 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:12.756 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-09-12T18:14:12.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.5, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.5, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.758 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:20.398999+0000", 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:12.759 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:12.760 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "18", 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:12.761 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:12.762 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:12.763 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:12.764 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.765 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:12.766 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:21.732662+0000", 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:12.767 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:12.768 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:12.769 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2024-09-12T18:14:12.770 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:12.771 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:12.772 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.773 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:12.774 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:12.775 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.776 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 5, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:38.126670+0000", 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:12.777 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 16, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 16, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 16, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 16, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 16, 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:12.778 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "23", 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:12.779 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:12.780 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:12.781 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:12.782 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "rados": {} 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 1, 2024-09-12T18:14:12.783 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 1, 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:14:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "d5348027-f4dc-457f-8b4e-a4341015d874", 2024-09-12T18:14:12.785 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:12.785 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:12.785 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:12.785 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:12.785 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:12.785 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:12.788 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:12.788 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 26, 2024-09-12T18:14:12.788 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6800", 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.789 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6801", 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6802", 2024-09-12T18:14:12.790 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6803", 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:12.791 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6806", 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6807", 2024-09-12T18:14:12.792 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6804", 2024-09-12T18:14:12.793 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6805", 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.794 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.129:6801/1368744816", 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.129:6803/1368744816", 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.129:6807/1368744816", 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.129:6805/1368744816", 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.795 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "939481c0-5bf6-4136-b772-e0ba4c215bf1", 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:12.796 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 21, 2024-09-12T18:14:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6800", 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.798 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6801", 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.799 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6802", 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6803", 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.800 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6806", 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.801 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6807", 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.802 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6804", 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6805", 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.151:6801/1445669154", 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.151:6803/1445669154", 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.151:6807/1445669154", 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.151:6805/1445669154", 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "66fc0ac1-f14f-48bf-a557-110b23bff1d2", 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:12.805 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 33, 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6800", 2024-09-12T18:14:12.806 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6801", 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6802", 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6803", 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6806", 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6807", 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.809 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6804", 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:12.810 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6805", 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.176:6801/752868242", 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.176:6803/752868242", 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.176:6807/752868242", 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.176:6805/752868242", 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:12.811 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.730957+0000", 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.793073+0000", 2024-09-12T18:14:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.762001+0000", 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.814 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [], 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-09-12T18:14:12.815 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-09-12T18:14:12.816 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-09-12T18:14:12.817 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:14:12.817 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:14:12.817 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-09-12T18:14:12.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:12.817 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:14:12.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:12.819 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '5c1106a1-8b30-400f-94eb-0bea28eb5927', 'created': '2024-09-12T18:13:00.942825+0000', 'modified': '2024-09-12T18:14:11.859949+0000', 'last_up_change': '2024-09-12T18:13:10.269506+0000', 'last_in_change': '2024-09-12T18:13:01.815814+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:13:10.380891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:13:16.182185+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:13:20.398999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:13:21.732662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:13:38.126670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'd5348027-f4dc-457f-8b4e-a4341015d874', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 1368744816}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 1368744816}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 1368744816}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 1368744816}]}, 'public_addr': '172.21.15.129:6801/1368744816', 'cluster_addr': '172.21.15.129:6803/1368744816', 'heartbeat_back_addr': '172.21.15.129:6807/1368744816', 'heartbeat_front_addr': '172.21.15.129:6805/1368744816', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '939481c0-5bf6-4136-b772-e0ba4c215bf1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 1445669154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 1445669154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 1445669154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 1445669154}]}, 'public_addr': '172.21.15.151:6801/1445669154', 'cluster_addr': '172.21.15.151:6803/1445669154', 'heartbeat_back_addr': '172.21.15.151:6807/1445669154', 'heartbeat_front_addr': '172.21.15.151:6805/1445669154', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '66fc0ac1-f14f-48bf-a557-110b23bff1d2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6800', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6801', 'nonce': 752868242}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6802', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6803', 'nonce': 752868242}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6806', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6807', 'nonce': 752868242}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6804', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6805', 'nonce': 752868242}]}, 'public_addr': '172.21.15.176:6801/752868242', 'cluster_addr': '172.21.15.176:6803/752868242', 'heartbeat_back_addr': '172.21.15.176:6807/752868242', 'heartbeat_front_addr': '172.21.15.176:6805/752868242', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.730957+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.793073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.762001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:14:12.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:14:12.843 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:12.841+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:12.944 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:12.940+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:12.976 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:12.976 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:12.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.976 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80710 5.4 e37/21 5:238923b8:::benchmark_data_smithi062_23645_object80709:head v 37'5086, mlcod=37'5084)", 2024-09-12T18:14:12.976 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.970063+0000", 2024-09-12T18:14:12.976 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0058909039999999998, 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059087799999999998, 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970063+0000", 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970063+0000", 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970063+0000", 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.75e-07 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970119+0000", 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5504000000000003e-05 2024-09-12T18:14:12.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970127+0000", 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2539999999999992e-06 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970131+0000", 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.403e-06 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970184+0000", 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3174999999999998e-05 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970205+0000", 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0649000000000002e-05 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:12.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80711 5.0 e37/21 5:0cafa9a5:::benchmark_data_smithi062_23645_object80710:head v 37'5010, mlcod=37'5008)", 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.970376+0000", 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0055772310000000002, 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056287029999999997, 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:12.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970376+0000", 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970376+0000", 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970377+0000", 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2599999999999998e-07 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970493+0000", 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011664599999999999 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970499+0000", 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3029999999999996e-06 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970503+0000", 2024-09-12T18:14:12.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9729999999999999e-06 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970542+0000", 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8198999999999998e-05 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970553+0000", 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1698999999999999e-05 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80713 5.c 5:3c391956:::benchmark_data_smithi062_23645_object80712:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.970640+0000", 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0053138389999999999, 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053984649999999999, 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:12.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80713 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970640+0000", 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970640+0000", 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970641+0000", 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.175e-06 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970732+0000", 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1701999999999997e-05 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:12.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970744+0000", 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1168e-05 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970750+0000", 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5100000000000004e-06 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:12.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970803+0000", 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3146000000000002e-05 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.970945+0000", 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141769 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971088+0000", 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014275299999999999 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973539+0000", 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024507349999999999 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80712 5.e e37/21 5:7fc14efa:::benchmark_data_smithi062_23645_object80711:head v 37'5057, mlcod=37'5053)", 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.971169+0000", 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047840579999999999, 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004906919, 2024-09-12T18:14:12.991 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971169+0000", 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971169+0000", 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971170+0000", 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4600000000000005e-07 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971233+0000", 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3381999999999997e-05 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:12.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971241+0000", 2024-09-12T18:14:12.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.208e-06 2024-09-12T18:14:12.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:12.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971247+0000", 2024-09-12T18:14:12.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:12.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971332+0000", 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5816999999999995e-05 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971356+0000", 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.357e-05 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80714 5.a 5:53e82517:::benchmark_data_smithi062_23645_object80713:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.971845+0000", 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0041087340000000002, 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042665380000000003, 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:12.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80714 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971845+0000", 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971845+0000", 2024-09-12T18:14:12.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971845+0000", 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8100000000000002e-07 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971897+0000", 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1174000000000002e-05 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971908+0000", 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0883999999999999e-05 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971915+0000", 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3560000000000004e-06 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971975+0000", 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0392e-05 2024-09-12T18:14:13.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972160+0000", 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000184802 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972308+0000", 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014789 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80715 5.b e37/21 5:d803d8d2:::benchmark_data_smithi062_23645_object80714:head v 37'4919, mlcod=37'4915)", 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.972545+0000", 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0034083289999999999, 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035999719999999999, 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972545+0000", 2024-09-12T18:14:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972545+0000", 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972546+0000", 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0100000000000004e-07 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972601+0000", 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5625999999999999e-05 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972610+0000", 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.901e-06 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972616+0000", 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7939999999999999e-06 2024-09-12T18:14:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974157+0000", 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001541197 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974181+0000", 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3295e-05 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80717 5.3 5:ccd27547:::benchmark_data_smithi062_23645_object80716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.973826+0000", 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00212787, 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002349088, 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80717 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.007 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973826+0000", 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973826+0000", 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973826+0000", 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2200000000000002e-07 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973929+0000", 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010245 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973936+0000", 2024-09-12T18:14:13.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973951+0000", 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4124999999999999e-05 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.975923+0000", 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019722189999999999 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.976070+0000", 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014677599999999999 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80718 5.6 5:6aac1fa9:::benchmark_data_smithi062_23645_object80717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.974050+0000", 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0019035370000000001, 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021613769999999999, 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.011 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80718 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974050+0000", 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974050+0000", 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974051+0000", 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1209999999999999e-06 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974185+0000", 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134313 2024-09-12T18:14:13.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974199+0000", 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3847e-05 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974207+0000", 2024-09-12T18:14:13.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0739999999999993e-06 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974255+0000", 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7491000000000003e-05 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974332+0000", 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7658999999999996e-05 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974468+0000", 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013602800000000001 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80716 5.8 e37/21 5:1afb8c29:::benchmark_data_smithi062_23645_object80715:head v 37'5068, mlcod=37'5066)", 2024-09-12T18:14:13.016 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.974448+0000", 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001505263, 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001800458, 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974448+0000", 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974448+0000", 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974449+0000", 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0600000000000001e-07 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974487+0000", 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8012999999999997e-05 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974493+0000", 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4359999999999999e-06 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974498+0000", 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0250000000000002e-06 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974529+0000", 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1217999999999998e-05 2024-09-12T18:14:13.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974544+0000", 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.484e-05 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80720 5.5 5:ac9db076:::benchmark_data_smithi062_23645_object80719:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.974587+0000", 2024-09-12T18:14:13.020 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001366843, 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017165870000000001, 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80720 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974587+0000", 2024-09-12T18:14:13.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974587+0000", 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974588+0000", 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4900000000000004e-07 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974718+0000", 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013081 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974731+0000", 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3087e-05 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974739+0000", 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7919999999999993e-06 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974802+0000", 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2958000000000003e-05 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974941+0000", 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013835 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.975068+0000", 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127861 2024-09-12T18:14:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80704 5.3 5:c3ac6f8f:::benchmark_data_smithi062_23645_object80703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.965387+0000", 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010566581, 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010966472999999999, 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.025 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80704 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965387+0000", 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965387+0000", 2024-09-12T18:14:13.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965388+0000", 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3500000000000005e-07 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965542+0000", 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015419899999999999 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965552+0000", 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7780000000000002e-06 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965559+0000", 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9070000000000001e-06 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.965891+0000", 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033228700000000001 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966010+0000", 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118855 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966238+0000", 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022785899999999999 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971611+0000", 2024-09-12T18:14:13.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053733820000000003 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80707 5.3 5:c704ff9e:::benchmark_data_smithi062_23645_object80706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.966090+0000", 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0098636839999999993, 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010301466, 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80707 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966090+0000", 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966090+0000", 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966091+0000", 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1100000000000004e-07 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966162+0000", 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0998e-05 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966173+0000", 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1508000000000001e-05 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966181+0000", 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6229999999999997e-06 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971770+0000", 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055895099999999998 2024-09-12T18:14:13.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.971949+0000", 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000178522 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.973991+0000", 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020424029999999999 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:80708 5.a 5:5393c5c8:::benchmark_data_smithi062_23645_object80707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.966222+0000", 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0097317849999999997, 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0102045, 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 80708 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966222+0000", 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966222+0000", 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966222+0000", 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4099999999999998e-07 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966280+0000", 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7302000000000001e-05 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966289+0000", 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3309999999999993e-06 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.966295+0000", 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000004e-06 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.969358+0000", 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003062127 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.969503+0000", 2024-09-12T18:14:13.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014582399999999999 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.969647+0000", 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014332700000000001 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.974489+0000", 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048426179999999999 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80705 5.b e37/21 5:d5fdf019:::benchmark_data_smithi062_23645_object80704:head v 37'4917, mlcod=37'4913)", 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.967303+0000", 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.008650072, 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091676220000000003, 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.967303+0000", 2024-09-12T18:14:13.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.967303+0000", 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.967304+0000", 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1300000000000001e-07 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.967334+0000", 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0460999999999999e-05 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.967341+0000", 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4699999999999999e-06 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.967345+0000", 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.969495+0000", 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021497059999999999 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.969511+0000", 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6694e-05 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:80706 5.b e37/21 5:d01fddfe:::benchmark_data_smithi062_23645_object80705:head v 37'4918, mlcod=37'4913)", 2024-09-12T18:14:13.043 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:12.968296+0000", 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0076572990000000002, 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082062439999999997, 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.968296+0000", 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.968296+0000", 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.968297+0000", 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.968354+0000", 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7055999999999997e-05 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.968366+0000", 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.237e-05 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.968373+0000", 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5969999999999997e-06 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972097+0000", 2024-09-12T18:14:13.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037241259999999999 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:12.972117+0000", 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9621999999999999e-05 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 15 2024-09-12T18:14:13.047 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:13.049 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:13.049 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:13.047+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:13.150 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:13.147+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:13.155 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:14:13.158 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:14:13.174 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-12T18:14:12.350302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4942138269,"num_objects":75428,"num_object_clones":0,"num_object_copies":150856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75428,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":75594,"num_write_kb":4828416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60656,"ondisk_log_size":60656,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":815936,"kb_used_data":596040,"kb_used_omap":4,"kb_used_meta":219835,"kb_avail":282299584,"statfs":{"total":289910292480,"available":289074774016,"internally_reserved":0,"allocated":610344960,"data_stored":9746409080,"data_compressed":8338244,"data_compressed_allocated":609124352,"data_compressed_original":9745956864,"omap_allocated":4785,"internal_metadata":225111375},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":681902080,"num_objects":10405,"num_object_clones":0,"num_object_copies":20810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10405,"num_write_kb":665920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.518848"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865479+0000","last_change":"2024-09-12T18:13:23.425789+0000","last_active":"2024-09-12T18:14:08.865479+0000","last_peered":"2024-09-12T18:14:08.865479+0000","last_clean":"2024-09-12T18:14:08.865479+0000","last_became_active":"2024-09-12T18:13:23.423414+0000","last_became_peered":"2024-09-12T18:13:23.423414+0000","last_unstale":"2024-09-12T18:14:08.865479+0000","last_undegraded":"2024-09-12T18:14:08.865479+0000","last_fullsized":"2024-09-12T18:14:08.865479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864588+0000","last_change":"2024-09-12T18:13:23.428771+0000","last_active":"2024-09-12T18:14:08.864588+0000","last_peered":"2024-09-12T18:14:08.864588+0000","last_clean":"2024-09-12T18:14:08.864588+0000","last_became_active":"2024-09-12T18:13:23.426685+0000","last_became_peered":"2024-09-12T18:13:23.426685+0000","last_unstale":"2024-09-12T18:14:08.864588+0000","last_undegraded":"2024-09-12T18:14:08.864588+0000","last_fullsized":"2024-09-12T18:14:08.864588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:28.043135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862402+0000","last_change":"2024-09-12T18:13:23.430314+0000","last_active":"2024-09-12T18:14:08.862402+0000","last_peered":"2024-09-12T18:14:08.862402+0000","last_clean":"2024-09-12T18:14:08.862402+0000","last_became_active":"2024-09-12T18:13:23.429485+0000","last_became_peered":"2024-09-12T18:13:23.429485+0000","last_unstale":"2024-09-12T18:14:08.862402+0000","last_undegraded":"2024-09-12T18:14:08.862402+0000","last_fullsized":"2024-09-12T18:14:08.862402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:18.415018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862200+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:14:08.862200+0000","last_peered":"2024-09-12T18:14:08.862200+0000","last_clean":"2024-09-12T18:14:08.862200+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:14:08.862200+0000","last_undegraded":"2024-09-12T18:14:08.862200+0000","last_fullsized":"2024-09-12T18:14:08.862200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865094+0000","last_change":"2024-09-12T18:13:23.410285+0000","last_active":"2024-09-12T18:14:08.865094+0000","last_peered":"2024-09-12T18:14:08.865094+0000","last_clean":"2024-09-12T18:14:08.865094+0000","last_became_active":"2024-09-12T18:13:23.409311+0000","last_became_peered":"2024-09-12T18:13:23.409311+0000","last_unstale":"2024-09-12T18:14:08.865094+0000","last_undegraded":"2024-09-12T18:14:08.865094+0000","last_fullsized":"2024-09-12T18:14:08.865094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861616+0000","last_change":"2024-09-12T18:13:23.415977+0000","last_active":"2024-09-12T18:14:08.861616+0000","last_peered":"2024-09-12T18:14:08.861616+0000","last_clean":"2024-09-12T18:14:08.861616+0000","last_became_active":"2024-09-12T18:13:23.414768+0000","last_became_peered":"2024-09-12T18:13:23.414768+0000","last_unstale":"2024-09-12T18:14:08.861616+0000","last_undegraded":"2024-09-12T18:14:08.861616+0000","last_fullsized":"2024-09-12T18:14:08.861616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861628+0000","last_change":"2024-09-12T18:14:02.828262+0000","last_active":"2024-09-12T18:14:08.861628+0000","last_peered":"2024-09-12T18:14:08.861628+0000","last_clean":"2024-09-12T18:14:08.861628+0000","last_became_active":"2024-09-12T18:14:02.828011+0000","last_became_peered":"2024-09-12T18:14:02.828011+0000","last_unstale":"2024-09-12T18:14:08.861628+0000","last_undegraded":"2024-09-12T18:14:08.861628+0000","last_fullsized":"2024-09-12T18:14:08.861628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:26.084753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861270+0000","last_change":"2024-09-12T18:13:23.411382+0000","last_active":"2024-09-12T18:14:08.861270+0000","last_peered":"2024-09-12T18:14:08.861270+0000","last_clean":"2024-09-12T18:14:08.861270+0000","last_became_active":"2024-09-12T18:13:23.409591+0000","last_became_peered":"2024-09-12T18:13:23.409591+0000","last_unstale":"2024-09-12T18:14:08.861270+0000","last_undegraded":"2024-09-12T18:14:08.861270+0000","last_fullsized":"2024-09-12T18:14:08.861270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:13.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864729+0000","last_change":"2024-09-12T18:13:23.422293+0000","last_active":"2024-09-12T18:14:08.864729+0000","last_peered":"2024-09-12T18:14:08.864729+0000","last_clean":"2024-09-12T18:14:08.864729+0000","last_became_active":"2024-09-12T18:13:23.420814+0000","last_became_peered":"2024-09-12T18:13:23.420814+0000","last_unstale":"2024-09-12T18:14:08.864729+0000","last_undegraded":"2024-09-12T18:14:08.864729+0000","last_fullsized":"2024-09-12T18:14:08.864729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:25.194753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864925+0000","last_change":"2024-09-12T18:13:23.428337+0000","last_active":"2024-09-12T18:14:08.864925+0000","last_peered":"2024-09-12T18:14:08.864925+0000","last_clean":"2024-09-12T18:14:08.864925+0000","last_became_active":"2024-09-12T18:13:23.426368+0000","last_became_peered":"2024-09-12T18:13:23.426368+0000","last_unstale":"2024-09-12T18:14:08.864925+0000","last_undegraded":"2024-09-12T18:14:08.864925+0000","last_fullsized":"2024-09-12T18:14:08.864925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862479+0000","last_change":"2024-09-12T18:13:23.408317+0000","last_active":"2024-09-12T18:14:08.862479+0000","last_peered":"2024-09-12T18:14:08.862479+0000","last_clean":"2024-09-12T18:14:08.862479+0000","last_became_active":"2024-09-12T18:13:23.406670+0000","last_became_peered":"2024-09-12T18:13:23.406670+0000","last_unstale":"2024-09-12T18:14:08.862479+0000","last_undegraded":"2024-09-12T18:14:08.862479+0000","last_fullsized":"2024-09-12T18:14:08.862479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:52.451403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864644+0000","last_change":"2024-09-12T18:13:23.423819+0000","last_active":"2024-09-12T18:14:08.864644+0000","last_peered":"2024-09-12T18:14:08.864644+0000","last_clean":"2024-09-12T18:14:08.864644+0000","last_became_active":"2024-09-12T18:13:23.420977+0000","last_became_peered":"2024-09-12T18:13:23.420977+0000","last_unstale":"2024-09-12T18:14:08.864644+0000","last_undegraded":"2024-09-12T18:14:08.864644+0000","last_fullsized":"2024-09-12T18:14:08.864644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:11.642559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864878+0000","last_change":"2024-09-12T18:13:23.420831+0000","last_active":"2024-09-12T18:14:08.864878+0000","last_peered":"2024-09-12T18:14:08.864878+0000","last_clean":"2024-09-12T18:14:08.864878+0000","last_became_active":"2024-09-12T18:13:23.420073+0000","last_became_peered":"2024-09-12T18:13:23.420073+0000","last_unstale":"2024-09-12T18:14:08.864878+0000","last_undegraded":"2024-09-12T18:14:08.864878+0000","last_fullsized":"2024-09-12T18:14:08.864878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:19.521219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861720+0000","last_change":"2024-09-12T18:13:23.423999+0000","last_active":"2024-09-12T18:14:08.861720+0000","last_peered":"2024-09-12T18:14:08.861720+0000","last_clean":"2024-09-12T18:14:08.861720+0000","last_became_active":"2024-09-12T18:13:23.419784+0000","last_became_peered":"2024-09-12T18:13:23.419784+0000","last_unstale":"2024-09-12T18:14:08.861720+0000","last_undegraded":"2024-09-12T18:14:08.861720+0000","last_fullsized":"2024-09-12T18:14:08.861720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:25.556607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862495+0000","last_change":"2024-09-12T18:13:23.423808+0000","last_active":"2024-09-12T18:14:08.862495+0000","last_peered":"2024-09-12T18:14:08.862495+0000","last_clean":"2024-09-12T18:14:08.862495+0000","last_became_active":"2024-09-12T18:13:23.420954+0000","last_became_peered":"2024-09-12T18:13:23.420954+0000","last_unstale":"2024-09-12T18:14:08.862495+0000","last_undegraded":"2024-09-12T18:14:08.862495+0000","last_fullsized":"2024-09-12T18:14:08.862495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861369+0000","last_change":"2024-09-12T18:13:23.411704+0000","last_active":"2024-09-12T18:14:08.861369+0000","last_peered":"2024-09-12T18:14:08.861369+0000","last_clean":"2024-09-12T18:14:08.861369+0000","last_became_active":"2024-09-12T18:13:23.409671+0000","last_became_peered":"2024-09-12T18:13:23.409671+0000","last_unstale":"2024-09-12T18:14:08.861369+0000","last_undegraded":"2024-09-12T18:14:08.861369+0000","last_fullsized":"2024-09-12T18:14:08.861369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:00.321370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865406+0000","last_change":"2024-09-12T18:13:23.415308+0000","last_active":"2024-09-12T18:14:08.865406+0000","last_peered":"2024-09-12T18:14:08.865406+0000","last_clean":"2024-09-12T18:14:08.865406+0000","last_became_active":"2024-09-12T18:13:23.414071+0000","last_became_peered":"2024-09-12T18:13:23.414071+0000","last_unstale":"2024-09-12T18:14:08.865406+0000","last_undegraded":"2024-09-12T18:14:08.865406+0000","last_fullsized":"2024-09-12T18:14:08.865406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865115+0000","last_change":"2024-09-12T18:13:23.428108+0000","last_active":"2024-09-12T18:14:08.865115+0000","last_peered":"2024-09-12T18:14:08.865115+0000","last_clean":"2024-09-12T18:14:08.865115+0000","last_became_active":"2024-09-12T18:13:23.424030+0000","last_became_peered":"2024-09-12T18:13:23.424030+0000","last_unstale":"2024-09-12T18:14:08.865115+0000","last_undegraded":"2024-09-12T18:14:08.865115+0000","last_fullsized":"2024-09-12T18:14:08.865115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.867341+0000","last_change":"2024-09-12T18:13:23.429790+0000","last_active":"2024-09-12T18:14:08.867341+0000","last_peered":"2024-09-12T18:14:08.867341+0000","last_clean":"2024-09-12T18:14:08.867341+0000","last_became_active":"2024-09-12T18:13:23.429102+0000","last_became_peered":"2024-09-12T18:13:23.429102+0000","last_unstale":"2024-09-12T18:14:08.867341+0000","last_undegraded":"2024-09-12T18:14:08.867341+0000","last_fullsized":"2024-09-12T18:14:08.867341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:10.086048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862200+0000","last_change":"2024-09-12T18:13:23.411494+0000","last_active":"2024-09-12T18:14:08.862200+0000","last_peered":"2024-09-12T18:14:08.862200+0000","last_clean":"2024-09-12T18:14:08.862200+0000","last_became_active":"2024-09-12T18:13:23.409867+0000","last_became_peered":"2024-09-12T18:13:23.409867+0000","last_unstale":"2024-09-12T18:14:08.862200+0000","last_undegraded":"2024-09-12T18:14:08.862200+0000","last_fullsized":"2024-09-12T18:14:08.862200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:30.302536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862006+0000","last_change":"2024-09-12T18:13:23.416089+0000","last_active":"2024-09-12T18:14:08.862006+0000","last_peered":"2024-09-12T18:14:08.862006+0000","last_clean":"2024-09-12T18:14:08.862006+0000","last_became_active":"2024-09-12T18:13:23.415322+0000","last_became_peered":"2024-09-12T18:13:23.415322+0000","last_unstale":"2024-09-12T18:14:08.862006+0000","last_undegraded":"2024-09-12T18:14:08.862006+0000","last_fullsized":"2024-09-12T18:14:08.862006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.407860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864422+0000","last_change":"2024-09-12T18:13:23.419383+0000","last_active":"2024-09-12T18:14:08.864422+0000","last_peered":"2024-09-12T18:14:08.864422+0000","last_clean":"2024-09-12T18:14:08.864422+0000","last_became_active":"2024-09-12T18:13:23.417481+0000","last_became_peered":"2024-09-12T18:13:23.417481+0000","last_unstale":"2024-09-12T18:14:08.864422+0000","last_undegraded":"2024-09-12T18:14:08.864422+0000","last_fullsized":"2024-09-12T18:14:08.864422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865113+0000","last_change":"2024-09-12T18:13:23.416587+0000","last_active":"2024-09-12T18:14:08.865113+0000","last_peered":"2024-09-12T18:14:08.865113+0000","last_clean":"2024-09-12T18:14:08.865113+0000","last_became_active":"2024-09-12T18:13:23.414572+0000","last_became_peered":"2024-09-12T18:13:23.414572+0000","last_unstale":"2024-09-12T18:14:08.865113+0000","last_undegraded":"2024-09-12T18:14:08.865113+0000","last_fullsized":"2024-09-12T18:14:08.865113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:23.113662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864176+0000","last_change":"2024-09-12T18:13:23.423404+0000","last_active":"2024-09-12T18:14:08.864176+0000","last_peered":"2024-09-12T18:14:08.864176+0000","last_clean":"2024-09-12T18:14:08.864176+0000","last_became_active":"2024-09-12T18:13:23.422583+0000","last_became_peered":"2024-09-12T18:13:23.422583+0000","last_unstale":"2024-09-12T18:14:08.864176+0000","last_undegraded":"2024-09-12T18:14:08.864176+0000","last_fullsized":"2024-09-12T18:14:08.864176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:14.363786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865518+0000","last_change":"2024-09-12T18:13:23.431872+0000","last_active":"2024-09-12T18:14:08.865518+0000","last_peered":"2024-09-12T18:14:08.865518+0000","last_clean":"2024-09-12T18:14:08.865518+0000","last_became_active":"2024-09-12T18:13:23.430783+0000","last_became_peered":"2024-09-12T18:13:23.430783+0000","last_unstale":"2024-09-12T18:14:08.865518+0000","last_undegraded":"2024-09-12T18:14:08.865518+0000","last_fullsized":"2024-09-12T18:14:08.865518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865042+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:14:08.865042+0000","last_peered":"2024-09-12T18:14:08.865042+0000","last_clean":"2024-09-12T18:14:08.865042+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:14:08.865042+0000","last_undegraded":"2024-09-12T18:14:08.865042+0000","last_fullsized":"2024-09-12T18:14:08.865042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862588+0000","last_change":"2024-09-12T18:13:23.420805+0000","last_active":"2024-09-12T18:14:08.862588+0000","last_peered":"2024-09-12T18:14:08.862588+0000","last_clean":"2024-09-12T18:14:08.862588+0000","last_became_active":"2024-09-12T18:13:23.419019+0000","last_became_peered":"2024-09-12T18:13:23.419019+0000","last_unstale":"2024-09-12T18:14:08.862588+0000","last_undegraded":"2024-09-12T18:14:08.862588+0000","last_fullsized":"2024-09-12T18:14:08.862588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:11.886102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865060+0000","last_change":"2024-09-12T18:13:23.422858+0000","last_active":"2024-09-12T18:14:08.865060+0000","last_peered":"2024-09-12T18:14:08.865060+0000","last_clean":"2024-09-12T18:14:08.865060+0000","last_became_active":"2024-09-12T18:13:23.420120+0000","last_became_peered":"2024-09-12T18:13:23.420120+0000","last_unstale":"2024-09-12T18:14:08.865060+0000","last_undegraded":"2024-09-12T18:14:08.865060+0000","last_fullsized":"2024-09-12T18:14:08.865060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:39.628972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864664+0000","last_change":"2024-09-12T18:13:23.408431+0000","last_active":"2024-09-12T18:14:08.864664+0000","last_peered":"2024-09-12T18:14:08.864664+0000","last_clean":"2024-09-12T18:14:08.864664+0000","last_became_active":"2024-09-12T18:13:23.407297+0000","last_became_peered":"2024-09-12T18:13:23.407297+0000","last_unstale":"2024-09-12T18:14:08.864664+0000","last_undegraded":"2024-09-12T18:14:08.864664+0000","last_fullsized":"2024-09-12T18:14:08.864664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.996840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864680+0000","last_change":"2024-09-12T18:13:23.419395+0000","last_active":"2024-09-12T18:14:08.864680+0000","last_peered":"2024-09-12T18:14:08.864680+0000","last_clean":"2024-09-12T18:14:08.864680+0000","last_became_active":"2024-09-12T18:13:23.418330+0000","last_became_peered":"2024-09-12T18:13:23.418330+0000","last_unstale":"2024-09-12T18:14:08.864680+0000","last_undegraded":"2024-09-12T18:14:08.864680+0000","last_fullsized":"2024-09-12T18:14:08.864680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865207+0000","last_change":"2024-09-12T18:13:23.407925+0000","last_active":"2024-09-12T18:14:08.865207+0000","last_peered":"2024-09-12T18:14:08.865207+0000","last_clean":"2024-09-12T18:14:08.865207+0000","last_became_active":"2024-09-12T18:13:23.406790+0000","last_became_peered":"2024-09-12T18:13:23.406790+0000","last_unstale":"2024-09-12T18:14:08.865207+0000","last_undegraded":"2024-09-12T18:14:08.865207+0000","last_fullsized":"2024-09-12T18:14:08.865207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:44.927266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861447+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:14:08.861447+0000","last_peered":"2024-09-12T18:14:08.861447+0000","last_clean":"2024-09-12T18:14:08.861447+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:14:08.861447+0000","last_undegraded":"2024-09-12T18:14:08.861447+0000","last_fullsized":"2024-09-12T18:14:08.861447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864883+0000","last_change":"2024-09-12T18:13:23.412728+0000","last_active":"2024-09-12T18:14:08.864883+0000","last_peered":"2024-09-12T18:14:08.864883+0000","last_clean":"2024-09-12T18:14:08.864883+0000","last_became_active":"2024-09-12T18:13:23.411996+0000","last_became_peered":"2024-09-12T18:13:23.411996+0000","last_unstale":"2024-09-12T18:14:08.864883+0000","last_undegraded":"2024-09-12T18:14:08.864883+0000","last_fullsized":"2024-09-12T18:14:08.864883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:28.901910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862139+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:14:08.862139+0000","last_peered":"2024-09-12T18:14:08.862139+0000","last_clean":"2024-09-12T18:14:08.862139+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:14:08.862139+0000","last_undegraded":"2024-09-12T18:14:08.862139+0000","last_fullsized":"2024-09-12T18:14:08.862139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864849+0000","last_change":"2024-09-12T18:13:23.426625+0000","last_active":"2024-09-12T18:14:08.864849+0000","last_peered":"2024-09-12T18:14:08.864849+0000","last_clean":"2024-09-12T18:14:08.864849+0000","last_became_active":"2024-09-12T18:13:23.425857+0000","last_became_peered":"2024-09-12T18:13:23.425857+0000","last_unstale":"2024-09-12T18:14:08.864849+0000","last_undegraded":"2024-09-12T18:14:08.864849+0000","last_fullsized":"2024-09-12T18:14:08.864849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864836+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:14:08.864836+0000","last_peered":"2024-09-12T18:14:08.864836+0000","last_clean":"2024-09-12T18:14:08.864836+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:14:08.864836+0000","last_undegraded":"2024-09-12T18:14:08.864836+0000","last_fullsized":"2024-09-12T18:14:08.864836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865338+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:14:08.865338+0000","last_peered":"2024-09-12T18:14:08.865338+0000","last_clean":"2024-09-12T18:14:08.865338+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:14:08.865338+0000","last_undegraded":"2024-09-12T18:14:08.865338+0000","last_fullsized":"2024-09-12T18:14:08.865338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864323+0000","last_change":"2024-09-12T18:13:22.413570+0000","last_active":"2024-09-12T18:14:08.864323+0000","last_peered":"2024-09-12T18:14:08.864323+0000","last_clean":"2024-09-12T18:14:08.864323+0000","last_became_active":"2024-09-12T18:13:22.412182+0000","last_became_peered":"2024-09-12T18:13:22.412182+0000","last_unstale":"2024-09-12T18:14:08.864323+0000","last_undegraded":"2024-09-12T18:14:08.864323+0000","last_fullsized":"2024-09-12T18:14:08.864323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864816+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:14:08.864816+0000","last_peered":"2024-09-12T18:14:08.864816+0000","last_clean":"2024-09-12T18:14:08.864816+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:14:08.864816+0000","last_undegraded":"2024-09-12T18:14:08.864816+0000","last_fullsized":"2024-09-12T18:14:08.864816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861521+0000","last_change":"2024-09-12T18:13:22.410901+0000","last_active":"2024-09-12T18:14:08.861521+0000","last_peered":"2024-09-12T18:14:08.861521+0000","last_clean":"2024-09-12T18:14:08.861521+0000","last_became_active":"2024-09-12T18:13:22.410171+0000","last_became_peered":"2024-09-12T18:13:22.410171+0000","last_unstale":"2024-09-12T18:14:08.861521+0000","last_undegraded":"2024-09-12T18:14:08.861521+0000","last_fullsized":"2024-09-12T18:14:08.861521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.589625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"36'4706","reported_seq":4745,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.439275+0000","last_change":"2024-09-12T18:13:39.302813+0000","last_active":"2024-09-12T18:14:10.439275+0000","last_peered":"2024-09-12T18:14:10.439275+0000","last_clean":"2024-09-12T18:14:10.439275+0000","last_became_active":"2024-09-12T18:13:39.302410+0000","last_became_peered":"2024-09-12T18:13:39.302410+0000","last_unstale":"2024-09-12T18:14:10.439275+0000","last_undegraded":"2024-09-12T18:14:10.439275+0000","last_fullsized":"2024-09-12T18:14:10.439275+0000","mapping_epoch":21,"log_start":"25'1000","ondisk_log_start":"25'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:44.866987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":308412416,"num_objects":4706,"num_object_clones":0,"num_object_copies":9412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4706,"num_write_kb":301184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865428+0000","last_change":"2024-09-12T18:13:22.411056+0000","last_active":"2024-09-12T18:14:08.865428+0000","last_peered":"2024-09-12T18:14:08.865428+0000","last_clean":"2024-09-12T18:14:08.865428+0000","last_became_active":"2024-09-12T18:13:22.410381+0000","last_became_peered":"2024-09-12T18:13:22.410381+0000","last_unstale":"2024-09-12T18:14:08.865428+0000","last_undegraded":"2024-09-12T18:14:08.865428+0000","last_fullsized":"2024-09-12T18:14:08.865428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:36.837900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864277+0000","last_change":"2024-09-12T18:13:23.420695+0000","last_active":"2024-09-12T18:14:08.864277+0000","last_peered":"2024-09-12T18:14:08.864277+0000","last_clean":"2024-09-12T18:14:08.864277+0000","last_became_active":"2024-09-12T18:13:23.418567+0000","last_became_peered":"2024-09-12T18:13:23.418567+0000","last_unstale":"2024-09-12T18:14:08.864277+0000","last_undegraded":"2024-09-12T18:14:08.864277+0000","last_fullsized":"2024-09-12T18:14:08.864277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"36'4768","reported_seq":4807,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.439865+0000","last_change":"2024-09-12T18:13:39.307524+0000","last_active":"2024-09-12T18:14:10.439865+0000","last_peered":"2024-09-12T18:14:10.439865+0000","last_clean":"2024-09-12T18:14:10.439865+0000","last_became_active":"2024-09-12T18:13:39.306702+0000","last_became_peered":"2024-09-12T18:13:39.306702+0000","last_unstale":"2024-09-12T18:14:10.439865+0000","last_undegraded":"2024-09-12T18:14:10.439865+0000","last_fullsized":"2024-09-12T18:14:10.439865+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:45.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312475648,"num_objects":4768,"num_object_clones":0,"num_object_copies":9536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4768,"num_write_kb":305152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865159+0000","last_change":"2024-09-12T18:13:22.414864+0000","last_active":"2024-09-12T18:14:08.865159+0000","last_peered":"2024-09-12T18:14:08.865159+0000","last_clean":"2024-09-12T18:14:08.865159+0000","last_became_active":"2024-09-12T18:13:22.413966+0000","last_became_peered":"2024-09-12T18:13:22.413966+0000","last_unstale":"2024-09-12T18:14:08.865159+0000","last_undegraded":"2024-09-12T18:14:08.865159+0000","last_fullsized":"2024-09-12T18:14:08.865159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.724371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864209+0000","last_change":"2024-09-12T18:13:23.416894+0000","last_active":"2024-09-12T18:14:08.864209+0000","last_peered":"2024-09-12T18:14:08.864209+0000","last_clean":"2024-09-12T18:14:08.864209+0000","last_became_active":"2024-09-12T18:13:23.412840+0000","last_became_peered":"2024-09-12T18:13:23.412840+0000","last_unstale":"2024-09-12T18:14:08.864209+0000","last_undegraded":"2024-09-12T18:14:08.864209+0000","last_fullsized":"2024-09-12T18:14:08.864209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.404714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"36'4607","reported_seq":4646,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.421669+0000","last_change":"2024-09-12T18:13:39.307176+0000","last_active":"2024-09-12T18:14:10.421669+0000","last_peered":"2024-09-12T18:14:10.421669+0000","last_clean":"2024-09-12T18:14:10.421669+0000","last_became_active":"2024-09-12T18:13:39.306405+0000","last_became_peered":"2024-09-12T18:13:39.306405+0000","last_unstale":"2024-09-12T18:14:10.421669+0000","last_undegraded":"2024-09-12T18:14:10.421669+0000","last_fullsized":"2024-09-12T18:14:10.421669+0000","mapping_epoch":21,"log_start":"24'600","ondisk_log_start":"24'600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":4007,"log_dups_size":0,"ondisk_log_size":4007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301924352,"num_objects":4607,"num_object_clones":0,"num_object_copies":9214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4607,"num_write_kb":294848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862789+0000","last_change":"2024-09-12T18:13:22.411821+0000","last_active":"2024-09-12T18:14:08.862789+0000","last_peered":"2024-09-12T18:14:08.862789+0000","last_clean":"2024-09-12T18:14:08.862789+0000","last_became_active":"2024-09-12T18:13:22.411040+0000","last_became_peered":"2024-09-12T18:13:22.411040+0000","last_unstale":"2024-09-12T18:14:08.862789+0000","last_undegraded":"2024-09-12T18:14:08.862789+0000","last_fullsized":"2024-09-12T18:14:08.862789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:57.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861835+0000","last_change":"2024-09-12T18:13:23.416394+0000","last_active":"2024-09-12T18:14:08.861835+0000","last_peered":"2024-09-12T18:14:08.861835+0000","last_clean":"2024-09-12T18:14:08.861835+0000","last_became_active":"2024-09-12T18:13:23.415533+0000","last_became_peered":"2024-09-12T18:13:23.415533+0000","last_unstale":"2024-09-12T18:14:08.861835+0000","last_undegraded":"2024-09-12T18:14:08.861835+0000","last_fullsized":"2024-09-12T18:14:08.861835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:39.086721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"36'4602","reported_seq":4640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.431931+0000","last_change":"2024-09-12T18:13:39.304569+0000","last_active":"2024-09-12T18:14:10.431931+0000","last_peered":"2024-09-12T18:14:10.431931+0000","last_clean":"2024-09-12T18:14:10.431931+0000","last_became_active":"2024-09-12T18:13:39.303719+0000","last_became_peered":"2024-09-12T18:13:39.303719+0000","last_unstale":"2024-09-12T18:14:10.431931+0000","last_undegraded":"2024-09-12T18:14:10.431931+0000","last_fullsized":"2024-09-12T18:14:10.431931+0000","mapping_epoch":21,"log_start":"26'1000","ondisk_log_start":"26'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:27.784587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301596672,"num_objects":4602,"num_object_clones":0,"num_object_copies":9204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4602,"num_write_kb":294528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862476+0000","last_change":"2024-09-12T18:13:22.415915+0000","last_active":"2024-09-12T18:14:08.862476+0000","last_peered":"2024-09-12T18:14:08.862476+0000","last_clean":"2024-09-12T18:14:08.862476+0000","last_became_active":"2024-09-12T18:13:22.415209+0000","last_became_peered":"2024-09-12T18:13:22.415209+0000","last_unstale":"2024-09-12T18:14:08.862476+0000","last_undegraded":"2024-09-12T18:14:08.862476+0000","last_fullsized":"2024-09-12T18:14:08.862476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:53.832471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864689+0000","last_change":"2024-09-12T18:13:23.414215+0000","last_active":"2024-09-12T18:14:08.864689+0000","last_peered":"2024-09-12T18:14:08.864689+0000","last_clean":"2024-09-12T18:14:08.864689+0000","last_became_active":"2024-09-12T18:13:23.413017+0000","last_became_peered":"2024-09-12T18:13:23.413017+0000","last_unstale":"2024-09-12T18:14:08.864689+0000","last_undegraded":"2024-09-12T18:14:08.864689+0000","last_fullsized":"2024-09-12T18:14:08.864689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:39.843814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"36'4748","reported_seq":4787,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.440673+0000","last_change":"2024-09-12T18:13:39.304500+0000","last_active":"2024-09-12T18:14:10.440673+0000","last_peered":"2024-09-12T18:14:10.440673+0000","last_clean":"2024-09-12T18:14:10.440673+0000","last_became_active":"2024-09-12T18:13:39.303780+0000","last_became_peered":"2024-09-12T18:13:39.303780+0000","last_unstale":"2024-09-12T18:14:10.440673+0000","last_undegraded":"2024-09-12T18:14:10.440673+0000","last_fullsized":"2024-09-12T18:14:10.440673+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3948,"log_dups_size":0,"ondisk_log_size":3948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:21.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311164928,"num_objects":4748,"num_object_clones":0,"num_object_copies":9496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4748,"num_write_kb":303872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864849+0000","last_change":"2024-09-12T18:13:22.411218+0000","last_active":"2024-09-12T18:14:08.864849+0000","last_peered":"2024-09-12T18:14:08.864849+0000","last_clean":"2024-09-12T18:14:08.864849+0000","last_became_active":"2024-09-12T18:13:22.408809+0000","last_became_peered":"2024-09-12T18:13:22.408809+0000","last_unstale":"2024-09-12T18:14:08.864849+0000","last_undegraded":"2024-09-12T18:14:08.864849+0000","last_fullsized":"2024-09-12T18:14:08.864849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:18.480325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862352+0000","last_change":"2024-09-12T18:13:23.415662+0000","last_active":"2024-09-12T18:14:08.862352+0000","last_peered":"2024-09-12T18:14:08.862352+0000","last_clean":"2024-09-12T18:14:08.862352+0000","last_became_active":"2024-09-12T18:13:23.414867+0000","last_became_peered":"2024-09-12T18:13:23.414867+0000","last_unstale":"2024-09-12T18:14:08.862352+0000","last_undegraded":"2024-09-12T18:14:08.862352+0000","last_fullsized":"2024-09-12T18:14:08.862352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:43.223892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"36'4632","reported_seq":4671,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.409597+0000","last_change":"2024-09-12T18:13:39.304504+0000","last_active":"2024-09-12T18:14:10.409597+0000","last_peered":"2024-09-12T18:14:10.409597+0000","last_clean":"2024-09-12T18:14:10.409597+0000","last_became_active":"2024-09-12T18:13:39.302178+0000","last_became_peered":"2024-09-12T18:13:39.302178+0000","last_unstale":"2024-09-12T18:14:10.409597+0000","last_undegraded":"2024-09-12T18:14:10.409597+0000","last_fullsized":"2024-09-12T18:14:10.409597+0000","mapping_epoch":21,"log_start":"26'1100","ondisk_log_start":"26'1100","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:51.728022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303562752,"num_objects":4632,"num_object_clones":0,"num_object_copies":9264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4632,"num_write_kb":296448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862045+0000","last_change":"2024-09-12T18:13:22.413861+0000","last_active":"2024-09-12T18:14:08.862045+0000","last_peered":"2024-09-12T18:14:08.862045+0000","last_clean":"2024-09-12T18:14:08.862045+0000","last_became_active":"2024-09-12T18:13:22.413154+0000","last_became_peered":"2024-09-12T18:13:22.413154+0000","last_unstale":"2024-09-12T18:14:08.862045+0000","last_undegraded":"2024-09-12T18:14:08.862045+0000","last_fullsized":"2024-09-12T18:14:08.862045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:33.713858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862705+0000","last_change":"2024-09-12T18:13:23.429621+0000","last_active":"2024-09-12T18:14:08.862705+0000","last_peered":"2024-09-12T18:14:08.862705+0000","last_clean":"2024-09-12T18:14:08.862705+0000","last_became_active":"2024-09-12T18:13:23.427873+0000","last_became_peered":"2024-09-12T18:13:23.427873+0000","last_unstale":"2024-09-12T18:14:08.862705+0000","last_undegraded":"2024-09-12T18:14:08.862705+0000","last_fullsized":"2024-09-12T18:14:08.862705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.168059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"36'4801","reported_seq":4840,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.446715+0000","last_change":"2024-09-12T18:13:39.303893+0000","last_active":"2024-09-12T18:14:10.446715+0000","last_peered":"2024-09-12T18:14:10.446715+0000","last_clean":"2024-09-12T18:14:10.446715+0000","last_became_active":"2024-09-12T18:13:39.303338+0000","last_became_peered":"2024-09-12T18:13:39.303338+0000","last_unstale":"2024-09-12T18:14:10.446715+0000","last_undegraded":"2024-09-12T18:14:10.446715+0000","last_fullsized":"2024-09-12T18:14:10.446715+0000","mapping_epoch":21,"log_start":"26'1000","ondisk_log_start":"26'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:12.283961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314638336,"num_objects":4801,"num_object_clones":0,"num_object_copies":9602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4801,"num_write_kb":307264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864360+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:14:08.864360+0000","last_peered":"2024-09-12T18:14:08.864360+0000","last_clean":"2024-09-12T18:14:08.864360+0000","last_became_active":"2024-09-12T18:13:22.413813+0000","last_became_peered":"2024-09-12T18:13:22.413813+0000","last_unstale":"2024-09-12T18:14:08.864360+0000","last_undegraded":"2024-09-12T18:14:08.864360+0000","last_fullsized":"2024-09-12T18:14:08.864360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:45.381651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864967+0000","last_change":"2024-09-12T18:13:23.420465+0000","last_active":"2024-09-12T18:14:08.864967+0000","last_peered":"2024-09-12T18:14:08.864967+0000","last_clean":"2024-09-12T18:14:08.864967+0000","last_became_active":"2024-09-12T18:13:23.419246+0000","last_became_peered":"2024-09-12T18:13:23.419246+0000","last_unstale":"2024-09-12T18:14:08.864967+0000","last_undegraded":"2024-09-12T18:14:08.864967+0000","last_fullsized":"2024-09-12T18:14:08.864967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:39.802590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"36'4713","reported_seq":4752,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.427709+0000","last_change":"2024-09-12T18:13:39.307337+0000","last_active":"2024-09-12T18:14:10.427709+0000","last_peered":"2024-09-12T18:14:10.427709+0000","last_clean":"2024-09-12T18:14:10.427709+0000","last_became_active":"2024-09-12T18:13:39.306607+0000","last_became_peered":"2024-09-12T18:13:39.306607+0000","last_unstale":"2024-09-12T18:14:10.427709+0000","last_undegraded":"2024-09-12T18:14:10.427709+0000","last_fullsized":"2024-09-12T18:14:10.427709+0000","mapping_epoch":21,"log_start":"24'700","ondisk_log_start":"24'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":4013,"log_dups_size":0,"ondisk_log_size":4013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:48.160767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":308871168,"num_objects":4713,"num_object_clones":0,"num_object_copies":9426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4713,"num_write_kb":301632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864283+0000","last_change":"2024-09-12T18:13:22.411589+0000","last_active":"2024-09-12T18:14:08.864283+0000","last_peered":"2024-09-12T18:14:08.864283+0000","last_clean":"2024-09-12T18:14:08.864283+0000","last_became_active":"2024-09-12T18:13:22.410855+0000","last_became_peered":"2024-09-12T18:13:22.410855+0000","last_unstale":"2024-09-12T18:14:08.864283+0000","last_undegraded":"2024-09-12T18:14:08.864283+0000","last_fullsized":"2024-09-12T18:14:08.864283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:43.515260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864852+0000","last_change":"2024-09-12T18:13:23.421387+0000","last_active":"2024-09-12T18:14:08.864852+0000","last_peered":"2024-09-12T18:14:08.864852+0000","last_clean":"2024-09-12T18:14:08.864852+0000","last_became_active":"2024-09-12T18:13:23.419407+0000","last_became_peered":"2024-09-12T18:13:23.419407+0000","last_unstale":"2024-09-12T18:14:08.864852+0000","last_undegraded":"2024-09-12T18:14:08.864852+0000","last_fullsized":"2024-09-12T18:14:08.864852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:18.436537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"36'4759","reported_seq":4798,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.410819+0000","last_change":"2024-09-12T18:13:39.308661+0000","last_active":"2024-09-12T18:14:10.410819+0000","last_peered":"2024-09-12T18:14:10.410819+0000","last_clean":"2024-09-12T18:14:10.410819+0000","last_became_active":"2024-09-12T18:13:39.306758+0000","last_became_peered":"2024-09-12T18:13:39.306758+0000","last_unstale":"2024-09-12T18:14:10.410819+0000","last_undegraded":"2024-09-12T18:14:10.410819+0000","last_fullsized":"2024-09-12T18:14:10.410819+0000","mapping_epoch":21,"log_start":"24'800","ondisk_log_start":"24'800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3959,"log_dups_size":0,"ondisk_log_size":3959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:07.495377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311885824,"num_objects":4759,"num_object_clones":0,"num_object_copies":9518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4759,"num_write_kb":304576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861728+0000","last_change":"2024-09-12T18:13:12.946515+0000","last_active":"2024-09-12T18:14:08.861728+0000","last_peered":"2024-09-12T18:14:08.861728+0000","last_clean":"2024-09-12T18:14:08.861728+0000","last_became_active":"2024-09-12T18:13:12.943868+0000","last_became_peered":"2024-09-12T18:13:12.943868+0000","last_unstale":"2024-09-12T18:14:08.861728+0000","last_undegraded":"2024-09-12T18:14:08.861728+0000","last_fullsized":"2024-09-12T18:14:08.861728+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:11.024494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862272+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:14:08.862272+0000","last_peered":"2024-09-12T18:14:08.862272+0000","last_clean":"2024-09-12T18:14:08.862272+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:14:08.862272+0000","last_undegraded":"2024-09-12T18:14:08.862272+0000","last_fullsized":"2024-09-12T18:14:08.862272+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865121+0000","last_change":"2024-09-12T18:13:22.407501+0000","last_active":"2024-09-12T18:14:08.865121+0000","last_peered":"2024-09-12T18:14:08.865121+0000","last_clean":"2024-09-12T18:14:08.865121+0000","last_became_active":"2024-09-12T18:13:22.406329+0000","last_became_peered":"2024-09-12T18:13:22.406329+0000","last_unstale":"2024-09-12T18:14:08.865121+0000","last_undegraded":"2024-09-12T18:14:08.865121+0000","last_fullsized":"2024-09-12T18:14:08.865121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:57.015216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862688+0000","last_change":"2024-09-12T18:13:23.430192+0000","last_active":"2024-09-12T18:14:08.862688+0000","last_peered":"2024-09-12T18:14:08.862688+0000","last_clean":"2024-09-12T18:14:08.862688+0000","last_became_active":"2024-09-12T18:13:23.428824+0000","last_became_peered":"2024-09-12T18:13:23.428824+0000","last_unstale":"2024-09-12T18:14:08.862688+0000","last_undegraded":"2024-09-12T18:14:08.862688+0000","last_fullsized":"2024-09-12T18:14:08.862688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:35.829536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"36'4623","reported_seq":4662,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.446640+0000","last_change":"2024-09-12T18:13:39.304779+0000","last_active":"2024-09-12T18:14:10.446640+0000","last_peered":"2024-09-12T18:14:10.446640+0000","last_clean":"2024-09-12T18:14:10.446640+0000","last_became_active":"2024-09-12T18:13:39.304291+0000","last_became_peered":"2024-09-12T18:13:39.304291+0000","last_unstale":"2024-09-12T18:14:10.446640+0000","last_undegraded":"2024-09-12T18:14:10.446640+0000","last_fullsized":"2024-09-12T18:14:10.446640+0000","mapping_epoch":21,"log_start":"25'900","ondisk_log_start":"25'900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3723,"log_dups_size":0,"ondisk_log_size":3723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:56.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302972928,"num_objects":4623,"num_object_clones":0,"num_object_copies":9246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4623,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4623,"num_write_kb":295872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861663+0000","last_change":"2024-09-12T18:13:19.360455+0000","last_active":"2024-09-12T18:14:08.861663+0000","last_peered":"2024-09-12T18:14:08.861663+0000","last_clean":"2024-09-12T18:14:08.861663+0000","last_became_active":"2024-09-12T18:13:17.349901+0000","last_became_peered":"2024-09-12T18:13:17.349901+0000","last_unstale":"2024-09-12T18:14:08.861663+0000","last_undegraded":"2024-09-12T18:14:08.861663+0000","last_fullsized":"2024-09-12T18:14:08.861663+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:34.668785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865508+0000","last_change":"2024-09-12T18:13:22.404668+0000","last_active":"2024-09-12T18:14:08.865508+0000","last_peered":"2024-09-12T18:14:08.865508+0000","last_clean":"2024-09-12T18:14:08.865508+0000","last_became_active":"2024-09-12T18:13:22.403909+0000","last_became_peered":"2024-09-12T18:13:22.403909+0000","last_unstale":"2024-09-12T18:14:08.865508+0000","last_undegraded":"2024-09-12T18:14:08.865508+0000","last_fullsized":"2024-09-12T18:14:08.865508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:18.075759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865052+0000","last_change":"2024-09-12T18:13:23.427629+0000","last_active":"2024-09-12T18:14:08.865052+0000","last_peered":"2024-09-12T18:14:08.865052+0000","last_clean":"2024-09-12T18:14:08.865052+0000","last_became_active":"2024-09-12T18:13:23.425301+0000","last_became_peered":"2024-09-12T18:13:23.425301+0000","last_unstale":"2024-09-12T18:14:08.865052+0000","last_undegraded":"2024-09-12T18:14:08.865052+0000","last_fullsized":"2024-09-12T18:14:08.865052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'4675","reported_seq":4713,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.429704+0000","last_change":"2024-09-12T18:13:39.304331+0000","last_active":"2024-09-12T18:14:10.429704+0000","last_peered":"2024-09-12T18:14:10.429704+0000","last_clean":"2024-09-12T18:14:10.429704+0000","last_became_active":"2024-09-12T18:13:39.303195+0000","last_became_peered":"2024-09-12T18:13:39.303195+0000","last_unstale":"2024-09-12T18:14:10.429704+0000","last_undegraded":"2024-09-12T18:14:10.429704+0000","last_fullsized":"2024-09-12T18:14:10.429704+0000","mapping_epoch":21,"log_start":"26'1100","ondisk_log_start":"26'1100","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:21.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306380800,"num_objects":4675,"num_object_clones":0,"num_object_copies":9350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4675,"num_write_kb":299200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865617+0000","last_change":"2024-09-12T18:13:19.357727+0000","last_active":"2024-09-12T18:14:08.865617+0000","last_peered":"2024-09-12T18:14:08.865617+0000","last_clean":"2024-09-12T18:14:08.865617+0000","last_became_active":"2024-09-12T18:13:17.350786+0000","last_became_peered":"2024-09-12T18:13:17.350786+0000","last_unstale":"2024-09-12T18:14:08.865617+0000","last_undegraded":"2024-09-12T18:14:08.865617+0000","last_fullsized":"2024-09-12T18:14:08.865617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:27.623783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864482+0000","last_change":"2024-09-12T18:13:22.406925+0000","last_active":"2024-09-12T18:14:08.864482+0000","last_peered":"2024-09-12T18:14:08.864482+0000","last_clean":"2024-09-12T18:14:08.864482+0000","last_became_active":"2024-09-12T18:13:22.406100+0000","last_became_peered":"2024-09-12T18:13:22.406100+0000","last_unstale":"2024-09-12T18:14:08.864482+0000","last_undegraded":"2024-09-12T18:14:08.864482+0000","last_fullsized":"2024-09-12T18:14:08.864482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865131+0000","last_change":"2024-09-12T18:13:23.421844+0000","last_active":"2024-09-12T18:14:08.865131+0000","last_peered":"2024-09-12T18:14:08.865131+0000","last_clean":"2024-09-12T18:14:08.865131+0000","last_became_active":"2024-09-12T18:13:23.420609+0000","last_became_peered":"2024-09-12T18:13:23.420609+0000","last_unstale":"2024-09-12T18:14:08.865131+0000","last_undegraded":"2024-09-12T18:14:08.865131+0000","last_fullsized":"2024-09-12T18:14:08.865131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:52.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"36'4785","reported_seq":4824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.413868+0000","last_change":"2024-09-12T18:13:39.303887+0000","last_active":"2024-09-12T18:14:10.413868+0000","last_peered":"2024-09-12T18:14:10.413868+0000","last_clean":"2024-09-12T18:14:10.413868+0000","last_became_active":"2024-09-12T18:13:39.303308+0000","last_became_peered":"2024-09-12T18:13:39.303308+0000","last_unstale":"2024-09-12T18:14:10.413868+0000","last_undegraded":"2024-09-12T18:14:10.413868+0000","last_fullsized":"2024-09-12T18:14:10.413868+0000","mapping_epoch":21,"log_start":"26'1200","ondisk_log_start":"26'1200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3585,"log_dups_size":0,"ondisk_log_size":3585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:51.598853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":313589760,"num_objects":4785,"num_object_clones":0,"num_object_copies":9570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4785,"num_write_kb":306240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862071+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:14:08.862071+0000","last_peered":"2024-09-12T18:14:08.862071+0000","last_clean":"2024-09-12T18:14:08.862071+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:14:08.862071+0000","last_undegraded":"2024-09-12T18:14:08.862071+0000","last_fullsized":"2024-09-12T18:14:08.862071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862168+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:14:08.862168+0000","last_peered":"2024-09-12T18:14:08.862168+0000","last_clean":"2024-09-12T18:14:08.862168+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:14:08.862168+0000","last_undegraded":"2024-09-12T18:14:08.862168+0000","last_fullsized":"2024-09-12T18:14:08.862168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865327+0000","last_change":"2024-09-12T18:13:23.421299+0000","last_active":"2024-09-12T18:14:08.865327+0000","last_peered":"2024-09-12T18:14:08.865327+0000","last_clean":"2024-09-12T18:14:08.865327+0000","last_became_active":"2024-09-12T18:13:23.420509+0000","last_became_peered":"2024-09-12T18:13:23.420509+0000","last_unstale":"2024-09-12T18:14:08.865327+0000","last_undegraded":"2024-09-12T18:14:08.865327+0000","last_fullsized":"2024-09-12T18:14:08.865327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'4761","reported_seq":4800,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.422434+0000","last_change":"2024-09-12T18:13:39.303725+0000","last_active":"2024-09-12T18:14:10.422434+0000","last_peered":"2024-09-12T18:14:10.422434+0000","last_clean":"2024-09-12T18:14:10.422434+0000","last_became_active":"2024-09-12T18:13:39.302101+0000","last_became_peered":"2024-09-12T18:13:39.302101+0000","last_unstale":"2024-09-12T18:14:10.422434+0000","last_undegraded":"2024-09-12T18:14:10.422434+0000","last_fullsized":"2024-09-12T18:14:10.422434+0000","mapping_epoch":21,"log_start":"27'1200","ondisk_log_start":"27'1200","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:45.066545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312016896,"num_objects":4761,"num_object_clones":0,"num_object_copies":9522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4761,"num_write_kb":304704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862816+0000","last_change":"2024-09-12T18:13:22.418188+0000","last_active":"2024-09-12T18:14:08.862816+0000","last_peered":"2024-09-12T18:14:08.862816+0000","last_clean":"2024-09-12T18:14:08.862816+0000","last_became_active":"2024-09-12T18:13:22.417712+0000","last_became_peered":"2024-09-12T18:13:22.417712+0000","last_unstale":"2024-09-12T18:14:08.862816+0000","last_undegraded":"2024-09-12T18:14:08.862816+0000","last_fullsized":"2024-09-12T18:14:08.862816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.682492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865518+0000","last_change":"2024-09-12T18:13:19.358233+0000","last_active":"2024-09-12T18:14:08.865518+0000","last_peered":"2024-09-12T18:14:08.865518+0000","last_clean":"2024-09-12T18:14:08.865518+0000","last_became_active":"2024-09-12T18:13:17.350796+0000","last_became_peered":"2024-09-12T18:13:17.350796+0000","last_unstale":"2024-09-12T18:14:08.865518+0000","last_undegraded":"2024-09-12T18:14:08.865518+0000","last_fullsized":"2024-09-12T18:14:08.865518+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:54.562807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864534+0000","last_change":"2024-09-12T18:13:23.418275+0000","last_active":"2024-09-12T18:14:08.864534+0000","last_peered":"2024-09-12T18:14:08.864534+0000","last_clean":"2024-09-12T18:14:08.864534+0000","last_became_active":"2024-09-12T18:13:23.417303+0000","last_became_peered":"2024-09-12T18:13:23.417303+0000","last_unstale":"2024-09-12T18:14:08.864534+0000","last_undegraded":"2024-09-12T18:14:08.864534+0000","last_fullsized":"2024-09-12T18:14:08.864534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:08.786394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"36'4760","reported_seq":4799,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.426873+0000","last_change":"2024-09-12T18:13:39.298632+0000","last_active":"2024-09-12T18:14:10.426873+0000","last_peered":"2024-09-12T18:14:10.426873+0000","last_clean":"2024-09-12T18:14:10.426873+0000","last_became_active":"2024-09-12T18:13:39.298316+0000","last_became_peered":"2024-09-12T18:13:39.298316+0000","last_unstale":"2024-09-12T18:14:10.426873+0000","last_undegraded":"2024-09-12T18:14:10.426873+0000","last_fullsized":"2024-09-12T18:14:10.426873+0000","mapping_epoch":21,"log_start":"25'1000","ondisk_log_start":"25'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3760,"log_dups_size":0,"ondisk_log_size":3760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:48.671293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311951360,"num_objects":4760,"num_object_clones":0,"num_object_copies":9520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4760,"num_write_kb":304640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865450+0000","last_change":"2024-09-12T18:13:22.409855+0000","last_active":"2024-09-12T18:14:08.865450+0000","last_peered":"2024-09-12T18:14:08.865450+0000","last_clean":"2024-09-12T18:14:08.865450+0000","last_became_active":"2024-09-12T18:13:22.408226+0000","last_became_peered":"2024-09-12T18:13:22.408226+0000","last_unstale":"2024-09-12T18:14:08.865450+0000","last_undegraded":"2024-09-12T18:14:08.865450+0000","last_fullsized":"2024-09-12T18:14:08.865450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.356953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865110+0000","last_change":"2024-09-12T18:13:19.355365+0000","last_active":"2024-09-12T18:14:08.865110+0000","last_peered":"2024-09-12T18:14:08.865110+0000","last_clean":"2024-09-12T18:14:08.865110+0000","last_became_active":"2024-09-12T18:13:17.353167+0000","last_became_peered":"2024-09-12T18:13:17.353167+0000","last_unstale":"2024-09-12T18:14:08.865110+0000","last_undegraded":"2024-09-12T18:14:08.865110+0000","last_fullsized":"2024-09-12T18:14:08.865110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.642226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079924,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864976+0000","last_change":"2024-09-12T18:13:23.418862+0000","last_active":"2024-09-12T18:14:08.864976+0000","last_peered":"2024-09-12T18:14:08.864976+0000","last_clean":"2024-09-12T18:14:08.864976+0000","last_became_active":"2024-09-12T18:13:23.418008+0000","last_became_peered":"2024-09-12T18:13:23.418008+0000","last_unstale":"2024-09-12T18:14:08.864976+0000","last_undegraded":"2024-09-12T18:14:08.864976+0000","last_fullsized":"2024-09-12T18:14:08.864976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:03.114396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"36'4773","reported_seq":4812,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.430284+0000","last_change":"2024-09-12T18:13:39.299411+0000","last_active":"2024-09-12T18:14:10.430284+0000","last_peered":"2024-09-12T18:14:10.430284+0000","last_clean":"2024-09-12T18:14:10.430284+0000","last_became_active":"2024-09-12T18:13:39.298808+0000","last_became_peered":"2024-09-12T18:13:39.298808+0000","last_unstale":"2024-09-12T18:14:10.430284+0000","last_undegraded":"2024-09-12T18:14:10.430284+0000","last_fullsized":"2024-09-12T18:14:10.430284+0000","mapping_epoch":21,"log_start":"25'1000","ondisk_log_start":"25'1000","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3773,"log_dups_size":0,"ondisk_log_size":3773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:30.228394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":312803328,"num_objects":4773,"num_object_clones":0,"num_object_copies":9546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4773,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4773,"num_write_kb":305472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865369+0000","last_change":"2024-09-12T18:13:22.404743+0000","last_active":"2024-09-12T18:14:08.865369+0000","last_peered":"2024-09-12T18:14:08.865369+0000","last_clean":"2024-09-12T18:14:08.865369+0000","last_became_active":"2024-09-12T18:13:22.403821+0000","last_became_peered":"2024-09-12T18:13:22.403821+0000","last_unstale":"2024-09-12T18:14:08.865369+0000","last_undegraded":"2024-09-12T18:14:08.865369+0000","last_fullsized":"2024-09-12T18:14:08.865369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:38.154223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865456+0000","last_change":"2024-09-12T18:13:19.357766+0000","last_active":"2024-09-12T18:14:08.865456+0000","last_peered":"2024-09-12T18:14:08.865456+0000","last_clean":"2024-09-12T18:14:08.865456+0000","last_became_active":"2024-09-12T18:13:17.350502+0000","last_became_peered":"2024-09-12T18:13:17.350502+0000","last_unstale":"2024-09-12T18:14:08.865456+0000","last_undegraded":"2024-09-12T18:14:08.865456+0000","last_fullsized":"2024-09-12T18:14:08.865456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:36.054980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864969+0000","last_change":"2024-09-12T18:13:23.415455+0000","last_active":"2024-09-12T18:14:08.864969+0000","last_peered":"2024-09-12T18:14:08.864969+0000","last_clean":"2024-09-12T18:14:08.864969+0000","last_became_active":"2024-09-12T18:13:23.414801+0000","last_became_peered":"2024-09-12T18:13:23.414801+0000","last_unstale":"2024-09-12T18:14:08.864969+0000","last_undegraded":"2024-09-12T18:14:08.864969+0000","last_fullsized":"2024-09-12T18:14:08.864969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:02.246838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"36'4689","reported_seq":4728,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:10.445196+0000","last_change":"2024-09-12T18:13:39.307029+0000","last_active":"2024-09-12T18:14:10.445196+0000","last_peered":"2024-09-12T18:14:10.445196+0000","last_clean":"2024-09-12T18:14:10.445196+0000","last_became_active":"2024-09-12T18:13:39.306294+0000","last_became_peered":"2024-09-12T18:13:39.306294+0000","last_unstale":"2024-09-12T18:14:10.445196+0000","last_undegraded":"2024-09-12T18:14:10.445196+0000","last_fullsized":"2024-09-12T18:14:10.445196+0000","mapping_epoch":21,"log_start":"24'700","ondisk_log_start":"24'700","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:21.862841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307298304,"num_objects":4689,"num_object_clones":0,"num_object_copies":9378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4689,"num_write_kb":300096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865392+0000","last_change":"2024-09-12T18:13:22.411124+0000","last_active":"2024-09-12T18:14:08.865392+0000","last_peered":"2024-09-12T18:14:08.865392+0000","last_clean":"2024-09-12T18:14:08.865392+0000","last_became_active":"2024-09-12T18:13:22.409252+0000","last_became_peered":"2024-09-12T18:13:22.409252+0000","last_unstale":"2024-09-12T18:14:08.865392+0000","last_undegraded":"2024-09-12T18:14:08.865392+0000","last_fullsized":"2024-09-12T18:14:08.865392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.758015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865526+0000","last_change":"2024-09-12T18:13:19.360453+0000","last_active":"2024-09-12T18:14:08.865526+0000","last_peered":"2024-09-12T18:14:08.865526+0000","last_clean":"2024-09-12T18:14:08.865526+0000","last_became_active":"2024-09-12T18:13:17.350194+0000","last_became_peered":"2024-09-12T18:13:17.350194+0000","last_unstale":"2024-09-12T18:14:08.865526+0000","last_undegraded":"2024-09-12T18:14:08.865526+0000","last_fullsized":"2024-09-12T18:14:08.865526+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:37.244796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864240+0000","last_change":"2024-09-12T18:13:23.420201+0000","last_active":"2024-09-12T18:14:08.864240+0000","last_peered":"2024-09-12T18:14:08.864240+0000","last_clean":"2024-09-12T18:14:08.864240+0000","last_became_active":"2024-09-12T18:13:23.417342+0000","last_became_peered":"2024-09-12T18:13:23.417342+0000","last_unstale":"2024-09-12T18:14:08.864240+0000","last_undegraded":"2024-09-12T18:14:08.864240+0000","last_fullsized":"2024-09-12T18:14:08.864240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:51.724774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861890+0000","last_change":"2024-09-12T18:13:23.422092+0000","last_active":"2024-09-12T18:14:08.861890+0000","last_peered":"2024-09-12T18:14:08.861890+0000","last_clean":"2024-09-12T18:14:08.861890+0000","last_became_active":"2024-09-12T18:13:23.419716+0000","last_became_peered":"2024-09-12T18:13:23.419716+0000","last_unstale":"2024-09-12T18:14:08.861890+0000","last_undegraded":"2024-09-12T18:14:08.861890+0000","last_fullsized":"2024-09-12T18:14:08.861890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:59.181312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.863886+0000","last_change":"2024-09-12T18:13:22.411054+0000","last_active":"2024-09-12T18:14:08.863886+0000","last_peered":"2024-09-12T18:14:08.863886+0000","last_clean":"2024-09-12T18:14:08.863886+0000","last_became_active":"2024-09-12T18:13:22.410200+0000","last_became_peered":"2024-09-12T18:13:22.410200+0000","last_unstale":"2024-09-12T18:14:08.863886+0000","last_undegraded":"2024-09-12T18:14:08.863886+0000","last_fullsized":"2024-09-12T18:14:08.863886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.807621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864561+0000","last_change":"2024-09-12T18:13:23.419707+0000","last_active":"2024-09-12T18:14:08.864561+0000","last_peered":"2024-09-12T18:14:08.864561+0000","last_clean":"2024-09-12T18:14:08.864561+0000","last_became_active":"2024-09-12T18:13:23.418033+0000","last_became_peered":"2024-09-12T18:13:23.418033+0000","last_unstale":"2024-09-12T18:14:08.864561+0000","last_undegraded":"2024-09-12T18:14:08.864561+0000","last_fullsized":"2024-09-12T18:14:08.864561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:35.249283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865007+0000","last_change":"2024-09-12T18:13:22.406616+0000","last_active":"2024-09-12T18:14:08.865007+0000","last_peered":"2024-09-12T18:14:08.865007+0000","last_clean":"2024-09-12T18:14:08.865007+0000","last_became_active":"2024-09-12T18:13:22.405383+0000","last_became_peered":"2024-09-12T18:13:22.405383+0000","last_unstale":"2024-09-12T18:14:08.865007+0000","last_undegraded":"2024-09-12T18:14:08.865007+0000","last_fullsized":"2024-09-12T18:14:08.865007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:00.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865055+0000","last_change":"2024-09-12T18:13:22.418573+0000","last_active":"2024-09-12T18:14:08.865055+0000","last_peered":"2024-09-12T18:14:08.865055+0000","last_clean":"2024-09-12T18:14:08.865055+0000","last_became_active":"2024-09-12T18:13:22.417960+0000","last_became_peered":"2024-09-12T18:13:22.417960+0000","last_unstale":"2024-09-12T18:14:08.865055+0000","last_undegraded":"2024-09-12T18:14:08.865055+0000","last_fullsized":"2024-09-12T18:14:08.865055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:22.256001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865336+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:14:08.865336+0000","last_peered":"2024-09-12T18:14:08.865336+0000","last_clean":"2024-09-12T18:14:08.865336+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:14:08.865336+0000","last_undegraded":"2024-09-12T18:14:08.865336+0000","last_fullsized":"2024-09-12T18:14:08.865336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865220+0000","last_change":"2024-09-12T18:13:22.411111+0000","last_active":"2024-09-12T18:14:08.865220+0000","last_peered":"2024-09-12T18:14:08.865220+0000","last_clean":"2024-09-12T18:14:08.865220+0000","last_became_active":"2024-09-12T18:13:22.409076+0000","last_became_peered":"2024-09-12T18:13:22.409076+0000","last_unstale":"2024-09-12T18:14:08.865220+0000","last_undegraded":"2024-09-12T18:14:08.865220+0000","last_fullsized":"2024-09-12T18:14:08.865220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:06.286454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864701+0000","last_change":"2024-09-12T18:13:23.408045+0000","last_active":"2024-09-12T18:14:08.864701+0000","last_peered":"2024-09-12T18:14:08.864701+0000","last_clean":"2024-09-12T18:14:08.864701+0000","last_became_active":"2024-09-12T18:13:23.405875+0000","last_became_peered":"2024-09-12T18:13:23.405875+0000","last_unstale":"2024-09-12T18:14:08.864701+0000","last_undegraded":"2024-09-12T18:14:08.864701+0000","last_fullsized":"2024-09-12T18:14:08.864701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:48.102172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865564+0000","last_change":"2024-09-12T18:13:23.420266+0000","last_active":"2024-09-12T18:14:08.865564+0000","last_peered":"2024-09-12T18:14:08.865564+0000","last_clean":"2024-09-12T18:14:08.865564+0000","last_became_active":"2024-09-12T18:13:23.417814+0000","last_became_peered":"2024-09-12T18:13:23.417814+0000","last_unstale":"2024-09-12T18:14:08.865564+0000","last_undegraded":"2024-09-12T18:14:08.865564+0000","last_fullsized":"2024-09-12T18:14:08.865564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:59.925373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865069+0000","last_change":"2024-09-12T18:13:22.411684+0000","last_active":"2024-09-12T18:14:08.865069+0000","last_peered":"2024-09-12T18:14:08.865069+0000","last_clean":"2024-09-12T18:14:08.865069+0000","last_became_active":"2024-09-12T18:13:22.410870+0000","last_became_peered":"2024-09-12T18:13:22.410870+0000","last_unstale":"2024-09-12T18:14:08.865069+0000","last_undegraded":"2024-09-12T18:14:08.865069+0000","last_fullsized":"2024-09-12T18:14:08.865069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:39.656040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865019+0000","last_change":"2024-09-12T18:13:23.419524+0000","last_active":"2024-09-12T18:14:08.865019+0000","last_peered":"2024-09-12T18:14:08.865019+0000","last_clean":"2024-09-12T18:14:08.865019+0000","last_became_active":"2024-09-12T18:13:23.417967+0000","last_became_peered":"2024-09-12T18:13:23.417967+0000","last_unstale":"2024-09-12T18:14:08.865019+0000","last_undegraded":"2024-09-12T18:14:08.865019+0000","last_fullsized":"2024-09-12T18:14:08.865019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:15.615361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865452+0000","last_change":"2024-09-12T18:13:22.408063+0000","last_active":"2024-09-12T18:14:08.865452+0000","last_peered":"2024-09-12T18:14:08.865452+0000","last_clean":"2024-09-12T18:14:08.865452+0000","last_became_active":"2024-09-12T18:13:22.404550+0000","last_became_peered":"2024-09-12T18:13:22.404550+0000","last_unstale":"2024-09-12T18:14:08.865452+0000","last_undegraded":"2024-09-12T18:14:08.865452+0000","last_fullsized":"2024-09-12T18:14:08.865452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:38.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864821+0000","last_change":"2024-09-12T18:13:23.431781+0000","last_active":"2024-09-12T18:14:08.864821+0000","last_peered":"2024-09-12T18:14:08.864821+0000","last_clean":"2024-09-12T18:14:08.864821+0000","last_became_active":"2024-09-12T18:13:23.430824+0000","last_became_peered":"2024-09-12T18:13:23.430824+0000","last_unstale":"2024-09-12T18:14:08.864821+0000","last_undegraded":"2024-09-12T18:14:08.864821+0000","last_fullsized":"2024-09-12T18:14:08.864821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864789+0000","last_change":"2024-09-12T18:13:22.413206+0000","last_active":"2024-09-12T18:14:08.864789+0000","last_peered":"2024-09-12T18:14:08.864789+0000","last_clean":"2024-09-12T18:14:08.864789+0000","last_became_active":"2024-09-12T18:13:22.411471+0000","last_became_peered":"2024-09-12T18:13:22.411471+0000","last_unstale":"2024-09-12T18:14:08.864789+0000","last_undegraded":"2024-09-12T18:14:08.864789+0000","last_fullsized":"2024-09-12T18:14:08.864789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864777+0000","last_change":"2024-09-12T18:13:23.427548+0000","last_active":"2024-09-12T18:14:08.864777+0000","last_peered":"2024-09-12T18:14:08.864777+0000","last_clean":"2024-09-12T18:14:08.864777+0000","last_became_active":"2024-09-12T18:13:23.425454+0000","last_became_peered":"2024-09-12T18:13:23.425454+0000","last_unstale":"2024-09-12T18:14:08.864777+0000","last_undegraded":"2024-09-12T18:14:08.864777+0000","last_fullsized":"2024-09-12T18:14:08.864777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:27.815530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865214+0000","last_change":"2024-09-12T18:13:22.405985+0000","last_active":"2024-09-12T18:14:08.865214+0000","last_peered":"2024-09-12T18:14:08.865214+0000","last_clean":"2024-09-12T18:14:08.865214+0000","last_became_active":"2024-09-12T18:13:22.405142+0000","last_became_peered":"2024-09-12T18:13:22.405142+0000","last_unstale":"2024-09-12T18:14:08.865214+0000","last_undegraded":"2024-09-12T18:14:08.865214+0000","last_fullsized":"2024-09-12T18:14:08.865214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:11.865045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861808+0000","last_change":"2024-09-12T18:13:23.415802+0000","last_active":"2024-09-12T18:14:08.861808+0000","last_peered":"2024-09-12T18:14:08.861808+0000","last_clean":"2024-09-12T18:14:08.861808+0000","last_became_active":"2024-09-12T18:13:23.414819+0000","last_became_peered":"2024-09-12T18:13:23.414819+0000","last_unstale":"2024-09-12T18:14:08.861808+0000","last_undegraded":"2024-09-12T18:14:08.861808+0000","last_fullsized":"2024-09-12T18:14:08.861808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:06.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.862357+0000","last_change":"2024-09-12T18:13:22.413954+0000","last_active":"2024-09-12T18:14:08.862357+0000","last_peered":"2024-09-12T18:14:08.862357+0000","last_clean":"2024-09-12T18:14:08.862357+0000","last_became_active":"2024-09-12T18:13:22.413273+0000","last_became_peered":"2024-09-12T18:13:22.413273+0000","last_unstale":"2024-09-12T18:14:08.862357+0000","last_undegraded":"2024-09-12T18:14:08.862357+0000","last_fullsized":"2024-09-12T18:14:08.862357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.737124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861944+0000","last_change":"2024-09-12T18:13:23.428996+0000","last_active":"2024-09-12T18:14:08.861944+0000","last_peered":"2024-09-12T18:14:08.861944+0000","last_clean":"2024-09-12T18:14:08.861944+0000","last_became_active":"2024-09-12T18:13:23.427453+0000","last_became_peered":"2024-09-12T18:13:23.427453+0000","last_unstale":"2024-09-12T18:14:08.861944+0000","last_undegraded":"2024-09-12T18:14:08.861944+0000","last_fullsized":"2024-09-12T18:14:08.861944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:31.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864924+0000","last_change":"2024-09-12T18:13:22.406995+0000","last_active":"2024-09-12T18:14:08.864924+0000","last_peered":"2024-09-12T18:14:08.864924+0000","last_clean":"2024-09-12T18:14:08.864924+0000","last_became_active":"2024-09-12T18:13:22.405577+0000","last_became_peered":"2024-09-12T18:13:22.405577+0000","last_unstale":"2024-09-12T18:14:08.864924+0000","last_undegraded":"2024-09-12T18:14:08.864924+0000","last_fullsized":"2024-09-12T18:14:08.864924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:52.531009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.864441+0000","last_change":"2024-09-12T18:13:23.415567+0000","last_active":"2024-09-12T18:14:08.864441+0000","last_peered":"2024-09-12T18:14:08.864441+0000","last_clean":"2024-09-12T18:14:08.864441+0000","last_became_active":"2024-09-12T18:13:23.409462+0000","last_became_peered":"2024-09-12T18:13:23.409462+0000","last_unstale":"2024-09-12T18:14:08.864441+0000","last_undegraded":"2024-09-12T18:14:08.864441+0000","last_fullsized":"2024-09-12T18:14:08.864441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:10.714907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865213+0000","last_change":"2024-09-12T18:13:22.409123+0000","last_active":"2024-09-12T18:14:08.865213+0000","last_peered":"2024-09-12T18:14:08.865213+0000","last_clean":"2024-09-12T18:14:08.865213+0000","last_became_active":"2024-09-12T18:13:22.408332+0000","last_became_peered":"2024-09-12T18:13:22.408332+0000","last_unstale":"2024-09-12T18:14:08.865213+0000","last_undegraded":"2024-09-12T18:14:08.865213+0000","last_fullsized":"2024-09-12T18:14:08.865213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:49.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.861628+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:14:08.861628+0000","last_peered":"2024-09-12T18:14:08.861628+0000","last_clean":"2024-09-12T18:14:08.861628+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:14:08.861628+0000","last_undegraded":"2024-09-12T18:14:08.861628+0000","last_fullsized":"2024-09-12T18:14:08.861628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T18:14:08.865026+0000","last_change":"2024-09-12T18:13:22.411575+0000","last_active":"2024-09-12T18:14:08.865026+0000","last_peered":"2024-09-12T18:14:08.865026+0000","last_clean":"2024-09-12T18:14:08.865026+0000","last_became_active":"2024-09-12T18:13:22.410466+0000","last_became_peered":"2024-09-12T18:13:22.410466+0000","last_unstale":"2024-09-12T18:14:08.865026+0000","last_undegraded":"2024-09-12T18:14:08.865026+0000","last_fullsized":"2024-09-12T18:14:08.865026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:31.010879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":4941545472,"num_objects":75402,"num_object_clones":0,"num_object_copies":150804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75402,"num_write_kb":4825728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":617742336,"data_stored":9883877376,"data_compressed":8443476,"data_compressed_allocated":617742336,"data_compressed_original":9883877376,"omap_allocated":0,"internal_metadata":0},"log_size":60502,"ondisk_log_size":60502,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13600,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253928,"kb_used_data":186644,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94117912,"statfs":{"total":96636764160,"available":96376741888,"internally_reserved":0,"allocated":191123456,"data_stored":3051300359,"data_compressed":2612793,"data_compressed_allocated":190697472,"data_compressed_original":3051143168,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330684,"kb_used_data":241196,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94041156,"statfs":{"total":96636764160,"available":96298143744,"internally_reserved":0,"allocated":246984704,"data_stored":3945798885,"data_compressed":3370629,"data_compressed_allocated":246603776,"data_compressed_original":3945660416,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738384,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231324,"kb_used_data":168200,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94140516,"statfs":{"total":96636764160,"available":96399888384,"internally_reserved":0,"allocated":172236800,"data_stored":2749309836,"data_compressed":2354822,"data_compressed_allocated":171823104,"data_compressed_original":2749153280,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173666304,"data_stored":2778660864,"data_compressed":2373726,"data_compressed_allocated":173666304,"data_compressed_original":2778660864,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":250433536,"data_stored":4006936576,"data_compressed":3422989,"data_compressed_allocated":250433536,"data_compressed_original":4006936576,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":193642496,"data_stored":3098279936,"data_compressed":2646761,"data_compressed_allocated":193642496,"data_compressed_original":3098279936,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:14:13.179 INFO:tasks.thrashosds.thrasher:Setting 3.b to [1, 2, 0] 2024-09-12T18:14:13.180 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.b', '1', '2', '0'] 2024-09-12T18:14:13.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.b 1 2 0 2024-09-12T18:14:13.248 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:13.248 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:13.250 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:13.248+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:13.269 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:13.351 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:13.349+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:13.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 33 16 81614 81598 154.525 130.562 0.00869198 0.00646645 2024-09-12T18:14:13.452 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:13.449+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:13.465 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:13.465 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:13.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.063693831000002, 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:13.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.059663602000001, 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.471 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:13.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:14:13.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:14:13.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.477 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.059493365999998, 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.478 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:13.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.059376606999997, 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:13.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:13.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.490 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.059307470999997, 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:13.491 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:13.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:13.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.059195719000002, 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:13.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.059031896999997, 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:13.505 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:13.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.058971131, 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:13.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:13.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:13.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.224007967999999, 2024-09-12T18:14:13.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:13.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.218244228, 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.520 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.835762680999999, 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:61129 5.1 e34/21 5:8eb73760:::benchmark_data_smithi062_23645_object61128:head v 34'3864, mlcod=34'3862)", 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8510449050000002, 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017014511, 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613902+0000", 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6225999999999999e-05 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613910+0000", 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3389999999999993e-06 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613917+0000", 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999999e-06 2024-09-12T18:14:13.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613972+0000", 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4729999999999999e-05 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613990+0000", 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8097999999999999e-05 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630793+0000", 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016803604 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630849+0000", 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6137999999999997e-05 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7401275349999992, 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:13.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:68555 5.3 5:c0a78847:::benchmark_data_smithi062_23645_object68554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.144962+0000", 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.3199181859999998, 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015839717, 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 68555 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.544 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.144962+0000", 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.144962+0000", 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.144963+0000", 2024-09-12T18:14:13.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.333e-06 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.145085+0000", 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121635 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.145095+0000", 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0548e-05 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.145102+0000", 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7089999999999996e-06 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.148994+0000", 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00389187 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.149123+0000", 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012925299999999999 2024-09-12T18:14:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.149250+0000", 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127162 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.154838+0000", 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055874699999999998 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.160728+0000", 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058908090000000003 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.160761+0000", 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2965e-05 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.160801+0000", 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9962999999999997e-05 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.550 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:69118 5.c 5:3c73a29c:::benchmark_data_smithi062_23645_object69117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.04844179, 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016585826000000001, 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69118 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416439+0000", 2024-09-12T18:14:13.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416520+0000", 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1144999999999996e-05 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416530+0000", 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0345e-05 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416537+0000", 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8290000000000002e-06 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.419825+0000", 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032876820000000001 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.421805+0000", 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019806490000000001 2024-09-12T18:14:13.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.422103+0000", 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029764100000000002 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.426179+0000", 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040759409999999996 2024-09-12T18:14:13.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.432963+0000", 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067841280000000004 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433002+0000", 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9190000000000003e-05 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433024+0000", 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:71164 5.5 5:aa7a4e3c:::benchmark_data_smithi062_23645_object71163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.0826672180000001, 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016377579, 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.557 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71164 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9599999999999998e-07 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382296+0000", 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2130000000000001e-05 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382306+0000", 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0327e-05 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382311+0000", 2024-09-12T18:14:13.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0220000000000004e-06 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383026+0000", 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071518999999999999 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383141+0000", 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114503 2024-09-12T18:14:13.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383311+0000", 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017065900000000001 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.386723+0000", 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003412099 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398515+0000", 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011791375 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398559+0000", 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4016e-05 2024-09-12T18:14:13.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398590+0000", 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1362000000000002e-05 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.564 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72470 5.e e36/21 5:7a71debc:::benchmark_data_smithi062_23645_object72469:head v 36'4512, mlcod=36'4510)", 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4579112299999997, 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016072189000000001, 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:13.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007067+0000", 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8288000000000005e-05 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007085+0000", 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7234000000000001e-05 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007090+0000", 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6620000000000002e-06 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007139+0000", 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9100000000000001e-05 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007159+0000", 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9247999999999999e-05 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.023002+0000", 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015843697 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.023041+0000", 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8371000000000002e-05 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72759 5.4 e36/21 5:2a23e3dd:::benchmark_data_smithi062_23645_object72758:head v 36'4602, mlcod=36'4599)", 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3143027140000001, 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016567460999999999, 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150578+0000", 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150673+0000", 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5461e-05 2024-09-12T18:14:13.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150682+0000", 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7239999999999998e-06 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150689+0000", 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5700000000000004e-06 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152657+0000", 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019679810000000002 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152694+0000", 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167104+0000", 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014409580999999999 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167145+0000", 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0635e-05 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72767 5.c 5:3d19f5c3:::benchmark_data_smithi062_23645_object72766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3123113630000001, 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017300254000000001, 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.574 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72767 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152569+0000", 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153984+0000", 2024-09-12T18:14:13.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001414713 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153994+0000", 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7079999999999992e-06 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.154000+0000", 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000001e-06 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155208+0000", 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012075689999999999 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155336+0000", 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012841299999999999 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155481+0000", 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014465499999999999 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167316+0000", 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011835215 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169776+0000", 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024603310000000001 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169828+0000", 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440999999999998e-05 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169869+0000", 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1056000000000001e-05 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.580 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72776 5.c 5:36da256f:::benchmark_data_smithi062_23645_object72775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3085589339999997, 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016020478000000001, 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72776 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:13.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7400000000000003e-07 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156356+0000", 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4678000000000002e-05 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156363+0000", 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0400000000000004e-06 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156367+0000", 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1779999999999996e-06 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.162759+0000", 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063913950000000002 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.164837+0000", 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020779570000000001 2024-09-12T18:14:13.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.165001+0000", 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016395099999999999 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172228+0000", 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072277280000000001 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:13.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172244+0000", 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5515e-05 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172298+0000", 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3757e-05 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172341+0000", 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3705000000000003e-05 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:13.587 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:13.587 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:13.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:14:13.589 INFO:teuthology.orchestra.run.smithi062.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:14:13.589 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:13.590 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:13.583+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:13.590 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:14:13.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:13.690 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:13.685+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:13.750 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:13.750 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:13.751 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:13.751 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:13.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.751 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82333 5.1 5:80903172:::benchmark_data_smithi062_23645_object82332:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.751 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.743937+0000", 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0077374799999999997, 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007756616, 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82333 2024-09-12T18:14:13.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.743937+0000", 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.743937+0000", 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.743938+0000", 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2099999999999995e-07 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.744019+0000", 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1651999999999997e-05 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.744029+0000", 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.027e-05 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.744036+0000", 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8809999999999998e-06 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.744089+0000", 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3000000000000001e-05 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.744168+0000", 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.907e-05 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.744249+0000", 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0084000000000001e-05 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749412+0000", 2024-09-12T18:14:13.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005163249 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82334 5.7 5:e407e0f8:::benchmark_data_smithi062_23645_object82333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.745707+0000", 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0059675980000000002, 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060334050000000004, 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82334 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745707+0000", 2024-09-12T18:14:13.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745707+0000", 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745707+0000", 2024-09-12T18:14:13.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5300000000000004e-07 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745760+0000", 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2652999999999999e-05 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745768+0000", 2024-09-12T18:14:13.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5930000000000006e-06 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745773+0000", 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4970000000000003e-06 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745826+0000", 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3421000000000002e-05 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745953+0000", 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126809 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746075+0000", 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012173800000000001 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.763 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82336 5.1 5:83b2eeab:::benchmark_data_smithi062_23645_object82335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.745785+0000", 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0058894940000000003, 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0059932650000000002, 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.764 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82336 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745785+0000", 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745785+0000", 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745785+0000", 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0800000000000005e-07 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745834+0000", 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8656000000000003e-05 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745842+0000", 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0160000000000008e-06 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745848+0000", 2024-09-12T18:14:13.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1009999999999997e-06 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.747156+0000", 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0013079509999999999 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.747275+0000", 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000118671 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.747403+0000", 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012819700000000001 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82337 5.7 5:eee89d70:::benchmark_data_smithi062_23645_object82336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.769 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.745860+0000", 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0058141620000000003, 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005954155, 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.770 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82337 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745860+0000", 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745860+0000", 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745861+0000", 2024-09-12T18:14:13.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745905+0000", 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4187999999999998e-05 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745912+0000", 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3760000000000002e-06 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745918+0000", 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.747988+0000", 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020702110000000002 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.748106+0000", 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117984 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.748236+0000", 2024-09-12T18:14:13.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000130042 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82338 5.1 5:89635752:::benchmark_data_smithi062_23645_object82337:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.745933+0000", 2024-09-12T18:14:13.776 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0057415319999999997, 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0059304509999999998, 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82338 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.777 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745933+0000", 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745933+0000", 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.745933+0000", 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746013+0000", 2024-09-12T18:14:13.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9658000000000002e-05 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746021+0000", 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0169999999999996e-06 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746027+0000", 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1990000000000003e-06 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749445+0000", 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0034181110000000002 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749618+0000", 2024-09-12T18:14:13.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017301299999999999 2024-09-12T18:14:13.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:13.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749767+0000", 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014848699999999999 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:82340 5.d e37/21 5:b482f08a:::benchmark_data_smithi062_23645_object82339:head v 37'5171, mlcod=37'5168)", 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.746525+0000", 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0051489200000000004, 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053723549999999997, 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.783 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.784 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:13.784 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746525+0000", 2024-09-12T18:14:13.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746525+0000", 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746526+0000", 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:14:13.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746602+0000", 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6532999999999994e-05 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746613+0000", 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0967e-05 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.746618+0000", 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7609999999999998e-06 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.747145+0000", 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00052726100000000001 2024-09-12T18:14:13.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.747166+0000", 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0914999999999999e-05 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.788 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82344 5.1 5.72f5e8b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.749673+0000", 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020012139999999999, 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022607080000000002, 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82344 2024-09-12T18:14:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749673+0000", 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749673+0000", 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749674+0000", 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.297e-06 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749730+0000", 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6292000000000002e-05 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749750+0000", 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9731000000000001e-05 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749758+0000", 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.792 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82345 5.f 5:f6f2d4ac:::benchmark_data_smithi062_23645_object82344:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.749775+0000", 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001898924, 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022172160000000002, 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.793 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82345 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749775+0000", 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749775+0000", 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749776+0000", 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9599999999999999e-07 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749820+0000", 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4274999999999999e-05 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749828+0000", 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2109999999999998e-06 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749835+0000", 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4880000000000004e-06 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.749887+0000", 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1919999999999998e-05 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750035+0000", 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014784299999999999 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750190+0000", 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155155 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:82334 5.7 e37/21)", 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.750165+0000", 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0015091659999999999, 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0018786250000000001, 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750165+0000", 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750165+0000", 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750166+0000", 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8299999999999996e-07 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750169+0000", 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5190000000000001e-06 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750181+0000", 2024-09-12T18:14:13.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2058999999999999e-05 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.750189+0000", 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.038e-06 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.802 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:82336 5.1 e37/21)", 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.751948+0000", 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9997258, 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011708, 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751948+0000", 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751948+0000", 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751949+0000", 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.02e-07 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751954+0000", 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.425e-06 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751966+0000", 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2415000000000001e-05 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751974+0000", 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6930000000000007e-06 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:82347 5.d e37/21)", 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.751962+0000", 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9997125, 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143819, 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.810 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751962+0000", 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751962+0000", 2024-09-12T18:14:13.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.751962+0000", 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999995e-07 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.752047+0000", 2024-09-12T18:14:13.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5020999999999998e-05 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.752059+0000", 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1984000000000001e-05 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.752066+0000", 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1210000000000001e-06 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82319 5.f 5:f6745e60:::benchmark_data_smithi062_23645_object82318:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.736892+0000", 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.014782136, 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.015265198000000001, 2024-09-12T18:14:13.814 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82319 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.736892+0000", 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.736892+0000", 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.736893+0000", 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4300000000000002e-07 2024-09-12T18:14:13.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.736937+0000", 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4496999999999998e-05 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.736949+0000", 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1591e-05 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.736956+0000", 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0219999999999999e-06 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.737141+0000", 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018493200000000001 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.737216+0000", 2024-09-12T18:14:13.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4710999999999997e-05 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.737299+0000", 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3572000000000006e-05 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.742887+0000", 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005588094 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.752155+0000", 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092679949999999994 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:82330 5.7 5:e3d1b4b5:::benchmark_data_smithi062_23645_object82329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:13.739944+0000", 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.011729786000000001, 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.01229178, 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:13.820 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 82330 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.739944+0000", 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.739944+0000", 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.739945+0000", 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1500000000000003e-07 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.739997+0000", 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2250000000000003e-05 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.740005+0000", 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6109999999999996e-06 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.740010+0000", 2024-09-12T18:14:13.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6859999999999997e-06 2024-09-12T18:14:13.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:13.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.740045+0000", 2024-09-12T18:14:13.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5225000000000002e-05 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.740118+0000", 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3070000000000003e-05 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.740195+0000", 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6478999999999997e-05 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:13.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:13.743755+0000", 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035606679999999999 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 13 2024-09-12T18:14:13.826 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:13.827 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:13.828 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:13.828 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:13.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:13.829 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:13.825+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:13.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:14:13.928 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:13.925+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:14.021 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:14.022 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:14.029 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:14.025+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:14.041 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:14.130 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:14.128+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:14.232 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:14.229+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:14.234 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:14.234 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:14.257 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:14.332 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:14.329+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:14.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 34 16 83723 83707 153.857 131.812 0.00783034 0.00649481 2024-09-12T18:14:14.413 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:14.413 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:14.433 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:14.434 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:14.432+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:14.537 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:14.533+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:14.585 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:14.585 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:14.605 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:14.635 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:14.631+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:14.736 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:14.735+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:14.756 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:14.757 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:14.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:14.838 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:14.833+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:14:14.935 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:14.936 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:14.939 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:14.935+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:14.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:15.044 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:15.043+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:15.140 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:15.137+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:15.156 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:15.157 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:15.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:15.265 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:15.263+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:15.342 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:15.341+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:15.373 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:15.373 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:15.394 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:15.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 35 16 85754 85738 153.087 126.938 0.00442728 0.00652736 2024-09-12T18:14:15.447 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:15.445+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:15.548 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:15.544+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:15.660 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:15.660 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:15.661 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:15.661 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:15.656+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:15.761 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:15.759+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:15.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:15.860 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:15.861 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:15.862 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:15.860+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:15.880 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:15.962 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:15.959+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:15.997 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:16.016 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:16.016 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:16.036 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:16.064 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:16.060+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:16.086 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.790798813000002, 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:16.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:16.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:16.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:16.093 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 62.986470511, 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:16.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690874837999999, 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.100 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:16.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:16.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:16.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.108 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.108 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:16.108 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690781162999997, 2024-09-12T18:14:16.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690711933000003, 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:16.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:16.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:16.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690621167000003, 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:16.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:16.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.127 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690560144000003, 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:16.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:16.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:16.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690501384999997, 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.135 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:16.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.690438335000003, 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:16.142 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:16.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:16.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:16.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.689637961000003, 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:16.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:16.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:16.154 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.689499759, 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:16.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:16.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:16.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:16.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:16.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.689436508999997, 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:16.163 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:16.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:16.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:16.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:16.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.169 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.689036541999997, 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:16.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.688938440000001, 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:16.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:16.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:16.182 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.688846048000002, 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:16.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:16.187 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.688759150999999, 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.188 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:16.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:16.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.194 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.688635529000003, 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.195 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:16.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.688243929000002, 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:16.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.206 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78500 5.9 5:92ea3575:::benchmark_data_smithi062_23645_object78499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.1632326529999997, 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022476556000000002, 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78500 2024-09-12T18:14:16.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921728+0000", 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.452e-06 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921775+0000", 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6910999999999999e-05 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921787+0000", 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1374e-05 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921794+0000", 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922416+0000", 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00062186399999999997 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922566+0000", 2024-09-12T18:14:16.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014947800000000001 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922716+0000", 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0001505 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931674+0000", 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0089579459999999996 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944113+0000", 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012438362 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944168+0000", 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5464000000000003e-05 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944203+0000", 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5352000000000003e-05 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.212 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78501 5.9 5:9283cf68:::benchmark_data_smithi062_23645_object78500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.1631020200000002, 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022418885, 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:16.213 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78501 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921858+0000", 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921919+0000", 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1251e-05 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921926+0000", 2024-09-12T18:14:16.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921930+0000", 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3440000000000003e-06 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.926849+0000", 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049193279999999997 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927003+0000", 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000153542 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927167+0000", 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000163962 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931705+0000", 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045380359999999996 2024-09-12T18:14:16.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944215+0000", 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012510037999999999 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944246+0000", 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0613e-05 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:16.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944276+0000", 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0685000000000002e-05 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:16.219 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:16.221 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:16.217+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:16.221 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:16.322 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:16.320+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:16.375 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:87805 5.e 5:7318c8f1:::benchmark_data_smithi062_23645_object87804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:16.373792+0000", 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0026113519999999999, 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026294059999999999, 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.376 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 87805 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373792+0000", 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373792+0000", 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373793+0000", 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.06e-06 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373904+0000", 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011099000000000001 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373921+0000", 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6620999999999999e-05 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373926+0000", 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3199999999999999e-06 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373981+0000", 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.503e-05 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374120+0000", 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013900499999999999 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374267+0000", 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014681199999999999 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:87806 5.4 5:2c38fe9b:::benchmark_data_smithi062_23645_object87805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:16.373948+0000", 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0024552860000000001, 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025165980000000001, 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 87806 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373948+0000", 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373948+0000", 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.373949+0000", 2024-09-12T18:14:16.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8400000000000004e-07 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374017+0000", 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8073999999999999e-05 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374025+0000", 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0299999999999994e-06 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374031+0000", 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.998e-06 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374092+0000", 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0927000000000001e-05 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374211+0000", 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119195 2024-09-12T18:14:16.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.374337+0000", 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126389 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:87797 5.0 5:0af48388:::benchmark_data_smithi062_23645_object87796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:16.369358+0000", 2024-09-12T18:14:16.385 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.007044748, 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071429809999999996, 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 87797 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.369358+0000", 2024-09-12T18:14:16.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.369358+0000", 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.369359+0000", 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7800000000000001e-07 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.369442+0000", 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3152000000000006e-05 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.369451+0000", 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4740000000000005e-06 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.369456+0000", 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0050000000000004e-06 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.371546+0000", 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020905839999999999 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.371643+0000", 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6897000000000004e-05 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.371761+0000", 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117465 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.375090+0000", 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033286840000000002 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 3 2024-09-12T18:14:16.390 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:16.396 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:16.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 36 16 87865 87849 152.499 131.938 0.00557875 0.0065528 2024-09-12T18:14:16.422 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:16.419+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:16.523 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:16.521+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:16.595 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:16.595 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:14:16.595 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:14:16.595 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:14:16.595 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:16.616 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:16.623 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:16.619+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:16.724 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:16.719+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382933209999997, 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:14:16.775 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:14:16.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:14:16.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:14:16.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:14:16.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.783 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382817848000002, 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:14:16.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:14:16.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.791 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382736882000003, 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:14:16.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:16.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:14:16.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:14:16.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:16.799 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382632370000003, 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:16.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:14:16.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:14:16.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:14:16.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.809 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382548427000003, 2024-09-12T18:14:16.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:14:16.811 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.811 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.811 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.811 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:16.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:14:16.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:14:16.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382425480999999, 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.819 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:14:16.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:14:16.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:14:16.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382353971999997, 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.826 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:14:16.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:14:16.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:16.834 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382289071999999, 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.835 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:14:16.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:14:16.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:14:16.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:14:16.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:14:16.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:14:16.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.839 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:14:16.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:14:16.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:14:16.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:14:16.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:16.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:14:16.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:14:16.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:14:16.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:14:16.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.843 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:14:16.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:14:16.843 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:14:16.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:14:16.844 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.844 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.845 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.845 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:16.845 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:16.845 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.382219606, 2024-09-12T18:14:16.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:14:16.846 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.846 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.846 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:16.846 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:16.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.848 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.848 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:16.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.848 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:14:16.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:14:16.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:14:16.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:14:16.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:14:16.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:14:16.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:14:16.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:14:16.852 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:14:16.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:14:16.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:16.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:14:16.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:14:16.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:14:16.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:14:16.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:14:16.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:14:16.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:14:16.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:14:16.856 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.856 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.857 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.857 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:14:16.857 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:16.857 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.367801444999998, 2024-09-12T18:14:16.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:14:16.858 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.858 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.858 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.858 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:16.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:16.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:14:16.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:14:16.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:14:16.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:14:16.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:14:16.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:14:16.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:14:16.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:14:16.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:14:16.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:14:16.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:14:16.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:14:16.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:14:16.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:14:16.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:14:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:14:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.869 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.870 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:16.870 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:16.870 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 31.528300498, 2024-09-12T18:14:16.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:14:16.871 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.871 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.871 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.871 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.871 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.871 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.872 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:14:16.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.872 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:16.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:16.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:16.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:14:16.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:14:16.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:14:16.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:14:16.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:14:16.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:14:16.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:14:16.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:14:16.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:14:16.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:14:16.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:14:16.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:14:16.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:14:16.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:14:16.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:14:16.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:14:16.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:14:16.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:14:16.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:14:16.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:14:16.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:14:16.884 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.884 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.884 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.885 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72759 5.4 5:2a23e3dd:::benchmark_data_smithi062_23645_object72758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.885 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:16.885 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.6257614489999996, 2024-09-12T18:14:16.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019309862000000001, 2024-09-12T18:14:16.885 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.886 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.886 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.886 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.886 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.886 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.887 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72759 2024-09-12T18:14:16.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.887 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:16.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:16.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148203+0000", 2024-09-12T18:14:16.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.08e-06 2024-09-12T18:14:16.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148395+0000", 2024-09-12T18:14:16.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000192313 2024-09-12T18:14:16.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148404+0000", 2024-09-12T18:14:16.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:14:16.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148410+0000", 2024-09-12T18:14:16.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2430000000000002e-06 2024-09-12T18:14:16.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150393+0000", 2024-09-12T18:14:16.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019825250000000002 2024-09-12T18:14:16.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150467+0000", 2024-09-12T18:14:16.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3622999999999996e-05 2024-09-12T18:14:16.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150561+0000", 2024-09-12T18:14:16.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4191999999999995e-05 2024-09-12T18:14:16.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.153681+0000", 2024-09-12T18:14:16.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031201340000000001 2024-09-12T18:14:16.896 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167403+0000", 2024-09-12T18:14:16.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013722447 2024-09-12T18:14:16.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167464+0000", 2024-09-12T18:14:16.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0825000000000001e-05 2024-09-12T18:14:16.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167512+0000", 2024-09-12T18:14:16.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7593999999999999e-05 2024-09-12T18:14:16.899 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.899 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.900 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.900 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72760 5.4 5:2406a1e8:::benchmark_data_smithi062_23645_object72759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.900 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.148429+0000", 2024-09-12T18:14:16.900 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.6255343419999999, 2024-09-12T18:14:16.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019266359, 2024-09-12T18:14:16.901 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.901 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.901 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.901 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.902 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.902 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.902 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72760 2024-09-12T18:14:16.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.902 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148429+0000", 2024-09-12T18:14:16.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148429+0000", 2024-09-12T18:14:16.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148430+0000", 2024-09-12T18:14:16.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3399999999999998e-07 2024-09-12T18:14:16.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148468+0000", 2024-09-12T18:14:16.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8217999999999999e-05 2024-09-12T18:14:16.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148480+0000", 2024-09-12T18:14:16.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1766000000000001e-05 2024-09-12T18:14:16.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148486+0000", 2024-09-12T18:14:16.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.879e-06 2024-09-12T18:14:16.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.151980+0000", 2024-09-12T18:14:16.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034941619999999999 2024-09-12T18:14:16.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.152088+0000", 2024-09-12T18:14:16.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108355 2024-09-12T18:14:16.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.152238+0000", 2024-09-12T18:14:16.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014954700000000001 2024-09-12T18:14:16.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.154102+0000", 2024-09-12T18:14:16.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018641899999999999 2024-09-12T18:14:16.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167591+0000", 2024-09-12T18:14:16.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013488763000000001 2024-09-12T18:14:16.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167648+0000", 2024-09-12T18:14:16.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6981999999999998e-05 2024-09-12T18:14:16.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167695+0000", 2024-09-12T18:14:16.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7663000000000001e-05 2024-09-12T18:14:16.914 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.914 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.914 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.915 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72983 5.0 5:094817b2:::benchmark_data_smithi062_23645_object72982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.915 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:16.915 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.5183311540000002, 2024-09-12T18:14:16.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020466501000000002, 2024-09-12T18:14:16.916 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.916 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.916 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.916 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.916 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.916 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.917 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72983 2024-09-12T18:14:16.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.917 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:16.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:16.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255633+0000", 2024-09-12T18:14:16.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8200000000000001e-07 2024-09-12T18:14:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255698+0000", 2024-09-12T18:14:16.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5612999999999997e-05 2024-09-12T18:14:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255705+0000", 2024-09-12T18:14:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8040000000000004e-06 2024-09-12T18:14:16.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255715+0000", 2024-09-12T18:14:16.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8579999999999995e-06 2024-09-12T18:14:16.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264776+0000", 2024-09-12T18:14:16.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090614019999999997 2024-09-12T18:14:16.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264857+0000", 2024-09-12T18:14:16.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0699999999999996e-05 2024-09-12T18:14:16.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264945+0000", 2024-09-12T18:14:16.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8412000000000007e-05 2024-09-12T18:14:16.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274553+0000", 2024-09-12T18:14:16.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096073900000000004 2024-09-12T18:14:16.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276047+0000", 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001493879 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276076+0000", 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8988000000000001e-05 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276099+0000", 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3073000000000001e-05 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.927 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72986 5.0 5:07446845:::benchmark_data_smithi062_23645_object72985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.5143577649999997, 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019504352999999999, 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.928 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72986 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259607+0000", 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.097e-06 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259667+0000", 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0408999999999997e-05 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259679+0000", 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2216e-05 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259685+0000", 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6210000000000001e-06 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266213+0000", 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00652785 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266348+0000", 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013515399999999999 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266508+0000", 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159851 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.277410+0000", 2024-09-12T18:14:16.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902159999999999 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279012+0000", 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016019610000000001 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279065+0000", 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3263999999999997e-05 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279110+0000", 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.477e-05 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72992 5.0 5:00f4008c:::benchmark_data_smithi062_23645_object72991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.5126572559999998, 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022141033000000001, 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.934 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72992 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261307+0000", 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2200000000000003e-07 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261386+0000", 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8980999999999995e-05 2024-09-12T18:14:16.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261395+0000", 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9900000000000003e-06 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261402+0000", 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0049999999999998e-06 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.269633+0000", 2024-09-12T18:14:16.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082313960000000002 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.269790+0000", 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015663600000000001 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.270114+0000", 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032398799999999999 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.277416+0000", 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.007301676 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283386+0000", 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059702440000000004 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283420+0000", 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3936000000000002e-05 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283447+0000", 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7359e-05 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72993 5.0 5:027dc36e:::benchmark_data_smithi062_23645_object72992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.5107009160000002, 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024378153999999999, 2024-09-12T18:14:16.940 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72993 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263263+0000", 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8100000000000002e-07 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263354+0000", 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1252e-05 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263365+0000", 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0471e-05 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263374+0000", 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8820000000000007e-06 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272483+0000", 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091092410000000006 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272619+0000", 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013574 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272784+0000", 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000165241 2024-09-12T18:14:16.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.281089+0000", 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083047180000000009 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287569+0000", 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064803020000000003 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287616+0000", 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6863999999999997e-05 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287641+0000", 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4762000000000001e-05 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:73000 5.8 5:106cd630:::benchmark_data_smithi062_23645_object72999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:16.946 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.5086191360000001, 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022436998999999999, 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 73000 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265345+0000", 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4799999999999998e-07 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265399+0000", 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3993000000000003e-05 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265406+0000", 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6059999999999997e-06 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265410+0000", 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9650000000000002e-06 2024-09-12T18:14:16.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274589+0000", 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091783000000000003 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274719+0000", 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013009799999999999 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274877+0000", 2024-09-12T18:14:16.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015795199999999999 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283374+0000", 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084975529999999997 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287690+0000", 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00431622 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287741+0000", 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0225000000000001e-05 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287781+0000", 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0538999999999999e-05 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.952 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:80768 5.8 5:1972d66f:::benchmark_data_smithi062_23645_object80767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.997925+0000", 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.776038341, 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019960835999999999, 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 80768 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.997925+0000", 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.997925+0000", 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.997926+0000", 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:14:16.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.998032+0000", 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010590300000000001 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.998040+0000", 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8329999999999994e-06 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.998045+0000", 2024-09-12T18:14:16.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8039999999999998e-06 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.002890+0000", 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048441339999999999 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.002987+0000", 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6995000000000002e-05 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.003069+0000", 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2853000000000001e-05 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.008405+0000", 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053353109999999997 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.017827+0000", 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0094220889999999998 2024-09-12T18:14:16.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.017860+0000", 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3467000000000003e-05 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.017886+0000", 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5598000000000001e-05 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:88304 5.8 5:16498d7a:::benchmark_data_smithi062_23645_object88303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.158291819, 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020759449999999999, 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 88304 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.959 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:16.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615708+0000", 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957000000000001e-05 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615717+0000", 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7860000000000002e-06 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615722+0000", 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0490000000000003e-06 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.625077+0000", 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093553279999999996 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.625192+0000", 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114502 2024-09-12T18:14:16.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.625277+0000", 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5373999999999999e-05 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.633623+0000", 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083460489999999995 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:16.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.636362+0000", 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027385589999999998 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.636398+0000", 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6508999999999999e-05 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.636431+0000", 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2771999999999997e-05 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.964 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.965 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.965 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:16.965 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:16.965 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:16.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:14:16.966 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:16.965+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:16.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:17.067 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:17.063+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:89336 5.c 5:39b3978b:::benchmark_data_smithi062_23645_object89335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.117491+0000", 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0038670850000000001, 2024-09-12T18:14:17.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038862469999999998, 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 89336 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.117491+0000", 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.117491+0000", 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.117491+0000", 2024-09-12T18:14:17.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:14:17.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.117601+0000", 2024-09-12T18:14:17.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109984 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.117619+0000", 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7842999999999998e-05 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.117627+0000", 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3579999999999997e-06 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.118311+0000", 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068401400000000004 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.118477+0000", 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166389 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.118616+0000", 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013905800000000001 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.121015+0000", 2024-09-12T18:14:17.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023990230000000001 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:89338 5.e e38/21 5:7c6fc1c3:::benchmark_data_smithi062_23645_object89337:head v 38'5571, mlcod=38'5567)", 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.120617+0000", 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00074058399999999997, 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00080714600000000001, 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.128 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120617+0000", 2024-09-12T18:14:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120617+0000", 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120618+0000", 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:14:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120678+0000", 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9710000000000003e-05 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120684+0000", 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5649999999999998e-06 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120688+0000", 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3599999999999998e-06 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120721+0000", 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3012000000000002e-05 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120734+0000", 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2177e-05 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:89323 5.a 5:5af208d5:::benchmark_data_smithi062_23645_object89322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.113272+0000", 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0080857099999999994, 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081857149999999997, 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 89323 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113272+0000", 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113272+0000", 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113273+0000", 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7499999999999998e-07 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113334+0000", 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1073000000000003e-05 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113345+0000", 2024-09-12T18:14:17.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1195999999999999e-05 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113352+0000", 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4230000000000002e-06 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113400+0000", 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8599e-05 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113477+0000", 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6601999999999996e-05 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.113553+0000", 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6172000000000002e-05 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120077+0000", 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065236590000000002 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.138 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:89330 5.6 5:6626f2dd:::benchmark_data_smithi062_23645_object89329:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.114104+0000", 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0072535480000000003, 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073929959999999998, 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 89330 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.114104+0000", 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.114104+0000", 2024-09-12T18:14:17.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.114105+0000", 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3099999999999996e-07 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.114150+0000", 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4687000000000001e-05 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.114159+0000", 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.114165+0000", 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7429999999999996e-06 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115968+0000", 2024-09-12T18:14:17.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001802877 2024-09-12T18:14:17.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116049+0000", 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0657999999999999e-05 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116135+0000", 2024-09-12T18:14:17.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5723000000000006e-05 2024-09-12T18:14:17.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.118566+0000", 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024310389999999999 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:89332 5.c 5:3ec9ee79:::benchmark_data_smithi062_23645_object89331:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.115609+0000", 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0057485649999999998, 2024-09-12T18:14:17.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059253700000000001, 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 89332 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115609+0000", 2024-09-12T18:14:17.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115609+0000", 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115610+0000", 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1379999999999999e-06 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115651+0000", 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0465e-05 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115662+0000", 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1049999999999999e-05 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115669+0000", 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0480000000000001e-06 2024-09-12T18:14:17.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115824+0000", 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015477500000000001 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.115957+0000", 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133158 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116107+0000", 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015030299999999999 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120566+0000", 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044587669999999998 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.154 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:89334 5.5 5:a28df59d:::benchmark_data_smithi062_23645_object89333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.116282+0000", 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050761230000000001, 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052892859999999998, 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 89334 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116282+0000", 2024-09-12T18:14:17.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116282+0000", 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116283+0000", 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7000000000000003e-07 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116379+0000", 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6104e-05 2024-09-12T18:14:17.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116389+0000", 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0703999999999999e-05 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116396+0000", 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.703e-06 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116455+0000", 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8972999999999999e-05 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116616+0000", 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016074199999999999 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.116732+0000", 2024-09-12T18:14:17.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011613899999999999 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.120344+0000", 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036117749999999998 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.162 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.163 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.163 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:17.163 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 6 2024-09-12T18:14:17.163 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:17.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:17.168 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:17.165+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:17.269 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:17.265+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:17.356 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:17.356 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:17.356 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:17.356 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:17.356 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:17.370 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:17.368+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:17.377 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:17.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 37 16 89927 89911 151.86 128.875 0.00881802 0.00658025 2024-09-12T18:14:17.471 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:17.467+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.128292791, 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.124262561999998, 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016082933000000001, 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405216+0000", 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405226+0000", 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7969999999999995e-06 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405241+0000", 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5362999999999998e-05 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405273+0000", 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1705999999999998e-05 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405321+0000", 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7777e-05 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406667+0000", 2024-09-12T18:14:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013464799999999999 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.406966+0000", 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029846400000000002 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407261+0000", 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029567699999999999 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.414628+0000", 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073661639999999997 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421081+0000", 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064533769999999997 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421208+0000", 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012657900000000001 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421299+0000", 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1549e-05 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.124092326000003, 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.123975567000002, 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.123906431000002, 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.123794679, 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.123630857000002, 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.123570090999998, 2024-09-12T18:14:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.288606928, 2024-09-12T18:14:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:17.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:17.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:17.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:17.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.599 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.600 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:17.600 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:17.600 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.282843188000001, 2024-09-12T18:14:17.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:17.600 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.601 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:17.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:17.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:17.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:17.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:17.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:17.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:17.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:17.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:17.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:17.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:17.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:17.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:17.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:17.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:17.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:17.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:17.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:17.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.611 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:17.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:17.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.900361641, 2024-09-12T18:14:17.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:17.612 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.613 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.613 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:17.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.614 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:17.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:17.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:17.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:17.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:17.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:17.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:17.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:17.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:17.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:17.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:17.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:17.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:17.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:17.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:17.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:17.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:17.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:17.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:17.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:17.625 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.625 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.626 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:61129 5.1 e34/21 5:8eb73760:::benchmark_data_smithi062_23645_object61128:head v 34'3864, mlcod=34'3862)", 2024-09-12T18:14:17.626 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:17.626 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.915643865, 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017014511, 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:17.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613902+0000", 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6225999999999999e-05 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613910+0000", 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3389999999999993e-06 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613917+0000", 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999999e-06 2024-09-12T18:14:17.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613972+0000", 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4729999999999999e-05 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613990+0000", 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8097999999999999e-05 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630793+0000", 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016803604 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630849+0000", 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6137999999999997e-05 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.804726495000001, 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.632 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:17.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:69118 5.c 5:3c73a29c:::benchmark_data_smithi062_23645_object69117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:17.639 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.11304075, 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016585826000000001, 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69118 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:17.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416439+0000", 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416520+0000", 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1144999999999996e-05 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416530+0000", 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0345e-05 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416537+0000", 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8290000000000002e-06 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.419825+0000", 2024-09-12T18:14:17.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032876820000000001 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.421805+0000", 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019806490000000001 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.422103+0000", 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029764100000000002 2024-09-12T18:14:17.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.426179+0000", 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040759409999999996 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.432963+0000", 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067841280000000004 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433002+0000", 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9190000000000003e-05 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433024+0000", 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:71164 5.5 5:aa7a4e3c:::benchmark_data_smithi062_23645_object71163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:17.647 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1472661780000006, 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016377579, 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71164 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.648 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9599999999999998e-07 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382296+0000", 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2130000000000001e-05 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382306+0000", 2024-09-12T18:14:17.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0327e-05 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382311+0000", 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0220000000000004e-06 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383026+0000", 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071518999999999999 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383141+0000", 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114503 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383311+0000", 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017065900000000001 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.386723+0000", 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003412099 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398515+0000", 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011791375 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398559+0000", 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4016e-05 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398590+0000", 2024-09-12T18:14:17.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1362000000000002e-05 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72470 5.e e36/21 5:7a71debc:::benchmark_data_smithi062_23645_object72469:head v 36'4512, mlcod=36'4510)", 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.5225101900000002, 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016072189000000001, 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.654 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.006969+0000", 2024-09-12T18:14:17.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007067+0000", 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8288000000000005e-05 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007085+0000", 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7234000000000001e-05 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007090+0000", 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6620000000000002e-06 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007139+0000", 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9100000000000001e-05 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.007159+0000", 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9247999999999999e-05 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.023002+0000", 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015843697 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.023041+0000", 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8371000000000002e-05 2024-09-12T18:14:17.658 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72759 5.4 e36/21 5:2a23e3dd:::benchmark_data_smithi062_23645_object72758:head v 36'4602, mlcod=36'4599)", 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.3789016739999997, 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016567460999999999, 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150578+0000", 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150673+0000", 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5461e-05 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150682+0000", 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7239999999999998e-06 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150689+0000", 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5700000000000004e-06 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152657+0000", 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019679810000000002 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152694+0000", 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167104+0000", 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014409580999999999 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167145+0000", 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0635e-05 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72767 5.c 5:3d19f5c3:::benchmark_data_smithi062_23645_object72766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.3769103230000006, 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017300254000000001, 2024-09-12T18:14:17.664 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72767 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152569+0000", 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153984+0000", 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001414713 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153994+0000", 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7079999999999992e-06 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.154000+0000", 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000001e-06 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155208+0000", 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012075689999999999 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155336+0000", 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012841299999999999 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155481+0000", 2024-09-12T18:14:17.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014465499999999999 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167316+0000", 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011835215 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169776+0000", 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024603310000000001 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169828+0000", 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440999999999998e-05 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169869+0000", 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1056000000000001e-05 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.670 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72776 5.c 5:36da256f:::benchmark_data_smithi062_23645_object72775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.3731578940000002, 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016020478000000001, 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72776 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156321+0000", 2024-09-12T18:14:17.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7400000000000003e-07 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156356+0000", 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4678000000000002e-05 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156363+0000", 2024-09-12T18:14:17.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0400000000000004e-06 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.156367+0000", 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1779999999999996e-06 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.162759+0000", 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063913950000000002 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.164837+0000", 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020779570000000001 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.165001+0000", 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016395099999999999 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172228+0000", 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072277280000000001 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172244+0000", 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5515e-05 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172298+0000", 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3757e-05 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.172341+0000", 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3705000000000003e-05 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:89686 5.5 5:af89ae7e:::benchmark_data_smithi062_23645_object89685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:17.286860+0000", 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.24261855600000001, 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016363810999999999, 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:17.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 89686 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.286860+0000", 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:17.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.286860+0000", 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.286861+0000", 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.286898+0000", 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6899e-05 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.286906+0000", 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5590000000000006e-06 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.286912+0000", 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4949999999999999e-06 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.289469+0000", 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025574439999999999 2024-09-12T18:14:17.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.289602+0000", 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132478 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.289741+0000", 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013964000000000001 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.295333+0000", 2024-09-12T18:14:17.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055911620000000002 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.303139+0000", 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078061040000000003 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.303183+0000", 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4634e-05 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:17.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:17.303224+0000", 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0667000000000002e-05 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:17.683 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:17.685 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:17.685 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:17.679+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:17.785 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:17.783+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:90823 5.f 5:ff6f6c58:::benchmark_data_smithi062_23645_object90822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.834778+0000", 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.007852197, 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0078729549999999992, 2024-09-12T18:14:17.842 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 90823 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834778+0000", 2024-09-12T18:14:17.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834778+0000", 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834779+0000", 2024-09-12T18:14:17.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834852+0000", 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3008000000000003e-05 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834861+0000", 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0229999999999998e-06 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834867+0000", 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3559999999999998e-06 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835513+0000", 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00064606699999999995 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835636+0000", 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012231399999999999 2024-09-12T18:14:17.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835761+0000", 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000124972 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838440+0000", 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026791979999999998 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.848 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:90824 5.7 5:e79e4858:::benchmark_data_smithi062_23645_object90823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.834908+0000", 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0077229009999999999, 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0077902520000000001, 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.849 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 90824 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834908+0000", 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834908+0000", 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834908+0000", 2024-09-12T18:14:17.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834973+0000", 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4634999999999994e-05 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834981+0000", 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2360000000000004e-06 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.834987+0000", 2024-09-12T18:14:17.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7660000000000004e-06 2024-09-12T18:14:17.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835496+0000", 2024-09-12T18:14:17.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00050878000000000002 2024-09-12T18:14:17.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835572+0000", 2024-09-12T18:14:17.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6398999999999998e-05 2024-09-12T18:14:17.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:17.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835654+0000", 2024-09-12T18:14:17.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1821000000000001e-05 2024-09-12T18:14:17.857 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.858 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.858 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.858 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90822 5.5 e38/21 5:a54164a2:::benchmark_data_smithi062_23645_object90821:head v 38'5760, mlcod=38'5758)", 2024-09-12T18:14:17.858 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.835224+0000", 2024-09-12T18:14:17.859 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0074064500000000002, 2024-09-12T18:14:17.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075095989999999996, 2024-09-12T18:14:17.859 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.859 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.859 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.860 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835224+0000", 2024-09-12T18:14:17.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835224+0000", 2024-09-12T18:14:17.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835225+0000", 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7599999999999996e-07 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835294+0000", 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8954000000000004e-05 2024-09-12T18:14:17.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835308+0000", 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3767e-05 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835315+0000", 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5750000000000003e-06 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835369+0000", 2024-09-12T18:14:17.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3606999999999997e-05 2024-09-12T18:14:17.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835389+0000", 2024-09-12T18:14:17.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.048e-05 2024-09-12T18:14:17.865 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.865 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.866 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.866 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:90828 5.7 5:e2e8ec87:::benchmark_data_smithi062_23645_object90827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.867 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.835822+0000", 2024-09-12T18:14:17.867 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0068085209999999997, 2024-09-12T18:14:17.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0069440489999999999, 2024-09-12T18:14:17.867 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 90828 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835822+0000", 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835822+0000", 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835823+0000", 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9300000000000006e-07 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835888+0000", 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4720000000000004e-05 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835899+0000", 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1008e-05 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.835906+0000", 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-06 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838500+0000", 2024-09-12T18:14:17.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025941940000000002 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838600+0000", 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010018699999999999 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838685+0000", 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5146000000000001e-05 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.872 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90825 5.6 e38/21 5:648ae041:::benchmark_data_smithi062_23645_object90824:head v 38'5619, mlcod=38'5617)", 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.837943+0000", 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0046879030000000002, 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0048569099999999999, 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837943+0000", 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837943+0000", 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837943+0000", 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5499999999999999e-07 2024-09-12T18:14:17.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837970+0000", 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7362e-05 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837978+0000", 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8979999999999996e-06 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837982+0000", 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8130000000000002e-06 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838031+0000", 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9410000000000003e-05 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838051+0000", 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9749999999999999e-05 2024-09-12T18:14:17.876 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90826 5.3 e38/21 5:cb5b8115:::benchmark_data_smithi062_23645_object90825:head v 38'5749, mlcod=38'5747)", 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.837991+0000", 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0046399479999999996, 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0048360900000000004, 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.877 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837991+0000", 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837991+0000", 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.837991+0000", 2024-09-12T18:14:17.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9299999999999999e-07 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838012+0000", 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.145e-05 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838018+0000", 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5439999999999998e-06 2024-09-12T18:14:17.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838023+0000", 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3569999999999997e-06 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838089+0000", 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6082999999999997e-05 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.838114+0000", 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4406e-05 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90830 5.d e38/21 5:bcb64029:::benchmark_data_smithi062_23645_object90829:head v 38'5720, mlcod=38'5718)", 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.839417+0000", 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0032131220000000001, 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003435792, 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.881 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839417+0000", 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839417+0000", 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839418+0000", 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9200000000000001e-07 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839488+0000", 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0098999999999994e-05 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839498+0000", 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:14:17.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839503+0000", 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839563+0000", 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9901999999999997e-05 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839586+0000", 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2870999999999998e-05 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:90835 5.7 5:eccab63d:::benchmark_data_smithi062_23645_object90834:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.839548+0000", 2024-09-12T18:14:17.885 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0030826299999999998, 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00333614, 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 90835 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839548+0000", 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839548+0000", 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839549+0000", 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1009999999999999e-06 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839580+0000", 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1115999999999998e-05 2024-09-12T18:14:17.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839589+0000", 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8170000000000005e-06 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839595+0000", 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3579999999999999e-06 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841565+0000", 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001969485 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841742+0000", 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000177023 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841917+0000", 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017516400000000001 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90833 5.c e38/21 5:34dbabf7:::benchmark_data_smithi062_23645_object90832:head v 38'5634, mlcod=38'5632)", 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.839970+0000", 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0026604860000000001, 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002946527, 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839970+0000", 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839970+0000", 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.839971+0000", 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5000000000000002e-07 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.840027+0000", 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6607999999999997e-05 2024-09-12T18:14:17.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.840045+0000", 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7734999999999999e-05 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.840051+0000", 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4409999999999998e-06 2024-09-12T18:14:17.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.840110+0000", 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8278e-05 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.840128+0000", 2024-09-12T18:14:17.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8695999999999999e-05 2024-09-12T18:14:17.896 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.896 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.896 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90832 5.d e38/21 5:b7dc1711:::benchmark_data_smithi062_23645_object90831:head v 38'5721, mlcod=38'5718)", 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.841812+0000", 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000818975, 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001131714, 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841812+0000", 2024-09-12T18:14:17.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841812+0000", 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841812+0000", 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841856+0000", 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3649999999999997e-05 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841873+0000", 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6753e-05 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841880+0000", 2024-09-12T18:14:17.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0820000000000001e-06 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841925+0000", 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5432000000000001e-05 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.841938+0000", 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3059e-05 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.900 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:90836 5.6 e38/21 5:665a8a89:::benchmark_data_smithi062_23645_object90835:head v 38'5620, mlcod=38'5617)", 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:17.842201+0000", 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00042964799999999998, 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00076867400000000001, 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:17.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842201+0000", 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842201+0000", 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842202+0000", 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7800000000000001e-07 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842255+0000", 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3631000000000002e-05 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842269+0000", 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3806e-05 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842277+0000", 2024-09-12T18:14:17.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9990000000000008e-06 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842329+0000", 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1894000000000002e-05 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:17.842353+0000", 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3711e-05 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.904 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:17.905 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:17.905 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 11 2024-09-12T18:14:17.905 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:14:17.907 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:17.907 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:17.903+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:18.006 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:18.003+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:18.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:18.061 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:18.061 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:18.061 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:18.062 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:18.062 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:18.083 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:18.126 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:18.125+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:18.209 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:18.207+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:18.224 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:18.224 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:18.239 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:18.239 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:18.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:18.239 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:18.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.240 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:18.240 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:18.240 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 65.943683402000005, 2024-09-12T18:14:18.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:18.240 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.240 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:18.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:18.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:18.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:18.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:18.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:18.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:18.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:18.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:18.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:18.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:18.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:18.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:18.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:18.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:18.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:18.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:18.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:18.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:18.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:18.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:18.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:18.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:18.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:18.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:18.254 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.254 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.254 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.255 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:18.255 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:18.255 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 65.139355100000003, 2024-09-12T18:14:18.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:18.255 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.256 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.256 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.256 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:18.256 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:18.256 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:18.257 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:18.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.257 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:18.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:18.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:18.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:18.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:18.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:18.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:18.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:18.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:18.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:18.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:18.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:18.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:18.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:18.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:18.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:18.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:18.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:18.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:18.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:18.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:18.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:18.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:18.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:18.268 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.268 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.269 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.269 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.269 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:18.270 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843759427000002, 2024-09-12T18:14:18.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:18.270 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.270 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.270 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:18.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:18.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:18.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843665752, 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:18.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:18.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:18.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843596521999999, 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:18.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.291 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.291 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:18.291 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843505755999999, 2024-09-12T18:14:18.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:18.291 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.291 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:18.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:18.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:18.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:18.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:18.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:18.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:18.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:18.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:18.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:18.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:18.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:18.300 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843444732999998, 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.301 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:18.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:18.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:18.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:18.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:18.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:18.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:18.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:18.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:18.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:18.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:18.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843385974, 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.311 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:18.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:18.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:18.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:18.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.843322923999999, 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:18.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:18.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:18.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.842522549999998, 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:18.326 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:18.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:18.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.842384348000003, 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:18.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:18.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:18.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.842321097999999, 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:18.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:18.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:18.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:18.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.841921130999999, 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:18.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:18.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:18.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.841823028999997, 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.354 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:18.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:18.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:18.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.363 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.841730636999998, 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:18.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:18.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:18.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.841643740000002, 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:18.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:18.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.379 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.841520117999998, 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:18.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.381 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.381 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.381 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.381 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:18.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.381 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:18.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:18.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:18.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:18.384 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.384 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:18.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:18.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.385 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.385 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:18.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:18.386 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.386 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.386 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.386 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:18.386 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:18.386 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.387 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.387 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:18.387 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:18.387 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:18.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:18.388 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:18.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:18.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:18.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:18.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:18.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:18.391 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.391 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.391 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.392 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:18.392 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:18.392 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 54.841128517999998, 2024-09-12T18:14:18.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:18.393 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.393 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.393 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:18.393 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:18.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.394 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:18.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.395 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:18.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:18.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:18.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:18.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:18.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.400 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78500 5.9 5:92ea3575:::benchmark_data_smithi062_23645_object78499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:18.401 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:18.401 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 6.3161172419999998, 2024-09-12T18:14:18.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022476556000000002, 2024-09-12T18:14:18.401 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.401 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.401 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.402 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:18.402 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:18.402 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:18.402 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78500 2024-09-12T18:14:18.402 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.402 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.403 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.403 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.403 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:18.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.403 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.403 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.404 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.404 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:18.404 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.404 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921728+0000", 2024-09-12T18:14:18.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.452e-06 2024-09-12T18:14:18.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921775+0000", 2024-09-12T18:14:18.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6910999999999999e-05 2024-09-12T18:14:18.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921787+0000", 2024-09-12T18:14:18.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1374e-05 2024-09-12T18:14:18.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921794+0000", 2024-09-12T18:14:18.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:14:18.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922416+0000", 2024-09-12T18:14:18.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00062186399999999997 2024-09-12T18:14:18.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.409 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.409 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.409 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922566+0000", 2024-09-12T18:14:18.409 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014947800000000001 2024-09-12T18:14:18.409 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.410 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.410 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.410 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922716+0000", 2024-09-12T18:14:18.410 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0001505 2024-09-12T18:14:18.410 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.411 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.411 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931674+0000", 2024-09-12T18:14:18.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0089579459999999996 2024-09-12T18:14:18.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944113+0000", 2024-09-12T18:14:18.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012438362 2024-09-12T18:14:18.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944168+0000", 2024-09-12T18:14:18.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5464000000000003e-05 2024-09-12T18:14:18.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944203+0000", 2024-09-12T18:14:18.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5352000000000003e-05 2024-09-12T18:14:18.414 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.414 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78501 5.9 5:9283cf68:::benchmark_data_smithi062_23645_object78500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 6.3159866090000003, 2024-09-12T18:14:18.416 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022418885, 2024-09-12T18:14:18.416 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:18.416 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:18.416 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:18.416 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:18.417 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:18.417 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:18.417 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78501 2024-09-12T18:14:18.417 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.417 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:18.417 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.418 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:18.418 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:18.418 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.418 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.418 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.418 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:18.419 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:18.419 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:18.419 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.419 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.419 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:18.420 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921858+0000", 2024-09-12T18:14:18.420 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:14:18.420 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.420 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.420 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:18.421 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921919+0000", 2024-09-12T18:14:18.421 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1251e-05 2024-09-12T18:14:18.421 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.421 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.422 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:18.422 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921926+0000", 2024-09-12T18:14:18.422 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:18.423 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.423 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.423 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:18.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921930+0000", 2024-09-12T18:14:18.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3440000000000003e-06 2024-09-12T18:14:18.424 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.424 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:18.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.926849+0000", 2024-09-12T18:14:18.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049193279999999997 2024-09-12T18:14:18.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:18.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927003+0000", 2024-09-12T18:14:18.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000153542 2024-09-12T18:14:18.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927167+0000", 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000163962 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931705+0000", 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045380359999999996 2024-09-12T18:14:18.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.428 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:18.428 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944215+0000", 2024-09-12T18:14:18.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012510037999999999 2024-09-12T18:14:18.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:18.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944246+0000", 2024-09-12T18:14:18.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0613e-05 2024-09-12T18:14:18.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:18.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:18.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944276+0000", 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0685000000000002e-05 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:18.430 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:18.431 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:18.432 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:18.432 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:18.428+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:18.433 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:18.433 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:18.434 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:18.435 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:18.435 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 38 16 92001 91985 151.275 129.625 0.00677582 0.00660612 2024-09-12T18:14:18.532 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:18.528+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:18.590 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:18.590 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:18.592 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:14:18.592 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:18.592 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T18:14:18.593 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:14:18.593 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:14:18.594 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T18:14:18.613 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:18.657 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:18.656+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:18.735 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:18.733+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:18.748 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:18.748 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:14:18.748 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:18.816 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:18.816 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:18.836 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:18.831+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:18.838 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:18.937 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:18.933+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:18.992 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:18.993 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:19.011 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:19.057 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.055+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.138 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.135+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.164 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:19.164 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:19.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:19.273 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.271+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.340 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.335+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.378 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:19.378 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:19.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:19.402 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 39 16 94063 94047 150.7 128.875 0.00800943 0.0066311 2024-09-12T18:14:19.440 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:19.436+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:19.541 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.539+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.592 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:19.593 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:19.612 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:19.658 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:19.657+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:19.743 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:19.741+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:19.770 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:19.770 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:19.788 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:19.870 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.843+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:14:19.945 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:19.943+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:19.971 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:19.971 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:19.991 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:20.046 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:20.045+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:20.144 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:20.144 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:20.149 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:20.144+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:20.164 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:20.292 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:20.293 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:20.299 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:20.248+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:20.313 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:20.353 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:20.349+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:20.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:2024-09-12T18:14:20.404875+0000 min lat: 0.0015127 max lat: 0.116233 avg lat: 0.00669515 2024-09-12T18:14:20.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-12T18:14:20.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 40 16 95550 95534 149.256 92.9375 0.00621809 0.00669515 2024-09-12T18:14:20.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:20.453 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:20.452+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:20.458 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:20.458 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:20.482 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:20.554 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:20.553+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:20.602 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:20.603 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:20.622 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:20.623 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:20.641 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:20.641 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:20.655 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:20.652+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:20.683 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:13 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.291478892999997, 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042187885000000001, 2024-09-12T18:14:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391030+0000", 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391036+0000", 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6659999999999996e-06 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391045+0000", 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6299999999999993e-06 2024-09-12T18:14:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391068+0000", 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2583e-05 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391092+0000", 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4267e-05 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391213+0000", 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120945 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391229+0000", 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5330000000000001e-05 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413644+0000", 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022415026000000001 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414449+0000", 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00080579700000000002 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.414816+0000", 2024-09-12T18:14:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036692400000000003 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425719+0000", 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902662 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433078+0000", 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073585760000000004 2024-09-12T18:14:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433160+0000", 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2033999999999994e-05 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433218+0000", 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8445e-05 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:14 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.291363531000002, 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042959703000000002, 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391146+0000", 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391147+0000", 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.567e-06 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391156+0000", 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391178+0000", 2024-09-12T18:14:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1763000000000002e-05 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391197+0000", 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9678999999999999e-05 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391289+0000", 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1303000000000003e-05 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391298+0000", 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0100000000000001e-06 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.418859+0000", 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027561598999999999 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419370+0000", 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051074599999999996 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.419670+0000", 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00029949499999999999 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425744+0000", 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060744459999999998 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433880+0000", 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081355669999999998 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434015+0000", 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135539 2024-09-12T18:14:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434105+0000", 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0109000000000001e-05 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:17 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.291282565000003, 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040164897999999997, 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391227+0000", 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391228+0000", 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-09-12T18:14:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391261+0000", 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2740000000000002e-05 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391283+0000", 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1682999999999999e-05 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391299+0000", 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6163000000000001e-05 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391410+0000", 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110973 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5470000000000002e-06 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410443+0000", 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019026254999999999 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.411734+0000", 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001291307 2024-09-12T18:14:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.412040+0000", 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030620700000000002 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.416743+0000", 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047029940000000003 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431164+0000", 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014420951 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431282+0000", 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118286 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431391+0000", 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108979 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.291178053000003, 2024-09-12T18:14:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.042103756999999999, 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391331+0000", 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391332+0000", 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391340+0000", 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8469999999999996e-06 2024-09-12T18:14:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391360+0000", 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9286000000000001e-05 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391375+0000", 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5404e-05 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391535+0000", 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000160428 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391548+0000", 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.225e-05 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415491+0000", 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023943267000000001 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415708+0000", 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000216615 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.415934+0000", 2024-09-12T18:14:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00022606899999999999 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425732+0000", 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097985969999999992 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433280+0000", 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075480490000000003 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433371+0000", 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0649000000000006e-05 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.433435+0000", 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3879000000000003e-05 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.291094110000003, 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043188844999999997, 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391415+0000", 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391416+0000", 2024-09-12T18:14:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.217e-06 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391442+0000", 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5496000000000001e-05 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391462+0000", 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9983000000000002e-05 2024-09-12T18:14:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391477+0000", 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5264000000000002e-05 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391604+0000", 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000126632 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6899999999999992e-06 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420455+0000", 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.028843789000000002 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420653+0000", 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019792200000000001 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.420931+0000", 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027781799999999999 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427665+0000", 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067342110000000004 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434302+0000", 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066367960000000004 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434437+0000", 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013541900000000001 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434604+0000", 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000166608 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.290971163999998, 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.040251881000000003, 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391538+0000", 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391539+0000", 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3370000000000001e-06 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391546+0000", 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391566+0000", 2024-09-12T18:14:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391582+0000", 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6229999999999999e-05 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391687+0000", 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010434599999999999 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391695+0000", 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.49e-06 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413106+0000", 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021410680000000001 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413222+0000", 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116286 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.413420+0000", 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000197651 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422818+0000", 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093983399999999998 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431526+0000", 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0087078069999999997 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431663+0000", 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000137255 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.431790+0000", 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012669299999999999 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.290899654999997, 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.043022233, 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391609+0000", 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391611+0000", 2024-09-12T18:14:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2440000000000001e-06 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391618+0000", 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391636+0000", 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7674000000000001e-05 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391650+0000", 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391715+0000", 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5075999999999998e-05 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391721+0000", 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5729999999999998e-06 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422262+0000", 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030541186000000001 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422596+0000", 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033406700000000001 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.422935+0000", 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033853799999999999 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.428986+0000", 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006051397 2024-09-12T18:14:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434398+0000", 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054117640000000003 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434526+0000", 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000127883 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.434632+0000", 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105852 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.290834754999999, 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.039093833000000001, 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391674+0000", 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391676+0000", 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.33e-06 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391681+0000", 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9699999999999998e-06 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391703+0000", 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2566e-05 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391717+0000", 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4103e-05 2024-09-12T18:14:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391826+0000", 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108999 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391839+0000", 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2694000000000001e-05 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410092+0000", 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018253234 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.410359+0000", 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026685499999999998 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.430768+0000", 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020409081999999999 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.290765288999999, 2024-09-12T18:14:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036149750000000001, 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391744+0000", 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391746+0000", 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7370000000000001e-06 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391752+0000", 2024-09-12T18:14:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391769+0000", 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7897000000000002e-05 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391783+0000", 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.348e-05 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391858+0000", 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5295000000000003e-05 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.391865+0000", 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.408237+0000", 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016372250000000001 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.409428+0000", 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001190913 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.427894+0000", 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018465168000000001 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:23 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.276347127999998, 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019535716000000002, 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406162+0000", 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406163+0000", 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-09-12T18:14:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406174+0000", 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1167e-05 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406193+0000", 2024-09-12T18:14:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8868999999999998e-05 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.406206+0000", 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.239e-05 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407858+0000", 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016524039999999999 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.407906+0000", 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8022999999999997e-05 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425611+0000", 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017704936000000001 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:23.425698+0000", 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-09-12T18:14:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:15918 5.b 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.436846181, 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021538187, 2024-09-12T18:14:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 15918 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245663+0000", 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245692+0000", 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8462999999999998e-05 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245697+0000", 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5280000000000003e-06 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.245701+0000", 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.168e-06 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246670+0000", 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096976699999999996 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246835+0000", 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016499799999999999 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.246980+0000", 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014462899999999999 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.255205+0000", 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082251029999999992 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267120+0000", 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011915169999999999 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267158+0000", 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7354000000000002e-05 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:13:45.267201+0000", 2024-09-12T18:14:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3427999999999998e-05 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72759 5.4 5:2a23e3dd:::benchmark_data_smithi062_23645_object72758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.534307132, 2024-09-12T18:14:20.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019309862000000001, 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72759 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.766 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148202+0000", 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148203+0000", 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.08e-06 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148395+0000", 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000192313 2024-09-12T18:14:20.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148404+0000", 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.148410+0000", 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2430000000000002e-06 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150393+0000", 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019825250000000002 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150467+0000", 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3622999999999996e-05 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.150561+0000", 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4191999999999995e-05 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.153681+0000", 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031201340000000001 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167403+0000", 2024-09-12T18:14:20.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013722447 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167464+0000", 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0825000000000001e-05 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.167512+0000", 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7593999999999999e-05 2024-09-12T18:14:20.772 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72983 5.0 5:094817b2:::benchmark_data_smithi062_23645_object72982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.426876837, 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020466501000000002, 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.773 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72983 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.774 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255632+0000", 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255633+0000", 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8200000000000001e-07 2024-09-12T18:14:20.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255698+0000", 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5612999999999997e-05 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255705+0000", 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8040000000000004e-06 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.255715+0000", 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8579999999999995e-06 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264776+0000", 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090614019999999997 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264857+0000", 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0699999999999996e-05 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.264945+0000", 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8412000000000007e-05 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274553+0000", 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096073900000000004 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276047+0000", 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001493879 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276076+0000", 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8988000000000001e-05 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.276099+0000", 2024-09-12T18:14:20.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3073000000000001e-05 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72986 5.0 5:07446845:::benchmark_data_smithi062_23645_object72985:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.422903448, 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019504352999999999, 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.781 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72986 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259606+0000", 2024-09-12T18:14:20.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259607+0000", 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.097e-06 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259667+0000", 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0408999999999997e-05 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259679+0000", 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2216e-05 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.259685+0000", 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6210000000000001e-06 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266213+0000", 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00652785 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266348+0000", 2024-09-12T18:14:20.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013515399999999999 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.266508+0000", 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000159851 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.277410+0000", 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010902159999999999 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279012+0000", 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016019610000000001 2024-09-12T18:14:20.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279065+0000", 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3263999999999997e-05 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.279110+0000", 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.477e-05 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.790 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72992 5.0 5:00f4008c:::benchmark_data_smithi062_23645_object72991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.421202939, 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022141033000000001, 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.791 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72992 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261306+0000", 2024-09-12T18:14:20.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261307+0000", 2024-09-12T18:14:20.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2200000000000003e-07 2024-09-12T18:14:20.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261386+0000", 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8980999999999995e-05 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261395+0000", 2024-09-12T18:14:20.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9900000000000003e-06 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.261402+0000", 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0049999999999998e-06 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.269633+0000", 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082313960000000002 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.269790+0000", 2024-09-12T18:14:20.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015663600000000001 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.270114+0000", 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032398799999999999 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.277416+0000", 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.007301676 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283386+0000", 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059702440000000004 2024-09-12T18:14:20.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283420+0000", 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3936000000000002e-05 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283447+0000", 2024-09-12T18:14:20.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7359e-05 2024-09-12T18:14:20.801 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.801 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.802 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.802 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:72993 5.0 5:027dc36e:::benchmark_data_smithi062_23645_object72992:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:20.802 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:20.802 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.419246598999999, 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024378153999999999, 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.803 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.804 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 72993 2024-09-12T18:14:20.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.804 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.805 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:20.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263262+0000", 2024-09-12T18:14:20.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263263+0000", 2024-09-12T18:14:20.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8100000000000002e-07 2024-09-12T18:14:20.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263354+0000", 2024-09-12T18:14:20.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1252e-05 2024-09-12T18:14:20.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263365+0000", 2024-09-12T18:14:20.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0471e-05 2024-09-12T18:14:20.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.263374+0000", 2024-09-12T18:14:20.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8820000000000007e-06 2024-09-12T18:14:20.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272483+0000", 2024-09-12T18:14:20.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091092410000000006 2024-09-12T18:14:20.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272619+0000", 2024-09-12T18:14:20.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013574 2024-09-12T18:14:20.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.272784+0000", 2024-09-12T18:14:20.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000165241 2024-09-12T18:14:20.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.813 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.281089+0000", 2024-09-12T18:14:20.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083047180000000009 2024-09-12T18:14:20.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287569+0000", 2024-09-12T18:14:20.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064803020000000003 2024-09-12T18:14:20.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287616+0000", 2024-09-12T18:14:20.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6863999999999997e-05 2024-09-12T18:14:20.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287641+0000", 2024-09-12T18:14:20.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4762000000000001e-05 2024-09-12T18:14:20.816 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.817 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.817 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.817 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:73000 5.8 5:106cd630:::benchmark_data_smithi062_23645_object72999:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:20.818 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:20.818 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.417164819, 2024-09-12T18:14:20.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.022436998999999999, 2024-09-12T18:14:20.818 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.818 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.818 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 73000 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265344+0000", 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265345+0000", 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4799999999999998e-07 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265399+0000", 2024-09-12T18:14:20.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3993000000000003e-05 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265406+0000", 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6059999999999997e-06 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.265410+0000", 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9650000000000002e-06 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274589+0000", 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0091783000000000003 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274719+0000", 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013009799999999999 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.274877+0000", 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015795199999999999 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.283374+0000", 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084975529999999997 2024-09-12T18:14:20.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287690+0000", 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00431622 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287741+0000", 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0225000000000001e-05 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:09.287781+0000", 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0538999999999999e-05 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.827 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:80768 5.8 5:1972d66f:::benchmark_data_smithi062_23645_object80767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:12.997925+0000", 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.6845840240000003, 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019960835999999999, 2024-09-12T18:14:20.828 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 80768 2024-09-12T18:14:20.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.997925+0000", 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.997925+0000", 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.997926+0000", 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-09-12T18:14:20.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.998032+0000", 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010590300000000001 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.998040+0000", 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8329999999999994e-06 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:12.998045+0000", 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8039999999999998e-06 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.002890+0000", 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048441339999999999 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.002987+0000", 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6995000000000002e-05 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.835 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.003069+0000", 2024-09-12T18:14:20.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2853000000000001e-05 2024-09-12T18:14:20.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.008405+0000", 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053353109999999997 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.017827+0000", 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0094220889999999998 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.017860+0000", 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3467000000000003e-05 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:13.017886+0000", 2024-09-12T18:14:20.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5598000000000001e-05 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:88304 5.8 5:16498d7a:::benchmark_data_smithi062_23645_object88303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0668375020000003, 2024-09-12T18:14:20.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020759449999999999, 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 88304 2024-09-12T18:14:20.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615672+0000", 2024-09-12T18:14:20.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615708+0000", 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957000000000001e-05 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615717+0000", 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7860000000000002e-06 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.615722+0000", 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0490000000000003e-06 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.625077+0000", 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093553279999999996 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.625192+0000", 2024-09-12T18:14:20.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114502 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.625277+0000", 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5373999999999999e-05 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.633623+0000", 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083460489999999995 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.636362+0000", 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027385589999999998 2024-09-12T18:14:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.636398+0000", 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6508999999999999e-05 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.636431+0000", 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2771999999999997e-05 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.848 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:88640 5.b 5:dff012fd:::benchmark_data_smithi062_23645_object88639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-12T18:14:20.849 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:16.784284+0000", 2024-09-12T18:14:20.849 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.8982248429999999, 2024-09-12T18:14:20.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020028456, 2024-09-12T18:14:20.849 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:20.849 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:20.849 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 88640 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.784284+0000", 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.784284+0000", 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:20.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:20.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.784285+0000", 2024-09-12T18:14:20.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1600000000000001e-07 2024-09-12T18:14:20.852 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.784354+0000", 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8743000000000002e-05 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.784362+0000", 2024-09-12T18:14:20.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3420000000000008e-06 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.784367+0000", 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5000000000000001e-06 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:20.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.789080+0000", 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047139199999999999 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.789224+0000", 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000143213 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:20.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.789371+0000", 2024-09-12T18:14:20.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014731299999999999 2024-09-12T18:14:20.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:20.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.792831+0000", 2024-09-12T18:14:20.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034595609999999999 2024-09-12T18:14:20.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:20.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.804247+0000", 2024-09-12T18:14:20.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011416186 2024-09-12T18:14:20.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-09-12T18:14:20.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.804277+0000", 2024-09-12T18:14:20.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0434999999999999e-05 2024-09-12T18:14:20.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:20.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:20.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-09-12T18:14:20.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:16.804313+0000", 2024-09-12T18:14:20.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5527000000000001e-05 2024-09-12T18:14:20.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.860 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:20.860 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:20.860 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:20.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:20.868 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:20.863+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:20.926 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:14:20.963 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:20.960+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96761 5.5 5:a4b5c943:::benchmark_data_smithi062_23645_object96760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.032134+0000", 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0066881989999999997, 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067105489999999997, 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.039 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96761 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032134+0000", 2024-09-12T18:14:21.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032134+0000", 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032135+0000", 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5700000000000002e-07 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032177+0000", 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2097e-05 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032197+0000", 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0639e-05 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032205+0000", 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5020000000000003e-06 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034010+0000", 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001805355 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034160+0000", 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014924099999999999 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034315+0000", 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000155618 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:96765 5.b e40/21 5:dc683ac9:::benchmark_data_smithi062_23645_object96764:head v 40'5932, mlcod=40'5930)", 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.032913+0000", 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00590933, 2024-09-12T18:14:21.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059756970000000003, 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032913+0000", 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032913+0000", 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.032914+0000", 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.033029+0000", 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115769 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.033041+0000", 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.033047+0000", 2024-09-12T18:14:21.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6800000000000004e-06 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034122+0000", 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001074466 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034133+0000", 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1007e-05 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.048 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96766 5.5 5:a79e96d4:::benchmark_data_smithi062_23645_object96765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.033985+0000", 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0048369909999999997, 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049356490000000003, 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.049 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96766 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.033985+0000", 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.033985+0000", 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.033987+0000", 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-06 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034024+0000", 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7107000000000002e-05 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034036+0000", 2024-09-12T18:14:21.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2065000000000001e-05 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.034043+0000", 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5549999999999997e-06 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036273+0000", 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022294659999999998 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036423+0000", 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015047699999999999 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036614+0000", 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000190223 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.053 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:96767 5.1 e40/21 5:873b45fc:::benchmark_data_smithi062_23645_object96766:head v 40'6087, mlcod=40'6085)", 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.035179+0000", 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003643411, 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037767429999999999, 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035179+0000", 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035179+0000", 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035180+0000", 2024-09-12T18:14:21.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2300000000000001e-07 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035241+0000", 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1087999999999995e-05 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035254+0000", 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3654e-05 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035260+0000", 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8599999999999998e-06 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035314+0000", 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3529000000000002e-05 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.035335+0000", 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1557e-05 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.058 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96769 5.6 5:66066ff9:::benchmark_data_smithi062_23645_object96768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.036852+0000", 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0019702529999999999, 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021358729999999999, 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96769 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036852+0000", 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036852+0000", 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036853+0000", 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1570000000000001e-06 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036895+0000", 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2194999999999998e-05 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036908+0000", 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2116999999999999e-05 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036917+0000", 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0499999999999997e-06 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037002+0000", 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5389999999999994e-05 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037137+0000", 2024-09-12T18:14:21.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013490400000000001 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037302+0000", 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000165079 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96770 5.6 5.9bfdd6c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.036941+0000", 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001881714, 2024-09-12T18:14:21.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020811699999999998, 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96770 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036941+0000", 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036941+0000", 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036942+0000", 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0809999999999999e-06 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036983+0000", 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1730999999999997e-05 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036993+0000", 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.217e-06 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.036999+0000", 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9989999999999997e-06 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.067 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96773 5.a 5:56d0c4d1:::benchmark_data_smithi062_23645_object96772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.037011+0000", 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001810849, 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020387019999999999, 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96773 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037011+0000", 2024-09-12T18:14:21.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037011+0000", 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037012+0000", 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1500000000000005e-07 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037055+0000", 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2923000000000002e-05 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037192+0000", 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013716100000000001 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037213+0000", 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0910000000000001e-05 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037286+0000", 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2985999999999995e-05 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037428+0000", 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014213799999999999 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037571+0000", 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014283300000000001 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96774 5.a 5.60343a6a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.074 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.037250+0000", 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001572059, 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018349519999999999, 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96774 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037250+0000", 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037250+0000", 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037251+0000", 2024-09-12T18:14:21.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0580000000000001e-06 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037286+0000", 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4434000000000003e-05 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037297+0000", 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1045e-05 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037303+0000", 2024-09-12T18:14:21.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:21.078 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.078 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.078 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:96768 5.2 e40/21)", 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.037251+0000", 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0015708569999999999, 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001857919, 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037251+0000", 2024-09-12T18:14:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037251+0000", 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037252+0000", 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0499999999999999e-07 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037325+0000", 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2837999999999996e-05 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037334+0000", 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9789999999999999e-06 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037339+0000", 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7819999999999999e-06 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.081 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:96771 5.0 e40/21 5:064a62a3:::benchmark_data_smithi062_23645_object96770:head v 40'6003, mlcod=40'6001)", 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.037359+0000", 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014636619999999999, 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017743539999999999, 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037359+0000", 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037359+0000", 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037359+0000", 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9200000000000001e-07 2024-09-12T18:14:21.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037491+0000", 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013198600000000001 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037498+0000", 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:21.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037502+0000", 2024-09-12T18:14:21.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8319999999999999e-06 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037547+0000", 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5778000000000001e-05 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037567+0000", 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9225e-05 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.086 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:96776 5.7 e40/21 5:e6a27600:::benchmark_data_smithi062_23645_object96775:head v 40'5928, mlcod=40'5926)", 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.037727+0000", 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001094863, 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014331840000000001, 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037727+0000", 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037727+0000", 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037728+0000", 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4799999999999999e-07 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037835+0000", 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107235 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037844+0000", 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8179999999999993e-06 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037850+0000", 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6860000000000003e-06 2024-09-12T18:14:21.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037911+0000", 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1557999999999996e-05 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037934+0000", 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2617999999999999e-05 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:96777 5.e e40/21)", 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.037777+0000", 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001045411, 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014094330000000001, 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037777+0000", 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037777+0000", 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037778+0000", 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0500000000000002e-07 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037847+0000", 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9052000000000002e-05 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037856+0000", 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6940000000000007e-06 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.037863+0000", 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.144e-06 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.093 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.094 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:21.094 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2024-09-12T18:14:21.094 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:21.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:21.096 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:21.092+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:21.196 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:21.192+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:21.264 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:21.265 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:21.265 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:21.265 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:21.265 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:21.289 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:21.337 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:21.335+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:21.401 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:21.396+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:21.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 41 16 97449 97433 148.51 118.688 0.00605611 0.00672909 2024-09-12T18:14:21.458 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.053027426, 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.459 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:21.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.048826961000003, 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.464 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:21.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.048710202000002, 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.048641066000002, 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.048529314, 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.048365492000002, 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.048304725999998, 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.213341563, 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.207577823000001, 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 35.825096275999996, 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:21.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.518 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:61129 5.1 e34/21 5:8eb73760:::benchmark_data_smithi062_23645_object61128:head v 34'3864, mlcod=34'3862)", 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.8403785, 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017014511, 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:21.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:21.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:21.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:21.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613902+0000", 2024-09-12T18:14:21.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6225999999999999e-05 2024-09-12T18:14:21.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613910+0000", 2024-09-12T18:14:21.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3389999999999993e-06 2024-09-12T18:14:21.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613917+0000", 2024-09-12T18:14:21.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999999e-06 2024-09-12T18:14:21.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613972+0000", 2024-09-12T18:14:21.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4729999999999999e-05 2024-09-12T18:14:21.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613990+0000", 2024-09-12T18:14:21.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8097999999999999e-05 2024-09-12T18:14:21.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630793+0000", 2024-09-12T18:14:21.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016803604 2024-09-12T18:14:21.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630849+0000", 2024-09-12T18:14:21.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6137999999999997e-05 2024-09-12T18:14:21.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.528 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.528 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:21.529 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:21.529 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.729461130000001, 2024-09-12T18:14:21.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:21.529 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.529 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.530 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.530 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:21.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.531 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:21.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:21.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:21.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:21.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:21.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:69118 5.c 5:3c73a29c:::benchmark_data_smithi062_23645_object69117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.037775385, 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016585826000000001, 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69118 2024-09-12T18:14:21.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416439+0000", 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416520+0000", 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1144999999999996e-05 2024-09-12T18:14:21.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416530+0000", 2024-09-12T18:14:21.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0345e-05 2024-09-12T18:14:21.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416537+0000", 2024-09-12T18:14:21.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8290000000000002e-06 2024-09-12T18:14:21.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.419825+0000", 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032876820000000001 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.421805+0000", 2024-09-12T18:14:21.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019806490000000001 2024-09-12T18:14:21.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.422103+0000", 2024-09-12T18:14:21.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029764100000000002 2024-09-12T18:14:21.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.426179+0000", 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040759409999999996 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.432963+0000", 2024-09-12T18:14:21.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067841280000000004 2024-09-12T18:14:21.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433002+0000", 2024-09-12T18:14:21.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9190000000000003e-05 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433024+0000", 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.548 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:71164 5.5 5:aa7a4e3c:::benchmark_data_smithi062_23645_object71163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:21.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:21.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.072000813000001, 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016377579, 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 71164 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:21.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382213+0000", 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9599999999999998e-07 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382296+0000", 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2130000000000001e-05 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382306+0000", 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0327e-05 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.382311+0000", 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0220000000000004e-06 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383026+0000", 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071518999999999999 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383141+0000", 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114503 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.383311+0000", 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017065900000000001 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.386723+0000", 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003412099 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398515+0000", 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011791375 2024-09-12T18:14:21.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398559+0000", 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4016e-05 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:08.398590+0000", 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1362000000000002e-05 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.556 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:72759 5.4 e36/21 5:2a23e3dd:::benchmark_data_smithi062_23645_object72758:head v 36'4602, mlcod=36'4599)", 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.303636309, 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016567460999999999, 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150577+0000", 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150578+0000", 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8599999999999998e-07 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150673+0000", 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5461e-05 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150682+0000", 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7239999999999998e-06 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.150689+0000", 2024-09-12T18:14:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5700000000000004e-06 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152657+0000", 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019679810000000002 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152694+0000", 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167104+0000", 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014409580999999999 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167145+0000", 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0635e-05 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.561 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72767 5.c 5:3d19f5c3:::benchmark_data_smithi062_23645_object72766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.301644958000001, 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017300254000000001, 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72767 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:21.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152569+0000", 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153984+0000", 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001414713 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153994+0000", 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7079999999999992e-06 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.154000+0000", 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000001e-06 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155208+0000", 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012075689999999999 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155336+0000", 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012841299999999999 2024-09-12T18:14:21.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155481+0000", 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014465499999999999 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167316+0000", 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011835215 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169776+0000", 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024603310000000001 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169828+0000", 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440999999999998e-05 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169869+0000", 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1056000000000001e-05 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96623 5.6 5:6c0b3156:::benchmark_data_smithi062_23645_object96622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:20.954635+0000", 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.499578101, 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016578978000000001, 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96623 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954635+0000", 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954635+0000", 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954636+0000", 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954682+0000", 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5677999999999999e-05 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954690+0000", 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3459999999999994e-06 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954696+0000", 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3680000000000001e-06 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.959815+0000", 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051189199999999999 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.959968+0000", 2024-09-12T18:14:21.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015301799999999999 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.960170+0000", 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020274400000000001 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.968285+0000", 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081141919999999992 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.971129+0000", 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028440829999999999 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.971178+0000", 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8980000000000002e-05 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.971214+0000", 2024-09-12T18:14:21.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6559e-05 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96647 5.a 5:5d01fd3c:::benchmark_data_smithi062_23645_object96646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:20.969500+0000", 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.48471329099999999, 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016511109, 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96647 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969500+0000", 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969500+0000", 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969502+0000", 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.404e-06 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969600+0000", 2024-09-12T18:14:21.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8845000000000007e-05 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969613+0000", 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.22e-05 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969621+0000", 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5480000000000002e-06 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969673+0000", 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2306999999999999e-05 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969757+0000", 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.373e-05 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.969844+0000", 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6385999999999996e-05 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.974040+0000", 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041968459999999997 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.985890+0000", 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011849237 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.985952+0000", 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1938000000000002e-05 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.986011+0000", 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9667999999999999e-05 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:97341 5.c 5:31a5055b:::benchmark_data_smithi062_23645_object97340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.112914297, 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017069225, 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 97341 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341300+0000", 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341329+0000", 2024-09-12T18:14:21.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8912e-05 2024-09-12T18:14:21.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341339+0000", 2024-09-12T18:14:21.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0117e-05 2024-09-12T18:14:21.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341345+0000", 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9220000000000002e-06 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341752+0000", 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040689099999999999 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341872+0000", 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120728 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.342018+0000", 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014604799999999999 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.350193+0000", 2024-09-12T18:14:21.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081745759999999994 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358267+0000", 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080736120000000008 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358320+0000", 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3006e-05 2024-09-12T18:14:21.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358368+0000", 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8730000000000003e-05 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:97345 5.e e40/21 5:7d54bab1:::benchmark_data_smithi062_23645_object97344:head v 40'6064, mlcod=40'6059)", 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.347073+0000", 2024-09-12T18:14:21.591 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.107140192, 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016711871999999999, 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:21.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347073+0000", 2024-09-12T18:14:21.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:21.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347073+0000", 2024-09-12T18:14:21.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347074+0000", 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9199999999999999e-07 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347124+0000", 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9425999999999997e-05 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347138+0000", 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347146+0000", 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970000000000001e-06 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.348980+0000", 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018340730000000001 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.349000+0000", 2024-09-12T18:14:21.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9922e-05 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.363740+0000", 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014739785 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.363785+0000", 2024-09-12T18:14:21.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4963999999999998e-05 2024-09-12T18:14:21.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.598 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:21.598 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:21.598 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:21.600 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:21.600 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:21.595+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:21.700 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:21.696+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:21.756 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:21.756 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:21.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.757 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:98128 5.9 5:9c3a0c65:::benchmark_data_smithi062_23645_object98127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.757 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:21.748562+0000", 2024-09-12T18:14:21.757 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.007354658, 2024-09-12T18:14:21.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073846240000000002, 2024-09-12T18:14:21.758 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:21.758 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:21.758 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.758 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:21.758 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:21.759 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.759 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 98128 2024-09-12T18:14:21.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.759 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:21.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:21.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748562+0000", 2024-09-12T18:14:21.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:21.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748562+0000", 2024-09-12T18:14:21.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:21.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748563+0000", 2024-09-12T18:14:21.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6400000000000001e-07 2024-09-12T18:14:21.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:21.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748720+0000", 2024-09-12T18:14:21.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0001572 2024-09-12T18:14:21.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:21.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748729+0000", 2024-09-12T18:14:21.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.268e-06 2024-09-12T18:14:21.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748737+0000", 2024-09-12T18:14:21.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8089999999999993e-06 2024-09-12T18:14:21.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:21.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748797+0000", 2024-09-12T18:14:21.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9883000000000002e-05 2024-09-12T18:14:21.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:21.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.748926+0000", 2024-09-12T18:14:21.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012873800000000001 2024-09-12T18:14:21.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.749075+0000", 2024-09-12T18:14:21.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014916500000000001 2024-09-12T18:14:21.768 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.768 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:21.769 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.769 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:98135 5.9 5:944c9a75:::benchmark_data_smithi062_23645_object98134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.769 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:21.750883+0000", 2024-09-12T18:14:21.769 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0050331079999999997, 2024-09-12T18:14:21.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051482630000000001, 2024-09-12T18:14:21.770 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:21.770 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:21.770 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.770 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:21.771 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:21.771 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.771 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 98135 2024-09-12T18:14:21.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.771 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:21.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:21.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.750883+0000", 2024-09-12T18:14:21.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:21.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.750883+0000", 2024-09-12T18:14:21.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:21.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.750884+0000", 2024-09-12T18:14:21.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.031e-06 2024-09-12T18:14:21.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:21.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.750925+0000", 2024-09-12T18:14:21.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0469000000000002e-05 2024-09-12T18:14:21.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:21.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.750935+0000", 2024-09-12T18:14:21.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9010000000000006e-06 2024-09-12T18:14:21.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.750942+0000", 2024-09-12T18:14:21.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.866e-06 2024-09-12T18:14:21.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:21.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751355+0000", 2024-09-12T18:14:21.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00041358200000000001 2024-09-12T18:14:21.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:21.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751445+0000", 2024-09-12T18:14:21.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9807000000000003e-05 2024-09-12T18:14:21.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751535+0000", 2024-09-12T18:14:21.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0005000000000003e-05 2024-09-12T18:14:21.780 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.780 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:21.780 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.781 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:98137 5.9 5:9b68f7c6:::benchmark_data_smithi062_23645_object98136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.781 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:21.751734+0000", 2024-09-12T18:14:21.781 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0041827100000000001, 2024-09-12T18:14:21.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0043702669999999997, 2024-09-12T18:14:21.782 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:21.782 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:21.782 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.782 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:21.782 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:21.783 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.783 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 98137 2024-09-12T18:14:21.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.783 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:21.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:21.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751734+0000", 2024-09-12T18:14:21.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:21.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751734+0000", 2024-09-12T18:14:21.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:21.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751735+0000", 2024-09-12T18:14:21.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:14:21.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:21.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751815+0000", 2024-09-12T18:14:21.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9834999999999997e-05 2024-09-12T18:14:21.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:21.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751828+0000", 2024-09-12T18:14:21.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2914e-05 2024-09-12T18:14:21.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.751834+0000", 2024-09-12T18:14:21.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7769999999999997e-06 2024-09-12T18:14:21.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:21.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753648+0000", 2024-09-12T18:14:21.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001813357 2024-09-12T18:14:21.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:21.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753812+0000", 2024-09-12T18:14:21.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00016378599999999999 2024-09-12T18:14:21.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:21.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.754054+0000", 2024-09-12T18:14:21.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024247799999999999 2024-09-12T18:14:21.793 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.793 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:21.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.794 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:98132 5.6 e40/21 5:61368cf6:::benchmark_data_smithi062_23645_object98131:head v 40'6076, mlcod=40'6072)", 2024-09-12T18:14:21.794 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:21.753340+0000", 2024-09-12T18:14:21.795 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0025770459999999999, 2024-09-12T18:14:21.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028352619999999999, 2024-09-12T18:14:21.795 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:21.795 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:21.795 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:21.796 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:21.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:21.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753340+0000", 2024-09-12T18:14:21.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:21.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753340+0000", 2024-09-12T18:14:21.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:21.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753340+0000", 2024-09-12T18:14:21.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9500000000000002e-07 2024-09-12T18:14:21.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:21.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753393+0000", 2024-09-12T18:14:21.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2775999999999998e-05 2024-09-12T18:14:21.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:21.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753405+0000", 2024-09-12T18:14:21.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2002e-05 2024-09-12T18:14:21.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753412+0000", 2024-09-12T18:14:21.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.435e-06 2024-09-12T18:14:21.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:21.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753468+0000", 2024-09-12T18:14:21.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5574e-05 2024-09-12T18:14:21.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:21.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.753486+0000", 2024-09-12T18:14:21.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8269000000000001e-05 2024-09-12T18:14:21.803 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.803 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:21.803 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.804 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:98144 5.2 5:4f0b72d0:::benchmark_data_smithi062_23645_object98143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:21.804 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:21.755382+0000", 2024-09-12T18:14:21.804 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00053488799999999997, 2024-09-12T18:14:21.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00085327700000000005, 2024-09-12T18:14:21.805 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:21.806 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:21.806 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:21.806 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:21.806 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:21.807 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:21.807 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 98144 2024-09-12T18:14:21.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.808 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:21.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:21.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755382+0000", 2024-09-12T18:14:21.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:21.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755382+0000", 2024-09-12T18:14:21.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:21.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755383+0000", 2024-09-12T18:14:21.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3519999999999999e-06 2024-09-12T18:14:21.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:21.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755504+0000", 2024-09-12T18:14:21.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000121031 2024-09-12T18:14:21.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:21.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755519+0000", 2024-09-12T18:14:21.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4752999999999999e-05 2024-09-12T18:14:21.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755527+0000", 2024-09-12T18:14:21.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2139999999999996e-06 2024-09-12T18:14:21.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:21.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755588+0000", 2024-09-12T18:14:21.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0634000000000003e-05 2024-09-12T18:14:21.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:21.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755722+0000", 2024-09-12T18:14:21.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000134067 2024-09-12T18:14:21.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755887+0000", 2024-09-12T18:14:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00016514599999999999 2024-09-12T18:14:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.817 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:98133 5.6 e40/21 5:69108476:::benchmark_data_smithi062_23645_object98132:head v 40'6077, mlcod=40'6072)", 2024-09-12T18:14:21.817 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:21.755469+0000", 2024-09-12T18:14:21.817 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000447591, 2024-09-12T18:14:21.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00080007799999999997, 2024-09-12T18:14:21.818 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:21.818 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:21.818 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:21.818 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:21.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:21.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755469+0000", 2024-09-12T18:14:21.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:21.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755469+0000", 2024-09-12T18:14:21.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:21.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:21.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755469+0000", 2024-09-12T18:14:21.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7e-07 2024-09-12T18:14:21.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:21.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755575+0000", 2024-09-12T18:14:21.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000106026 2024-09-12T18:14:21.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:21.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755584+0000", 2024-09-12T18:14:21.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6100000000000006e-06 2024-09-12T18:14:21.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:21.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755590+0000", 2024-09-12T18:14:21.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8170000000000004e-06 2024-09-12T18:14:21.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:21.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755636+0000", 2024-09-12T18:14:21.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6075000000000002e-05 2024-09-12T18:14:21.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:21.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:21.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:21.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:21.755655+0000", 2024-09-12T18:14:21.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8825e-05 2024-09-12T18:14:21.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.826 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:21.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:21.826 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:21.826 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 6 2024-09-12T18:14:21.827 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:21.829 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:21.824+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:21.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:21.929 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:21.927+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:21.984 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:21.984 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:21.985 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:21.985 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:21.985 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:22.008 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:22.029 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:22.028+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:22.131 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:22.128+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:22.162 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:22.163 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:22.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:22.163 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:22.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.163 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:22.163 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:22.164 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 69.867334541999995, 2024-09-12T18:14:22.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:22.164 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.164 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.164 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.164 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:22.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:22.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:22.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:22.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:22.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:22.175 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 69.063006240000007, 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:22.176 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:22.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:22.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:22.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:22.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:22.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:22.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:22.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:22.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:22.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:22.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.186 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.767410566999999, 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.187 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:22.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:22.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:22.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:22.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:22.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:22.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:22.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:22.196 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.196 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.767316891999997, 2024-09-12T18:14:22.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:22.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:22.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:22.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:22.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:22.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:22.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:22.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:22.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:22.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:22.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:22.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:22.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:22.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:22.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:22.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:22.210 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.210 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.210 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.210 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.767247662000003, 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.211 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:22.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:22.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:22.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:22.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.767156896000003, 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.221 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:22.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:22.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:22.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:22.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:22.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:22.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:22.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:22.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:22.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:22.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:22.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:22.230 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.767095873000002, 2024-09-12T18:14:22.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:22.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:22.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:22.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:22.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:22.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:22.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.241 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:22.241 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.767037113999997, 2024-09-12T18:14:22.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:22.241 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.241 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.241 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:22.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:22.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:22.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:22.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:22.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.766974064000003, 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.251 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:22.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:22.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:22.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:22.259 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.766173690000002, 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.260 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:22.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:22.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:22.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.766035488, 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.270 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:22.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:22.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:22.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:22.278 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:22.279 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.765972238000003, 2024-09-12T18:14:22.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:22.280 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.280 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.280 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.280 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:22.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:22.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:22.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:22.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:22.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:22.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:22.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:22.289 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.765572271000003, 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:22.290 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:22.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.298 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.765474169000001, 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.299 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:22.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:22.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:22.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:22.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:22.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:22.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:22.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:22.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.765381777000002, 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.311 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:22.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:22.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:22.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:22.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:22.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:22.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:22.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.765294879999999, 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:22.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:22.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:22.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:22.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:22.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:22.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:22.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.330 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.765171258000002, 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.331 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:22.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 58.764779658000002, 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.341 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:22.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:22.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:22.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.348 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78500 5.9 5:92ea3575:::benchmark_data_smithi062_23645_object78499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.239768381999999, 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022476556000000002, 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78500 2024-09-12T18:14:22.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921728+0000", 2024-09-12T18:14:22.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.452e-06 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921775+0000", 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6910999999999999e-05 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921787+0000", 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1374e-05 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921794+0000", 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922416+0000", 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00062186399999999997 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922566+0000", 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014947800000000001 2024-09-12T18:14:22.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922716+0000", 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0001505 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931674+0000", 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0089579459999999996 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944113+0000", 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012438362 2024-09-12T18:14:22.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944168+0000", 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5464000000000003e-05 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944203+0000", 2024-09-12T18:14:22.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5352000000000003e-05 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78501 5.9 5:9283cf68:::benchmark_data_smithi062_23645_object78500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:22.358 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.239637749, 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022418885, 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:22.359 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78501 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921858+0000", 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:14:22.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921919+0000", 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1251e-05 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921926+0000", 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:22.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921930+0000", 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3440000000000003e-06 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.926849+0000", 2024-09-12T18:14:22.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049193279999999997 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927003+0000", 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000153542 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927167+0000", 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000163962 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931705+0000", 2024-09-12T18:14:22.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045380359999999996 2024-09-12T18:14:22.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:22.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944215+0000", 2024-09-12T18:14:22.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012510037999999999 2024-09-12T18:14:22.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944246+0000", 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0613e-05 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:22.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944276+0000", 2024-09-12T18:14:22.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0685000000000002e-05 2024-09-12T18:14:22.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.368 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:22.368 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:22.369 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:22.371 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:22.369+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:22.371 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:14:22.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 42 16 99508 99492 148.037 128.688 0.00653365 0.00675024 2024-09-12T18:14:22.471 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:22.469+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:22.532 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:99772 5.8 5:122870b3:::benchmark_data_smithi062_23645_object99771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:22.526348+0000", 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.006767632, 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0067940819999999999, 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:22.533 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 99772 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526348+0000", 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526348+0000", 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526348+0000", 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3300000000000003e-07 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526412+0000", 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.313e-05 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:22.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526419+0000", 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5689999999999999e-06 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526424+0000", 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8369999999999996e-06 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526475+0000", 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0719e-05 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526600+0000", 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000124871 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.526705+0000", 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105271 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530659+0000", 2024-09-12T18:14:22.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0039546449999999997 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:99778 5.d 5:bd17d90e:::benchmark_data_smithi062_23645_object99777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:22.530430+0000", 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0026851840000000002, 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027856249999999999, 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 99778 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530430+0000", 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:22.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530430+0000", 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530431+0000", 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0160000000000001e-06 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530563+0000", 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013110300000000001 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530573+0000", 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0097e-05 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530586+0000", 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3165e-05 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:22.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530645+0000", 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9317000000000001e-05 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530739+0000", 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4351000000000005e-05 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530837+0000", 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7569e-05 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.542 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:99781 5.0 5:0bb7506b:::benchmark_data_smithi062_23645_object99780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:22.530602+0000", 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.002513885, 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00265299, 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:22.543 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 99781 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530602+0000", 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530602+0000", 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530602+0000", 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7700000000000005e-07 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530632+0000", 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0124000000000002e-05 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:22.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530641+0000", 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530647+0000", 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.852e-06 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530701+0000", 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4126999999999999e-05 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530847+0000", 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014610099999999999 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.531016+0000", 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000168598 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.547 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:99782 5.8 5:145ba7bd:::benchmark_data_smithi062_23645_object99781:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:22.530701+0000", 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0024141589999999999, 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025889429999999998, 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 99782 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:22.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530701+0000", 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530701+0000", 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530702+0000", 2024-09-12T18:14:22.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530774+0000", 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1896000000000004e-05 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530780+0000", 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3040000000000001e-06 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530786+0000", 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7440000000000004e-06 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530823+0000", 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.530924+0000", 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100905 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.531038+0000", 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011387600000000001 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4581.0:99784 5.e 5:72867f96:::benchmark_data_smithi062_23645_object99783:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-09-12T18:14:22.533080+0000", 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.5917000000000002e-05, 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00025437399999999997, 2024-09-12T18:14:22.552 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4581", 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 99784 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533080+0000", 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533080+0000", 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533081+0000", 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0750000000000001e-06 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533146+0000", 2024-09-12T18:14:22.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5510000000000001e-05 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533164+0000", 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7787000000000001e-05 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533172+0000", 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1890000000000007e-06 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-09-12T18:14:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533232+0000", 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9457999999999999e-05 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-09-12T18:14:22.533313+0000", 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1421999999999994e-05 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 5 2024-09-12T18:14:22.556 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:22.558 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:14:22.572 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:22.567+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:22.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:22.672 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:22.668+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:22.711 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:14:22.711 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:14:22.711 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-09-12T18:14:22.711 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-09-12T18:14:22.711 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:14:22.732 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:14:22.773 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:22.771+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:22.820 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:22.820 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:22.839 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:22.839 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:22.857 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:22.857 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:22.875 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:22.872+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:22.929 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:22.929 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:22.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:22.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:14:22.976 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:22.971+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:23.077 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:23.072+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:23.110 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:23.110 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:23.130 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:23.178 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:23.173+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:23.278 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:23.277+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:23.330 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:23.331 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:23.351 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:23.398 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:23.395+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:23.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 43 16 101564 101548 147.583 128.5 0.00849674 0.00677135 2024-09-12T18:14:23.480 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:23.479+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:23.507 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:23.508 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:23.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:23.581 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:23.577+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:23.682 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:14:23.680+0000 7f14d6095640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22908) UID: 0 2024-09-12T18:14:23.685 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:23.685 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:23.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:23.772 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:14:23.772 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:23.772 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-09-12T18:14:23.772 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:14:23.773 INFO:teuthology.orchestra.console.smithi129:Power off 2024-09-12T18:14:23.773 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T18:14:23.803 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-09-12T18:14:23.804 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:23.801+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:23.887 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:23.883+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:23.907 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:23.908 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:23.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:23.940 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:14:24.024 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:24.021+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:24.090 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:24.085+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:24.134 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:24.134 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:24.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:24.198 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:24.197+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:24.291 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.287+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:24.306 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:24.306 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:24.327 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:24.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 44 16 103603 103587 147.125 127.438 0.00768846 0.00679228 2024-09-12T18:14:24.413 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.411+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:24.493 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.491+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:24.519 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:24.520 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:24.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:24.629 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.627+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:24.695 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.691+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:24.753 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:24.800 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:24.797+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:24.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:24.899 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.895+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:24.905 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:24.907 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:24.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:24.999 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:24.995+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.045 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:25.046 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:25.069 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:25.069 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:25.088 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:25.088 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:25.099 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:25.095+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.125 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:25.125 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:25.125 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:25.125 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:25.125 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:25.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:25.200 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:25.197+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 73.004917801999994, 2024-09-12T18:14:25.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:25.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:25.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.200589500000007, 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:25.308 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:25.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:25.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904993826999998, 2024-09-12T18:14:25.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904900152000003, 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:25.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:25.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904830922000002, 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.327 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:25.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:25.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:25.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.334 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904740156000003, 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:25.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:25.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:25.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.341 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904679133000002, 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:25.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:25.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.347 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904620373999997, 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:25.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:25.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.353 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.904557324000002, 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:25.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.903756950000002, 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.903618748, 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:25.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:25.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.903555498000003, 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.373 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:25.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:25.377 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:25.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.379 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.903155531000003, 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.380 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:25.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:25.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:25.384 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.386 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:25.387 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.903057429, 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.902965037000001, 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:25.395 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:25.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:25.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:25.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:25.401 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.902878139999999, 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.402 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:25.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:25.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:25.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.902754518000002, 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.409 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:25.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.902362918000001, 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.417 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.418 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.418 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.418 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:25.418 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.418 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.418 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:25.419 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.420 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:25.421 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78500 5.9 5:92ea3575:::benchmark_data_smithi062_23645_object78499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 13.377351642000001, 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022476556000000002, 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:25.422 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78500 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921728+0000", 2024-09-12T18:14:25.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.452e-06 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921775+0000", 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6910999999999999e-05 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921787+0000", 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1374e-05 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921794+0000", 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922416+0000", 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00062186399999999997 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922566+0000", 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014947800000000001 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922716+0000", 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0001505 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931674+0000", 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0089579459999999996 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944113+0000", 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012438362 2024-09-12T18:14:25.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944168+0000", 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5464000000000003e-05 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944203+0000", 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5352000000000003e-05 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.429 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78501 5.9 5:9283cf68:::benchmark_data_smithi062_23645_object78500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 13.377221008999999, 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022418885, 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:25.430 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78501 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921858+0000", 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:14:25.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921919+0000", 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1251e-05 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:25.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921926+0000", 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921930+0000", 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3440000000000003e-06 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.926849+0000", 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049193279999999997 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927003+0000", 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000153542 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927167+0000", 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000163962 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931705+0000", 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045380359999999996 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944215+0000", 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012510037999999999 2024-09-12T18:14:25.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944246+0000", 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0613e-05 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944276+0000", 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0685000000000002e-05 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.437 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.438 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.438 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:25.438 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:25.438 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:25.439 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 45 16 105595 105579 146.622 124.5 0.00552324 0.0068155 2024-09-12T18:14:25.439 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:25.435+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:25.541 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:25.535+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105988 5.c 5:359370ac:::benchmark_data_smithi062_23645_object105987:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.589899+0000", 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0086634269999999996, 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086838550000000007, 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.599 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105988 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.589899+0000", 2024-09-12T18:14:25.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.589899+0000", 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.589900+0000", 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0750000000000001e-06 2024-09-12T18:14:25.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.589979+0000", 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8568999999999999e-05 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.589992+0000", 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.31e-05 2024-09-12T18:14:25.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590001+0000", 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7739999999999993e-06 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594590+0000", 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045893740000000002 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594736+0000", 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014547599999999999 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594888+0000", 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152745 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105990 5.c 5:38d2574c:::benchmark_data_smithi062_23645_object105989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.590164+0000", 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0083984130000000004, 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084638030000000006, 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.606 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105990 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590164+0000", 2024-09-12T18:14:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590164+0000", 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590165+0000", 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.032e-06 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590228+0000", 2024-09-12T18:14:25.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3015999999999994e-05 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590240+0000", 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1895999999999999e-05 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590248+0000", 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0160000000000008e-06 2024-09-12T18:14:25.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.596931+0000", 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006682767 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597015+0000", 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3395999999999999e-05 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597099+0000", 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4031999999999998e-05 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105992 5.6 5:6d7e776c:::benchmark_data_smithi062_23645_object105991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.594125+0000", 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0044379119999999996, 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045413470000000003, 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105992 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594125+0000", 2024-09-12T18:14:25.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594125+0000", 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594126+0000", 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.004e-06 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594187+0000", 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1054000000000002e-05 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594198+0000", 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.092e-05 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594203+0000", 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1580000000000004e-06 2024-09-12T18:14:25.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594738+0000", 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053520100000000001 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594862+0000", 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012345499999999999 2024-09-12T18:14:25.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595005+0000", 2024-09-12T18:14:25.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014343299999999999 2024-09-12T18:14:25.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598116+0000", 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031106910000000001 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105998 5.a 5:5773818f:::benchmark_data_smithi062_23645_object105997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.595200+0000", 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0033625859999999999, 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035075750000000002, 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.619 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105998 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595200+0000", 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595200+0000", 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595201+0000", 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9299999999999996e-07 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595282+0000", 2024-09-12T18:14:25.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1256999999999998e-05 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595294+0000", 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1878e-05 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595301+0000", 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7360000000000004e-06 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595348+0000", 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7221000000000001e-05 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595470+0000", 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122044 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595602+0000", 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132111 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:105981 5.c e41/21)", 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.595778+0000", 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027846659999999999, 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029617900000000002, 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595778+0000", 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595778+0000", 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595779+0000", 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:14:25.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595782+0000", 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7179999999999998e-06 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595792+0000", 2024-09-12T18:14:25.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9159999999999996e-06 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595798+0000", 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5300000000000004e-06 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.628 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105995 5.b e41/21 5:dfded9e4:::benchmark_data_smithi062_23645_object105994:head v 41'6494, mlcod=41'6492)", 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.595571+0000", 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002992139, 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031929290000000002, 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595571+0000", 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595571+0000", 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.595571+0000", 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597447+0000", 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018760039999999999 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597458+0000", 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0847e-05 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597465+0000", 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8190000000000003e-06 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597519+0000", 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3860000000000003e-05 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597536+0000", 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6905000000000002e-05 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105997 5.4 e41/21)", 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.597484+0000", 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001079258, 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013053369999999999, 2024-09-12T18:14:25.633 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597484+0000", 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597484+0000", 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597484+0000", 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597519+0000", 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5064999999999997e-05 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597526+0000", 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9110000000000004e-06 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597531+0000", 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.028e-06 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105999 5.e e41/21 5:75d924d4:::benchmark_data_smithi062_23645_object105998:head v 41'6607, mlcod=41'6605)", 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.597541+0000", 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00102202, 2024-09-12T18:14:25.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001272357, 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597541+0000", 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597541+0000", 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597541+0000", 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5100000000000001e-07 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597570+0000", 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.883e-05 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597577+0000", 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597582+0000", 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9150000000000004e-06 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597657+0000", 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5190000000000003e-05 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597675+0000", 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7629999999999999e-05 2024-09-12T18:14:25.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:106000 5.8 e41/21 5:16e25bc2:::benchmark_data_smithi062_23645_object105999:head v 41'6638, mlcod=41'6636)", 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.597964+0000", 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00059925199999999999, 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087684000000000004, 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597964+0000", 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597964+0000", 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.597964+0000", 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3799999999999996e-07 2024-09-12T18:14:25.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598012+0000", 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7691999999999997e-05 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598023+0000", 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1037e-05 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598030+0000", 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0620000000000003e-06 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598125+0000", 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4757000000000001e-05 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598142+0000", 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7325000000000001e-05 2024-09-12T18:14:25.645 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:106001 5.5 5:adb8acb5:::benchmark_data_smithi062_23645_object106000:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.598292+0000", 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00027065500000000002, 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057771899999999998, 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.646 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 106001 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598292+0000", 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598292+0000", 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598294+0000", 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6810000000000001e-06 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598352+0000", 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8548000000000003e-05 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598364+0000", 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1871999999999999e-05 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598372+0000", 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598628+0000", 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025588999999999999 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598739+0000", 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110747 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598867+0000", 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012826999999999999 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105978 5.c 5:338cb91d:::benchmark_data_smithi062_23645_object105977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.587462+0000", 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.011100626000000001, 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011453315, 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105978 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587462+0000", 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587462+0000", 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587463+0000", 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587517+0000", 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3732e-05 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587530+0000", 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2866e-05 2024-09-12T18:14:25.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587538+0000", 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1079999999999993e-06 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587585+0000", 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7361999999999998e-05 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.587827+0000", 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000241912 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588031+0000", 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020348 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.594540+0000", 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065094669999999997 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.655 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:105983 5.c e41/21)", 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.598812+0000", 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997506, 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014486300000000001, 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598812+0000", 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598812+0000", 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598813+0000", 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2799999999999996e-07 2024-09-12T18:14:25.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598815+0000", 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8650000000000001e-06 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598822+0000", 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598828+0000", 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0379999999999996e-06 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:105988 5.c e41/21)", 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.598838+0000", 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997249, 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014030499999999999, 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.659 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598838+0000", 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598838+0000", 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598838+0000", 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9600000000000001e-07 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598840+0000", 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.559e-06 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598845+0000", 2024-09-12T18:14:25.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0050000000000004e-06 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.598848+0000", 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.704e-06 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105981 5.c 5:3f4bdae2:::benchmark_data_smithi062_23645_object105980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.588067+0000", 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010495592999999999, 2024-09-12T18:14:25.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010936721, 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105981 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.663 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588067+0000", 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588067+0000", 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588068+0000", 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588167+0000", 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9481000000000005e-05 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588180+0000", 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.306e-05 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588185+0000", 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4390000000000002e-06 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.589922+0000", 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017367210000000001 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590042+0000", 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120215 2024-09-12T18:14:25.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.590181+0000", 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013957499999999999 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105983 5.c 5:3f9b63c0:::benchmark_data_smithi062_23645_object105982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.588341+0000", 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010221802, 2024-09-12T18:14:25.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010710244000000001, 2024-09-12T18:14:25.668 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:25.668 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105983 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588341+0000", 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588341+0000", 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588342+0000", 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588403+0000", 2024-09-12T18:14:25.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1589999999999998e-05 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588412+0000", 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6489999999999997e-06 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.588429+0000", 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7311000000000001e-05 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:25.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.592070+0000", 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036403849999999999 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.592214+0000", 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000143786 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.592386+0000", 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017269400000000001 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.672 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:25.673 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.673 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:25.673 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:25.673 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 15 2024-09-12T18:14:25.673 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:25.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:25.675 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:25.671+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.776 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:25.771+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.870 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:25.870 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:25.870 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:25.870 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:25.871 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:25.877 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:25.875+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:25.892 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:25.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:14:25.978 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:25.977+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:26.079 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:26.077+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(mds.0.3:20 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.68246568, 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016986876000000001, 2024-09-12T18:14:26.085 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401186+0000", 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999996e-07 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401201+0000", 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.504e-05 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401213+0000", 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.401222+0000", 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3899999999999999e-06 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403010+0000", 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017874329999999999 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.403060+0000", 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9852999999999999e-05 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.417243+0000", 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014183787 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.418173+0000", 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092945300000000001 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.678265215000003, 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.090 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:26.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:26.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:18 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.097 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.678148456000002, 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016951938999999999, 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405503+0000", 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405505+0000", 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.443e-06 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405514+0000", 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8829999999999995e-06 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405533+0000", 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405551+0000", 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8053000000000001e-05 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408313+0000", 2024-09-12T18:14:26.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623830000000002 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408580+0000", 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026695400000000002 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408924+0000", 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034345099999999999 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.421223+0000", 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012298966 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422328+0000", 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011054039999999999 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422400+0000", 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1950000000000001e-05 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422455+0000", 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169e-05 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.103 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.678079320000002, 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.677967568, 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.677803746000002, 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:26.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:26.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:26.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.677742979999998, 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.123 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:26.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.127 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:26.128 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:26.128 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.842779817, 2024-09-12T18:14:26.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:26.128 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.128 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:26.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:26.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:26.133 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.837016077000001, 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:26.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:26.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:26.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:26.138 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.454534529999997, 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:26.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:26.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:26.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:61129 5.1 e34/21 5:8eb73760:::benchmark_data_smithi062_23645_object61128:head v 34'3864, mlcod=34'3862)", 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.469816754, 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017014511, 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613835+0000", 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7599999999999998e-07 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613902+0000", 2024-09-12T18:14:26.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6225999999999999e-05 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613910+0000", 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3389999999999993e-06 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613917+0000", 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999999e-06 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613972+0000", 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4729999999999999e-05 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.613990+0000", 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8097999999999999e-05 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630793+0000", 2024-09-12T18:14:26.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016803604 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.630849+0000", 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6137999999999997e-05 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.358899384000001, 2024-09-12T18:14:26.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:26.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:26.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:26.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:69118 5.c 5:3c73a29c:::benchmark_data_smithi062_23645_object69117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.667213639, 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016585826000000001, 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 69118 2024-09-12T18:14:26.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416438+0000", 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416439+0000", 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416520+0000", 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1144999999999996e-05 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416530+0000", 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0345e-05 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.416537+0000", 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8290000000000002e-06 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.419825+0000", 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032876820000000001 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.421805+0000", 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019806490000000001 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.422103+0000", 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029764100000000002 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.426179+0000", 2024-09-12T18:14:26.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040759409999999996 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.432963+0000", 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067841280000000004 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433002+0000", 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9190000000000003e-05 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:07.433024+0000", 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1469999999999999e-05 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72767 5.c 5:3d19f5c3:::benchmark_data_smithi062_23645_object72766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.931083212000001, 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017300254000000001, 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72767 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152569+0000", 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153984+0000", 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001414713 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153994+0000", 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7079999999999992e-06 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.154000+0000", 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000001e-06 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155208+0000", 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012075689999999999 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155336+0000", 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012841299999999999 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155481+0000", 2024-09-12T18:14:26.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014465499999999999 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167316+0000", 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011835215 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169776+0000", 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024603310000000001 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169828+0000", 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440999999999998e-05 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169869+0000", 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1056000000000001e-05 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.168 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:96623 5.6 5:6c0b3156:::benchmark_data_smithi062_23645_object96622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:20.954635+0000", 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.1290163550000001, 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016578978000000001, 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 96623 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954635+0000", 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954635+0000", 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954636+0000", 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0899999999999999e-06 2024-09-12T18:14:26.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954682+0000", 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5677999999999999e-05 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954690+0000", 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3459999999999994e-06 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.954696+0000", 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3680000000000001e-06 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.959815+0000", 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051189199999999999 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.959968+0000", 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015301799999999999 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.960170+0000", 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020274400000000001 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.968285+0000", 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081141919999999992 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.971129+0000", 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028440829999999999 2024-09-12T18:14:26.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.971178+0000", 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8980000000000002e-05 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:20.971214+0000", 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6559e-05 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:97341 5.c 5:31a5055b:::benchmark_data_smithi062_23645_object97340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.7423525509999997, 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017069225, 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 97341 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.175 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341300+0000", 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341329+0000", 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8912e-05 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341339+0000", 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0117e-05 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341345+0000", 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9220000000000002e-06 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341752+0000", 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040689099999999999 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341872+0000", 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120728 2024-09-12T18:14:26.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.342018+0000", 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014604799999999999 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.350193+0000", 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081745759999999994 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358267+0000", 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080736120000000008 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358320+0000", 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3006e-05 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358368+0000", 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8730000000000003e-05 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.180 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:97345 5.e e40/21 5:7d54bab1:::benchmark_data_smithi062_23645_object97344:head v 40'6064, mlcod=40'6059)", 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.347073+0000", 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.7365784460000002, 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016711871999999999, 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347073+0000", 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347073+0000", 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347074+0000", 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9199999999999999e-07 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347124+0000", 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9425999999999997e-05 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347138+0000", 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4212999999999999e-05 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.347146+0000", 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4970000000000001e-06 2024-09-12T18:14:26.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.348980+0000", 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018340730000000001 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.349000+0000", 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9922e-05 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.363740+0000", 2024-09-12T18:14:26.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014739785 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.363785+0000", 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4963999999999998e-05 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105371 5.a 5:585ffaea:::benchmark_data_smithi062_23645_object105370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.283130+0000", 2024-09-12T18:14:26.185 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.80052164299999995, 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017369709000000001, 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105371 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283130+0000", 2024-09-12T18:14:26.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283130+0000", 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283131+0000", 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7000000000000003e-07 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283229+0000", 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7884e-05 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283238+0000", 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5699999999999999e-06 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283245+0000", 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0650000000000004e-06 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283475+0000", 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230647 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283552+0000", 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7148000000000001e-05 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283700+0000", 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000147305 2024-09-12T18:14:26.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.290273+0000", 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065733299999999996 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.300332+0000", 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010059281999999999 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.300442+0000", 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010939500000000001 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.300500+0000", 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8112999999999997e-05 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:26.191 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.56782347700000002, 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:26.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:106895 5.3 5:c2b29f11:::benchmark_data_smithi062_23645_object106894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.035181753000000003, 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017774775999999999, 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:26.196 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 106895 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:26.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048471+0000", 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8200000000000008e-07 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048565+0000", 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4252999999999994e-05 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048580+0000", 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5285999999999999e-05 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048588+0000", 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6669999999999996e-06 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055671+0000", 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00708312 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055782+0000", 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011069999999999999 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055907+0000", 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012498699999999999 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.064148+0000", 2024-09-12T18:14:26.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082411059999999998 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066193+0000", 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020450830000000001 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066222+0000", 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:26.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066245+0000", 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2252e-05 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:26.204 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:26.204 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:26.199+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:26.304 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:26.301+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:26.358 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:26.358 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:26.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.358 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:107500 5.d e41/21 5:b45f0b83:::benchmark_data_smithi062_23645_object107499:head v 41'6735, mlcod=41'6731)", 2024-09-12T18:14:26.358 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.354505+0000", 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0041098419999999998, 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0041323779999999999, 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354505+0000", 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354505+0000", 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354506+0000", 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8299999999999996e-07 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354565+0000", 2024-09-12T18:14:26.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9277000000000002e-05 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354574+0000", 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9740000000000008e-06 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354579+0000", 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2279999999999998e-06 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354629+0000", 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0006999999999997e-05 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.354649+0000", 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9891999999999999e-05 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:107502 5.3 e41/21 5:c503c273:::benchmark_data_smithi062_23645_object107501:head v 41'6771, mlcod=41'6769)", 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.355505+0000", 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00310977, 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0031874849999999999, 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355505+0000", 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355505+0000", 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355506+0000", 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2799999999999996e-07 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355576+0000", 2024-09-12T18:14:26.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0303999999999996e-05 2024-09-12T18:14:26.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355585+0000", 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5339999999999999e-06 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355589+0000", 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1520000000000002e-06 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355645+0000", 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6672999999999998e-05 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355669+0000", 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3428999999999999e-05 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.367 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:107501 5.d e41/21 5:bde51bb7:::benchmark_data_smithi062_23645_object107500:head v 41'6736, mlcod=41'6732)", 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.356657+0000", 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0019583560000000001, 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002084439, 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356657+0000", 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356657+0000", 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356657+0000", 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356693+0000", 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5524000000000001e-05 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356703+0000", 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0097e-05 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356708+0000", 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2270000000000001e-06 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356755+0000", 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6817999999999998e-05 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.356773+0000", 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7969e-05 2024-09-12T18:14:26.371 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:107503 5.3 e41/21 5:c053ff7c:::benchmark_data_smithi062_23645_object107502:head v 41'6772, mlcod=41'6769)", 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.358310+0000", 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00030471900000000001, 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00048032800000000003, 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.372 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358310+0000", 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358310+0000", 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358311+0000", 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7999999999999995e-07 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358337+0000", 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6424e-05 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358344+0000", 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1369999999999996e-06 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358349+0000", 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358394+0000", 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5151000000000002e-05 2024-09-12T18:14:26.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358414+0000", 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9650999999999999e-05 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:107504 5.f 5.26710abf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.358698+0000", 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.999917, 2024-09-12T18:14:26.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014415700000000001, 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "reached pg", 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 107504 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358698+0000", 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358698+0000", 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358699+0000", 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4099999999999997e-07 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358767+0000", 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7939000000000001e-05 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358776+0000", 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5200000000000003e-06 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358781+0000", 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7550000000000002e-06 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358835+0000", 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3774999999999999e-05 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:107507 5.9 5:98505e9f:::benchmark_data_smithi062_23645_object107506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.358792+0000", 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9998226, 2024-09-12T18:14:26.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108337, 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "reached pg", 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 107507 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358792+0000", 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358792+0000", 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358793+0000", 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.22e-07 2024-09-12T18:14:26.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358823+0000", 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0326000000000001e-05 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358828+0000", 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.04e-06 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358831+0000", 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3189999999999999e-06 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.358870+0000", 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8869999999999999e-05 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.387 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:107491 5.f 5:fdba06d7:::benchmark_data_smithi062_23645_object107490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.349050+0000", 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0095652870000000004, 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0099053189999999992, 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.388 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 107491 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349050+0000", 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349050+0000", 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349051+0000", 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0759999999999999e-06 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349140+0000", 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9475999999999995e-05 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349152+0000", 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2232000000000001e-05 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349162+0000", 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2820000000000002e-06 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.350583+0000", 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0014212210000000001 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.350727+0000", 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014393300000000001 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.350861+0000", 2024-09-12T18:14:26.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013466199999999999 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.357798+0000", 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0069360250000000002 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:107492 5.7 5:eea6e582:::benchmark_data_smithi062_23645_object107491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.393 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.349181+0000", 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0094334880000000003, 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098441710000000005, 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 107492 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349181+0000", 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349181+0000", 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349182+0000", 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:26.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349221+0000", 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8454000000000001e-05 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349230+0000", 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.349248+0000", 2024-09-12T18:14:26.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8338e-05 2024-09-12T18:14:26.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.350751+0000", 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0015030379999999999 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.350879+0000", 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012750700000000001 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351011+0000", 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000132218 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353354+0000", 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023432800000000001 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:107497 5.d e41/21 5:ba4c81de:::benchmark_data_smithi062_23645_object107496:head v 41'6734, mlcod=41'6731)", 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.351699+0000", 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0069154239999999999, 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073900709999999998, 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.399 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351699+0000", 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351699+0000", 2024-09-12T18:14:26.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351700+0000", 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1500000000000003e-07 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351804+0000", 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103418 2024-09-12T18:14:26.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351816+0000", 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2140000000000001e-05 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351823+0000", 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6139999999999997e-06 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.402 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351888+0000", 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5016000000000002e-05 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.351910+0000", 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2421000000000001e-05 2024-09-12T18:14:26.403 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:107498 5.f 5:f5a774c2:::benchmark_data_smithi062_23645_object107497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.352878+0000", 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0057372669999999999, 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0062642790000000002, 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.404 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 107498 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.352878+0000", 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.352878+0000", 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.352879+0000", 2024-09-12T18:14:26.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2109999999999999e-06 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.352916+0000", 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7212000000000002e-05 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.352928+0000", 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1637000000000001e-05 2024-09-12T18:14:26.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.352935+0000", 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6690000000000006e-06 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353333+0000", 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00039815100000000002 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353446+0000", 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000112099 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353533+0000", 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7335000000000003e-05 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.409 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:107499 5.f 5:fa301be7:::benchmark_data_smithi062_23645_object107498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:26.353519+0000", 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0050959489999999998, 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0056856449999999996, 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.410 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 107499 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353519+0000", 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353519+0000", 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353520+0000", 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:14:26.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353572+0000", 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2533e-05 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353585+0000", 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2412000000000001e-05 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.353592+0000", 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7109999999999995e-06 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355068+0000", 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001475587 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355154+0000", 2024-09-12T18:14:26.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5612999999999995e-05 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:26.355232+0000", 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8769000000000004e-05 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:26.415 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 11 2024-09-12T18:14:26.416 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:26.417 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 46 16 107592 107576 146.147 124.812 0.00561984 0.00683777 2024-09-12T18:14:26.418 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:26.418 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:26.413+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:26.517 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:26.515+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:26.618 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:26.615+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:26.620 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:26.620 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:26.620 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:26.620 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:26.620 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:26.641 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:26.719 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:26.717+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:26.791 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 74.496204985999995, 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.792 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:26.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:26.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:26.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:26.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:26.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:26.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 73.691876683999993, 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.801 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:26.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:26.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.807 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.396281010999999, 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:26.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:26.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.396187335999997, 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:26.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:26.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:26.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.819 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.396118106000003, 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.820 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:26.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.825 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.396027340000003, 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.826 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:26.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:26.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:26.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.395966317000003, 2024-09-12T18:14:26.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:26.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.839 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.395907557999998, 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:26.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:26.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.395844508000003, 2024-09-12T18:14:26.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:26.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:26.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.395044134000003, 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:26.851 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:26.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:26.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:26.857 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394905932, 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:26.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394842681999997, 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.863 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:26.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:26.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:26.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394442714999997, 2024-09-12T18:14:26.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:26.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:26.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394344613000001, 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023326369999999999, 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.875 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396021+0000", 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396022+0000", 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4529999999999999e-06 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396030+0000", 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7940000000000003e-06 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396051+0000", 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0613000000000001e-05 2024-09-12T18:14:26.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396068+0000", 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7240000000000001e-05 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396201+0000", 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013320899999999999 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396495+0000", 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029346999999999999 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396947+0000", 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000452397 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.400506+0000", 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035588659999999999 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419123+0000", 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018617169999999999 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419243+0000", 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011951900000000001 2024-09-12T18:14:26.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419347+0000", 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000104639 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394252221000002, 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:26.881 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:26.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:26.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394165323999999, 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.887 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:26.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:26.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.394041702000003, 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.893 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:26.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:26.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.898 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 63.393650102000002, 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:26.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78500 5.9 5:92ea3575:::benchmark_data_smithi062_23645_object78499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.868638826, 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022476556000000002, 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.903 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78500 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921727+0000", 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921728+0000", 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.452e-06 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921775+0000", 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6910999999999999e-05 2024-09-12T18:14:26.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921787+0000", 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1374e-05 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921794+0000", 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8529999999999992e-06 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922416+0000", 2024-09-12T18:14:26.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00062186399999999997 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922566+0000", 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014947800000000001 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.922716+0000", 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0001505 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931674+0000", 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0089579459999999996 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944113+0000", 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012438362 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944168+0000", 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5464000000000003e-05 2024-09-12T18:14:26.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944203+0000", 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5352000000000003e-05 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.909 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:78501 5.9 5:9283cf68:::benchmark_data_smithi062_23645_object78500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.868508193, 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.022418885, 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 78501 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:26.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921857+0000", 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921858+0000", 2024-09-12T18:14:26.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921919+0000", 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1251e-05 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921926+0000", 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:26.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.921930+0000", 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3440000000000003e-06 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.926849+0000", 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049193279999999997 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927003+0000", 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000153542 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.927167+0000", 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000163962 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.931705+0000", 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045380359999999996 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944215+0000", 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012510037999999999 2024-09-12T18:14:26.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944246+0000", 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0613e-05 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:11.944276+0000", 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0685000000000002e-05 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:26.915 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:26.916 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:26.917 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:26.915+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:26.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:26.967 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:14:27.018 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:27.017+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:27.076 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:27.076 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:27.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.077 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:108942 5.5 5:a4e82fbf:::benchmark_data_smithi062_23645_object108941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:27.077 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.070006+0000", 2024-09-12T18:14:27.077 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0059186380000000004, 2024-09-12T18:14:27.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059468630000000001, 2024-09-12T18:14:27.077 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.078 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.078 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:27.078 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:27.078 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:27.078 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:27.078 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 108942 2024-09-12T18:14:27.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.079 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070006+0000", 2024-09-12T18:14:27.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070006+0000", 2024-09-12T18:14:27.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070007+0000", 2024-09-12T18:14:27.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2309999999999999e-06 2024-09-12T18:14:27.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070132+0000", 2024-09-12T18:14:27.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125275 2024-09-12T18:14:27.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070144+0000", 2024-09-12T18:14:27.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1590000000000001e-05 2024-09-12T18:14:27.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070150+0000", 2024-09-12T18:14:27.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4420000000000003e-06 2024-09-12T18:14:27.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070201+0000", 2024-09-12T18:14:27.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0365000000000003e-05 2024-09-12T18:14:27.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070299+0000", 2024-09-12T18:14:27.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7956999999999997e-05 2024-09-12T18:14:27.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:27.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.070382+0000", 2024-09-12T18:14:27.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3862000000000004e-05 2024-09-12T18:14:27.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:27.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072557+0000", 2024-09-12T18:14:27.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021744189999999999 2024-09-12T18:14:27.088 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.088 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.088 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.089 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108939 5.7 e42/21 5:effe653d:::benchmark_data_smithi062_23645_object108938:head v 42'6720, mlcod=42'6717)", 2024-09-12T18:14:27.089 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.072133+0000", 2024-09-12T18:14:27.089 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0037914469999999999, 2024-09-12T18:14:27.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038984190000000002, 2024-09-12T18:14:27.089 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.090 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.090 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.090 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072133+0000", 2024-09-12T18:14:27.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072133+0000", 2024-09-12T18:14:27.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072134+0000", 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4000000000000001e-07 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072167+0000", 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3389000000000002e-05 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072178+0000", 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0721e-05 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072184+0000", 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7689999999999999e-06 2024-09-12T18:14:27.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072234+0000", 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0016999999999999e-05 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072253+0000", 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8638999999999999e-05 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108943 5.0 e42/21 5:0a8332fd:::benchmark_data_smithi062_23645_object108942:head v 42'6789, mlcod=42'6785)", 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.072404+0000", 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035205319999999998, 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036873119999999999, 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072404+0000", 2024-09-12T18:14:27.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072404+0000", 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072404+0000", 2024-09-12T18:14:27.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072467+0000", 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2800999999999997e-05 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072478+0000", 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0818e-05 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072501+0000", 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2622000000000001e-05 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072563+0000", 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2234000000000001e-05 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.072579+0000", 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5783000000000001e-05 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.100 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108944 5.2 e42/21 5:4fc47f5a:::benchmark_data_smithi062_23645_object108943:head v 42'6874, mlcod=42'6869)", 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.073194+0000", 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027308409999999999, 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029518180000000002, 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.101 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073194+0000", 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073194+0000", 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073194+0000", 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7700000000000004e-07 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073291+0000", 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6377000000000002e-05 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073301+0000", 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0407999999999999e-05 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073307+0000", 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0809999999999999e-06 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073349+0000", 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2097e-05 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073367+0000", 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7853999999999999e-05 2024-09-12T18:14:27.104 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:108947 5.3 5:c2c00329:::benchmark_data_smithi062_23645_object108946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.073725+0000", 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0021991480000000002, 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024985060000000002, 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:27.105 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 108947 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073725+0000", 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073725+0000", 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073727+0000", 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.291e-06 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073814+0000", 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7273000000000003e-05 2024-09-12T18:14:27.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073825+0000", 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1401e-05 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073832+0000", 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9099999999999999e-06 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073888+0000", 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5522000000000001e-05 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074036+0000", 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000148422 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074316+0000", 2024-09-12T18:14:27.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028000799999999999 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:108948 5.5 5:a6066b7a:::benchmark_data_smithi062_23645_object108947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.073852+0000", 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020722230000000002, 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002436466, 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:27.110 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 108948 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073852+0000", 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073852+0000", 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073853+0000", 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2200000000000004e-07 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073889+0000", 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5729000000000003e-05 2024-09-12T18:14:27.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073898+0000", 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1099999999999992e-06 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073904+0000", 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9780000000000002e-06 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073960+0000", 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6780999999999997e-05 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074164+0000", 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020316400000000001 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074305+0000", 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014102599999999999 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.114 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108946 5.7 e42/21 5:e9bcf322:::benchmark_data_smithi062_23645_object108945:head v 42'6721, mlcod=42'6718)", 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.073999+0000", 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001925567, 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023480250000000001, 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073999+0000", 2024-09-12T18:14:27.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073999+0000", 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.073999+0000", 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8299999999999997e-07 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074098+0000", 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8667999999999998e-05 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074130+0000", 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1560999999999998e-05 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074145+0000", 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5662999999999999e-05 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074308+0000", 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016230899999999999 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074319+0000", 2024-09-12T18:14:27.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0961999999999999e-05 2024-09-12T18:14:27.120 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.120 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.120 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108945 5.8 e42/21 5:11e83ba0:::benchmark_data_smithi062_23645_object108944:head v 42'6805, mlcod=42'6802)", 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.074103+0000", 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0018216160000000001, 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022927059999999998, 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.121 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074103+0000", 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074103+0000", 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.074103+0000", 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075888+0000", 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017847760000000001 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075899+0000", 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0713000000000001e-05 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075905+0000", 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5189999999999998e-06 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075938+0000", 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075949+0000", 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0947e-05 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108949 5.4 e42/21 5:2a6a1a93:::benchmark_data_smithi062_23645_object108948:head v 42'6915, mlcod=42'6913)", 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.075922+0000", 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 2.5840000000000002e-06, 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052009699999999996, 2024-09-12T18:14:27.125 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075922+0000", 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075922+0000", 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075922+0000", 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075956+0000", 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3927000000000002e-05 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075965+0000", 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3500000000000003e-06 2024-09-12T18:14:27.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075971+0000", 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0479999999999998e-06 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076020+0000", 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9110000000000002e-05 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076035+0000", 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5685999999999999e-05 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108952 5.e e42/21 5:7ff128c7:::benchmark_data_smithi062_23645_object108951:head v 42'6800, mlcod=42'6798)", 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.075984+0000", 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999399, 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00050498600000000002, 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075984+0000", 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075984+0000", 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.075985+0000", 2024-09-12T18:14:27.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1699999999999999e-07 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076012+0000", 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7180000000000001e-05 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076019+0000", 2024-09-12T18:14:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6789999999999999e-06 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076024+0000", 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.921e-06 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076099+0000", 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5338000000000003e-05 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.076118+0000", 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8649000000000001e-05 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:108938 5.8 e42/21 5:1deaa6dd:::benchmark_data_smithi062_23645_object108937:head v 42'6804, mlcod=42'6802)", 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.069746+0000", 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0061788650000000004, 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067917480000000002, 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069746+0000", 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069746+0000", 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069746+0000", 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2100000000000002e-07 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069814+0000", 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8342000000000004e-05 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069822+0000", 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069827+0000", 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5119999999999999e-06 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069894+0000", 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6876000000000001e-05 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.069911+0000", 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6918999999999998e-05 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 11 2024-09-12T18:14:27.138 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:27.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:27.141 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:27.141 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:27.135+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:27.241 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:27.237+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:27.323 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:27.323 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:27.324 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0: {} 2024-09-12T18:14:27.324 INFO:teuthology.orchestra.run.smithi062.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:14:27.341 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:27.339+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:27.343 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:27.343 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:27.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:27.365 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:27.365 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:27.403 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 47 16 109494 109478 145.567 118.875 0.00797662 0.00686508 2024-09-12T18:14:27.443 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:27.439+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:27.536 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:27.536 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:27.543 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:27.539+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:27.556 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:27.645 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:27.641+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:27.704 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:27.704 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:27.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:27.766 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:27.765+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:27.804 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T18:14:27.847 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:27.843+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:27.916 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-09-12T18:14:27.918 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:27.918 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:27.940 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:27.947 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:27.943+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:28.048 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:28.045+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:28.066 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.066 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:28.150 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:28.145+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:28.197 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.197 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:28.257 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:28.255+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:28.315 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.315 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.327 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:28.369 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:28.367+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:28.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 48 16 110638 110622 144.023 71.5 0.0136997 0.00687769 2024-09-12T18:14:28.453 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:28.453+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:28.482 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.483 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:28.555 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:28.553+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:28.628 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.628 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:28.656 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:28.655+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:28.757 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:28.755+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:28.810 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.810 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:28.870 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:28.869+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:28.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T18:14:28.940 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:28.941 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:28.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:28.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:14:29.000 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:28.997+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.058 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:29.055+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:29.125 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:29.125 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:29.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:29.189 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:29.187+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:29.259 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:29.257+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.345 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:29.345 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:29.361 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:29.357+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:29.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:29.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 49 16 111455 111439 142.126 51.0625 0.00592797 0.00703134 2024-09-12T18:14:29.462 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:29.459+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:29.522 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:29.523 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:29.526 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:29.545 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:29.548 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:29.549 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:29.567 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:29.570 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:29.571 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:29.591 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:29.589+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.664 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:29.661+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.707 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:29.707 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:112101 5.f 5:f345ea48:::benchmark_data_smithi062_23645_object112100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.707755+0000", 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000174129, 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000202609, 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "reached pg", 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 112101 2024-09-12T18:14:29.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707755+0000", 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707755+0000", 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707756+0000", 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7900000000000007e-07 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707812+0000", 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6212999999999999e-05 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707821+0000", 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6850000000000007e-06 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707826+0000", 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2349999999999999e-06 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707883+0000", 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7336000000000001e-05 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:112102 5.7 5:e399962c:::benchmark_data_smithi062_23645_object112101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.707841+0000", 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.7557000000000002e-05, 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000185205, 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "reached pg", 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 112102 2024-09-12T18:14:29.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707841+0000", 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707841+0000", 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707842+0000", 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707892+0000", 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0445999999999998e-05 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707899+0000", 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2829999999999998e-06 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707904+0000", 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8849999999999998e-06 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707945+0000", 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1912999999999997e-05 2024-09-12T18:14:29.715 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:112100 5.6 e44/21)", 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.707969+0000", 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9999604, 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011305, 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707969+0000", 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707969+0000", 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.707969+0000", 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9800000000000004e-07 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.708038+0000", 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9166999999999997e-05 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.708046+0000", 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0800000000000006e-06 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.708052+0000", 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7359999999999998e-06 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:112087 5.9 5:96128428:::benchmark_data_smithi062_23645_object112086:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.701618+0000", 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0063106389999999998, 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0065156989999999998, 2024-09-12T18:14:29.719 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 112087 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701618+0000", 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701618+0000", 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701619+0000", 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.026e-06 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701670+0000", 2024-09-12T18:14:29.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0364000000000001e-05 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701682+0000", 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2173e-05 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701689+0000", 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9689999999999997e-06 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.703351+0000", 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001662176 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.703479+0000", 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000128035 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:112091 5.1 5:86a4092a:::benchmark_data_smithi062_23645_object112090:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:14:29.723 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.701987+0000", 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0059416149999999999, 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0062172219999999997, 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 112091 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701987+0000", 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701987+0000", 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.701988+0000", 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0219999999999999e-06 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.702048+0000", 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9675e-05 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.702061+0000", 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2746e-05 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.702067+0000", 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5379999999999999e-06 2024-09-12T18:14:29.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.703334+0000", 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001266276 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.703417+0000", 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3801999999999995e-05 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:29.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.703501+0000", 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3543999999999998e-05 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:112095 5.1 5:86bbd73f:::benchmark_data_smithi062_23645_object112094:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.705010+0000", 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002918683, 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0032583949999999999, 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:29.728 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 112095 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705010+0000", 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705010+0000", 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705011+0000", 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3090000000000001e-06 2024-09-12T18:14:29.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705110+0000", 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8089000000000002e-05 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705121+0000", 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1821000000000001e-05 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705129+0000", 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5050000000000001e-06 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705360+0000", 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023124199999999999 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705472+0000", 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011139199999999999 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705556+0000", 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4351999999999995e-05 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:112094 5.6 e44/21 5:6472e4dd:::benchmark_data_smithi062_23645_object112093:head v 44'6949, mlcod=44'6946)", 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.705248+0000", 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002680885, 2024-09-12T18:14:29.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030845989999999999, 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705248+0000", 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705248+0000", 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705249+0000", 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3399999999999998e-07 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705287+0000", 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8368000000000003e-05 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705298+0000", 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0838e-05 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705304+0000", 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4110000000000001e-06 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705353+0000", 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8177999999999998e-05 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705367+0000", 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.487e-05 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:112098 5.9 5:9c4a8073:::benchmark_data_smithi062_23645_object112097:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.705349+0000", 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0025800900000000002, 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030346570000000001, 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.738 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 112098 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705349+0000", 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705349+0000", 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705350+0000", 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8899999999999998e-07 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705411+0000", 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1393e-05 2024-09-12T18:14:29.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705421+0000", 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0132999999999999e-05 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705429+0000", 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4340000000000003e-06 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705476+0000", 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7002999999999997e-05 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705592+0000", 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116573 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:112097 5.5 e44/21 5:a5bfdc48:::benchmark_data_smithi062_23645_object112096:head v 44'7089, mlcod=44'7087)", 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:29.705743+0000", 2024-09-12T18:14:29.742 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0021861010000000002, 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026844320000000001, 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705743+0000", 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705743+0000", 2024-09-12T18:14:29.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705743+0000", 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9800000000000003e-07 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705798+0000", 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4694000000000002e-05 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:29.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705809+0000", 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1309e-05 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705817+0000", 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0480000000000001e-06 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705866+0000", 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9901000000000002e-05 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:29.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:29.705881+0000", 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4148000000000001e-05 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 9 2024-09-12T18:14:29.746 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:29.747 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:29.790 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:29.789+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.866 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:29.861+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:29.941 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:29.941 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:29.941 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:29.941 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:29.941 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:29.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:29.967 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:29.963+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:29.988 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:14:30.067 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:30.065+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:30.164 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:30.164 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:30.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:30.164 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 77.868789937000003, 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:30.165 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:30.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:30.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 77.064461635000001, 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:30.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:30.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.179 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768865962000007, 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:30.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.186 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768772287000004, 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:30.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:30.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:30.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:30.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:30.194 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.194 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768703056999996, 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.195 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:30.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768612290999997, 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:30.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.207 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768551267999996, 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:30.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:30.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768492508999998, 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:30.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:30.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:30.219 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.768429459000004, 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.220 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:30.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:30.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.226 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.767629084999996, 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:30.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:30.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:30.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.233 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.767490882999994, 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:30.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:30.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:30.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:30.239 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.767427632999997, 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:30.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.767027666000004, 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:30.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.766837171999995, 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:30.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.766750275000007, 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:30.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:30.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.766626653000003, 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.267 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:30.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:30.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 66.766235053000003, 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:30.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:30.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 2.9076720250000001, 2024-09-12T18:14:30.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:30.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:30.284 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 2.899649648, 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.285 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:30.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.292 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 2.8880643620000002, 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:30.293 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:30.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:30.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:30.299 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:30.301 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:30.297+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:30.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:30.401 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:30.399+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:30.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 50 16 113582 113566 141.942 132.938 0.00890765 0.00704058 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113673 5.e 5:7d02ae64:::benchmark_data_smithi062_23645_object113672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.452073+0000", 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014271399999999999, 2024-09-12T18:14:30.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001459534, 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113673 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452073+0000", 2024-09-12T18:14:30.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452073+0000", 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452074+0000", 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452173+0000", 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8886000000000002e-05 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452182+0000", 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.713e-06 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452188+0000", 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0689999999999998e-06 2024-09-12T18:14:30.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452235+0000", 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6233000000000003e-05 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452329+0000", 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4751000000000001e-05 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.458 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113674 5.6 5:6812428c:::benchmark_data_smithi062_23645_object113673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.452408+0000", 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001091924, 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001198691, 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.459 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.460 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.460 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113674 2024-09-12T18:14:30.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.460 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452408+0000", 2024-09-12T18:14:30.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452408+0000", 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452409+0000", 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1099999999999995e-07 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452490+0000", 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1006000000000003e-05 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452500+0000", 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0329000000000001e-05 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452505+0000", 2024-09-12T18:14:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0200000000000002e-06 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452545+0000", 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0312000000000003e-05 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452681+0000", 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013554699999999999 2024-09-12T18:14:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452814+0000", 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133246 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:113667 5.1 e45/21 5:81706dee:::benchmark_data_smithi062_23645_object113666:head v 45'7104, mlcod=45'7101)", 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.452533+0000", 2024-09-12T18:14:30.465 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00096698499999999996, 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011476520000000001, 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452533+0000", 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452533+0000", 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452533+0000", 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.39e-07 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452599+0000", 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5185999999999996e-05 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452606+0000", 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7579999999999992e-06 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452611+0000", 2024-09-12T18:14:30.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9459999999999997e-06 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452656+0000", 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4295000000000002e-05 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.452668+0000", 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2214e-05 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:113668 5.c e45/21)", 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.453110+0000", 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00038976100000000002, 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00062182999999999997, 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453110+0000", 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453110+0000", 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453111+0000", 2024-09-12T18:14:30.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9400000000000001e-07 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453113+0000", 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2680000000000001e-06 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453119+0000", 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.144e-06 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453126+0000", 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5420000000000002e-06 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113676 5.b 5.dc796fbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.453645+0000", 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998546, 2024-09-12T18:14:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013460999999999999, 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113676 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453645+0000", 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453645+0000", 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453646+0000", 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.031e-06 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453678+0000", 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1506e-05 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453687+0000", 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2310000000000002e-06 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453694+0000", 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.204e-06 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113677 5.0 5.f4d40af0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.453713+0000", 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997869, 2024-09-12T18:14:30.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121991, 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113677 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453713+0000", 2024-09-12T18:14:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453713+0000", 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453714+0000", 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453741+0000", 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7835999999999999e-05 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453749+0000", 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.328e-06 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453754+0000", 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.519e-06 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.480 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113662 5.4 5:2d891418:::benchmark_data_smithi062_23645_object113661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.446547+0000", 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0069525139999999999, 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.007338186, 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113662 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446547+0000", 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446547+0000", 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446548+0000", 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.33e-07 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446688+0000", 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014000500000000001 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446703+0000", 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4201e-05 2024-09-12T18:14:30.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446721+0000", 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8334000000000001e-05 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447465+0000", 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00074429900000000002 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447583+0000", 2024-09-12T18:14:30.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117811 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113663 5.0 5:0f4f65a9:::benchmark_data_smithi062_23645_object113662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.446733+0000", 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0067667129999999997, 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072390229999999998, 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113663 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446733+0000", 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446733+0000", 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446734+0000", 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446759+0000", 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000002e-05 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446768+0000", 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446773+0000", 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2639999999999999e-06 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446828+0000", 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4947000000000001e-05 2024-09-12T18:14:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.446958+0000", 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129579 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113664 5.6 5:64ed1525:::benchmark_data_smithi062_23645_object113663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.447202+0000", 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0062975799999999997, 2024-09-12T18:14:30.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068538050000000001, 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113664 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447202+0000", 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447202+0000", 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447203+0000", 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.64e-07 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447305+0000", 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010178 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447322+0000", 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7297000000000001e-05 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447329+0000", 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1120000000000001e-06 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447372+0000", 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3192000000000003e-05 2024-09-12T18:14:30.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447506+0000", 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133924 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.447598+0000", 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2199000000000003e-05 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.451970+0000", 2024-09-12T18:14:30.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043725910000000003 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:113666 5.1 e45/21 5:869728bf:::benchmark_data_smithi062_23645_object113665:head v 45'7103, mlcod=45'7101)", 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.449761+0000", 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003739203, 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043659329999999998, 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.495 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449761+0000", 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449761+0000", 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449761+0000", 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449820+0000", 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8619999999999998e-05 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449830+0000", 2024-09-12T18:14:30.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.645e-06 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449836+0000", 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1589999999999998e-06 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449893+0000", 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7584999999999998e-05 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.449914+0000", 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0573000000000001e-05 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113668 5.c 5:38f68390:::benchmark_data_smithi062_23645_object113667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.450244+0000", 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0032564130000000001, 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039401369999999998, 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.499 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113668 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450244+0000", 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450244+0000", 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450244+0000", 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450288+0000", 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3761999999999999e-05 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450311+0000", 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2736999999999999e-05 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450325+0000", 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4105e-05 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450372+0000", 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6557999999999997e-05 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450467+0000", 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5156999999999997e-05 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450545+0000", 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8554999999999996e-05 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113670 5.b 5:daf67ed5:::benchmark_data_smithi062_23645_object113669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.450346+0000", 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031536810000000002, 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039073320000000003, 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.504 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113670 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450346+0000", 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450346+0000", 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450347+0000", 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1100000000000001e-07 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450372+0000", 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5157999999999999e-05 2024-09-12T18:14:30.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450378+0000", 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2480000000000001e-06 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450383+0000", 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450424+0000", 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1492999999999997e-05 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450516+0000", 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2027000000000005e-05 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113671 5.c 5:3f4f06e0:::benchmark_data_smithi062_23645_object113670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.508 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.450515+0000", 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0029849080000000001, 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037742129999999998, 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113671 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450515+0000", 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450515+0000", 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450516+0000", 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6599999999999996e-07 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450586+0000", 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9956999999999994e-05 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450603+0000", 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7796999999999999e-05 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450609+0000", 2024-09-12T18:14:30.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6459999999999998e-06 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453590+0000", 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029809630000000001 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453722+0000", 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013221399999999999 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453845+0000", 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012249799999999999 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:113672 5.b 5:dacc0f06:::benchmark_data_smithi062_23645_object113671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:30.450618+0000", 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028816839999999998, 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037051839999999998, 2024-09-12T18:14:30.513 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 113672 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450618+0000", 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450618+0000", 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450619+0000", 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6199999999999999e-07 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450669+0000", 2024-09-12T18:14:30.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0275999999999998e-05 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450677+0000", 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9079999999999995e-06 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.450683+0000", 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7289999999999997e-06 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453058+0000", 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023752159999999999 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:30.453228+0000", 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017005000000000001 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.518 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:30.518 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2024-09-12T18:14:30.518 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:30.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:30.520 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:30.515+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:30.619 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:30.615+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:30.718 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:30.719 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:30.719 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:30.719 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:30.719 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:30.720 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:30.717+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:30.740 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:30.829 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:30.827+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:30.921 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:30.917+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:30.933 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:30.933 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.526466099999993, 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:30.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:30.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:30.940 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.526280205000006, 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:30.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:30.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.946 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.526168452999997, 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:30.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:30.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.952 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.526004631000006, 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:30.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:30.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.956 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.525943865000002, 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:30.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15908 5.0 e25/21 5:0e6fd37a:::benchmark_data_smithi062_23645_object15907:head v 25'970, mlcod=25'968)", 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.690980701999997, 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017105711999999999, 2024-09-12T18:14:30.961 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240872+0000", 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240910+0000", 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7697999999999997e-05 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240918+0000", 2024-09-12T18:14:30.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1149999999999994e-06 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240923+0000", 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1200000000000001e-06 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240962+0000", 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9289000000000003e-05 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.240975+0000", 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2418e-05 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.244832+0000", 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038574630000000002 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.257978+0000", 2024-09-12T18:14:30.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013145192999999999 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.685216961999998, 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.966 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:30.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:30.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.302735415000001, 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:30.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:30.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:30.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.207100269000001, 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.977 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:30.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:30.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:72767 5.c 5:3d19f5c3:::benchmark_data_smithi062_23645_object72766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.779284097000001, 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017300254000000001, 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.983 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72767 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152568+0000", 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.152569+0000", 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153984+0000", 2024-09-12T18:14:30.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001414713 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.153994+0000", 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7079999999999992e-06 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.154000+0000", 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000001e-06 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155208+0000", 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012075689999999999 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155336+0000", 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012841299999999999 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.155481+0000", 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014465499999999999 2024-09-12T18:14:30.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.167316+0000", 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011835215 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169776+0000", 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024603310000000001 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169828+0000", 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440999999999998e-05 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:09.169869+0000", 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1056000000000001e-05 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:97341 5.c 5:31a5055b:::benchmark_data_smithi062_23645_object97340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-12T18:14:30.989 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.5905534360000004, 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017069225, 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 97341 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341299+0000", 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341300+0000", 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:14:30.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341329+0000", 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8912e-05 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341339+0000", 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0117e-05 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341345+0000", 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9220000000000002e-06 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341752+0000", 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040689099999999999 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.341872+0000", 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120728 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.342018+0000", 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014604799999999999 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.350193+0000", 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081745759999999994 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358267+0000", 2024-09-12T18:14:30.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080736120000000008 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358320+0000", 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3006e-05 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:21.358368+0000", 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8730000000000003e-05 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:105371 5.a 5:585ffaea:::benchmark_data_smithi062_23645_object105370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.283130+0000", 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6487225280000004, 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017369709000000001, 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 105371 2024-09-12T18:14:30.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283130+0000", 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283130+0000", 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283131+0000", 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7000000000000003e-07 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283229+0000", 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7884e-05 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283238+0000", 2024-09-12T18:14:30.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5699999999999999e-06 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283245+0000", 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0650000000000004e-06 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283475+0000", 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230647 2024-09-12T18:14:30.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283552+0000", 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7148000000000001e-05 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.283700+0000", 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000147305 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.290273+0000", 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065733299999999996 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.300332+0000", 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010059281999999999 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.300442+0000", 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010939500000000001 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.300500+0000", 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8112999999999997e-05 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.4160243619999999, 2024-09-12T18:14:31.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:31.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:31.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:31.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:106895 5.3 5:c2b29f11:::benchmark_data_smithi062_23645_object106894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.8833826380000005, 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017774775999999999, 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.009 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 106895 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048471+0000", 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8200000000000008e-07 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048565+0000", 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4252999999999994e-05 2024-09-12T18:14:31.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048580+0000", 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5285999999999999e-05 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048588+0000", 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6669999999999996e-06 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055671+0000", 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00708312 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055782+0000", 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011069999999999999 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055907+0000", 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012498699999999999 2024-09-12T18:14:31.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.064148+0000", 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082411059999999998 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066193+0000", 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020450830000000001 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066222+0000", 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066245+0000", 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2252e-05 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:31.015 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.8156428380000005, 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:31.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:31.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:31.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109252 5.a 5:5f8d3e25:::benchmark_data_smithi062_23645_object109251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.694481734, 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019636572000000001, 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.022 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109252 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:31.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237372+0000", 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1230000000000001e-06 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237434+0000", 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1991999999999999e-05 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237444+0000", 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237449+0000", 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237785+0000", 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033586800000000002 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237880+0000", 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5476999999999994e-05 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237995+0000", 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114592 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.241563+0000", 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003567874 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256915+0000", 2024-09-12T18:14:31.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015352648999999999 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256968+0000", 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2095000000000002e-05 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257007+0000", 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9836000000000003e-05 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.6785176279999998, 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:31.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.6775851159999999, 2024-09-12T18:14:31.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:31.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:31.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.6774846540000001, 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.042 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:31.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.6673625940000001, 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:31.048 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:31.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:31.054 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:31.055 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:31.056 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:31.057 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:31.051+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:31.157 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:31.153+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:31.216 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:31.216 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:31.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.216 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115310 5.f 5:f3b05371:::benchmark_data_smithi062_23645_object115309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.216 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.210185+0000", 2024-09-12T18:14:31.216 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0056086210000000003, 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005634605, 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115310 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210185+0000", 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210185+0000", 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210186+0000", 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4199999999999995e-07 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210257+0000", 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1774999999999996e-05 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210267+0000", 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7939999999999997e-06 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210273+0000", 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1530000000000002e-06 2024-09-12T18:14:31.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210856+0000", 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00058296800000000001 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210945+0000", 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8498000000000005e-05 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115308 5.3 e45/21 5:c8bce35a:::benchmark_data_smithi062_23645_object115307:head v 45'7244, mlcod=45'7241)", 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.212698+0000", 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0030955840000000002, 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0031965409999999998, 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212698+0000", 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212698+0000", 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212699+0000", 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5499999999999996e-07 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212734+0000", 2024-09-12T18:14:31.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4975999999999999e-05 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212743+0000", 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.55e-06 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212750+0000", 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0360000000000001e-06 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212823+0000", 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2509999999999995e-05 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212845+0000", 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1622999999999999e-05 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115302 5.5 e45/21 5:ac4f6a4d:::benchmark_data_smithi062_23645_object115301:head v 45'7288, mlcod=45'7285)", 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.212772+0000", 2024-09-12T18:14:31.224 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0030215039999999999, 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0031714149999999999, 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212772+0000", 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212772+0000", 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212772+0000", 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.41e-07 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212805+0000", 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2920000000000003e-05 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212813+0000", 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4359999999999996e-06 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212819+0000", 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6290000000000004e-06 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212880+0000", 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0850999999999997e-05 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212899+0000", 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9111e-05 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115311 5.9 5:95189a5c:::benchmark_data_smithi062_23645_object115310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.212925+0000", 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0028681520000000001, 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030715989999999999, 2024-09-12T18:14:31.228 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115311 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212925+0000", 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212925+0000", 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212926+0000", 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.64e-07 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212953+0000", 2024-09-12T18:14:31.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6880999999999999e-05 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212962+0000", 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4880000000000007e-06 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.212968+0000", 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8200000000000002e-06 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213996+0000", 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010283029999999999 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214132+0000", 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000135783 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115312 5.1 5:8c9038b0:::benchmark_data_smithi062_23645_object115311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.232 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.213405+0000", 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0023884520000000001, 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026535959999999998, 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115312 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213405+0000", 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213405+0000", 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213406+0000", 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9500000000000001e-07 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213490+0000", 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4136999999999998e-05 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213607+0000", 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011714699999999999 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.213619+0000", 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2167000000000001e-05 2024-09-12T18:14:31.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214046+0000", 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00042643800000000001 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214188+0000", 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014185900000000001 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214346+0000", 2024-09-12T18:14:31.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000158646 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115314 5.d 5:b73b47e4:::benchmark_data_smithi062_23645_object115313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.214142+0000", 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001651184, 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019839319999999999, 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.237 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115314 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214142+0000", 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214142+0000", 2024-09-12T18:14:31.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214143+0000", 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4499999999999995e-07 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214220+0000", 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6977999999999994e-05 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214232+0000", 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1776e-05 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214240+0000", 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8169999999999999e-06 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214290+0000", 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0590000000000002e-05 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214459+0000", 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00016853199999999999 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115313 5.3 e45/21 5:c05fcf64:::benchmark_data_smithi062_23645_object115312:head v 45'7245, mlcod=45'7241)", 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.214442+0000", 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0013510709999999999, 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0017389440000000001, 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.241 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.242 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.242 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214442+0000", 2024-09-12T18:14:31.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214442+0000", 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214443+0000", 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8899999999999998e-07 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214502+0000", 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9122000000000001e-05 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214513+0000", 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0429e-05 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214519+0000", 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6250000000000001e-06 2024-09-12T18:14:31.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215108+0000", 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00058852999999999998 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215125+0000", 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7554000000000002e-05 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:115309 5.1 e45/21)", 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.215710+0000", 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.3784999999999998e-05, 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00054042599999999999, 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215710+0000", 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215710+0000", 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215710+0000", 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215715+0000", 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1300000000000003e-06 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215725+0000", 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0733e-05 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.215730+0000", 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.028e-06 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:115312 5.1 e45/21)", 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.216089+0000", 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9997048, 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019863300000000001, 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.249 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216089+0000", 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216089+0000", 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216090+0000", 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3200000000000004e-07 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216097+0000", 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0269999999999998e-06 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216110+0000", 2024-09-12T18:14:31.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3019e-05 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216117+0000", 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9029999999999998e-06 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115315 5.6 e45/21 5:6a215bd8:::benchmark_data_smithi062_23645_object115314:head v 45'7178, mlcod=45'7176)", 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.216131+0000", 2024-09-12T18:14:31.252 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9996629, 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000199798, 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216131+0000", 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216131+0000", 2024-09-12T18:14:31.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216131+0000", 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8200000000000001e-07 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216173+0000", 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2160000000000003e-05 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216183+0000", 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216189+0000", 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2639999999999997e-06 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216235+0000", 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6236000000000003e-05 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216254+0000", 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8697000000000001e-05 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115317 5.5 e45/21)", 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.216210+0000", 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9995842, 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000166358, 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.256 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216210+0000", 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216210+0000", 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216210+0000", 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216280+0000", 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0271999999999994e-05 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216288+0000", 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1750000000000005e-06 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216294+0000", 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7930000000000003e-06 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115300 5.3 e45/21 5:ccf73c57:::benchmark_data_smithi062_23645_object115299:head v 45'7243, mlcod=45'7241)", 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.208469+0000", 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0073250060000000002, 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0079479609999999999, 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.259 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208469+0000", 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208469+0000", 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208469+0000", 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4799999999999998e-07 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208509+0000", 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9521000000000003e-05 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208518+0000", 2024-09-12T18:14:31.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9940000000000006e-06 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208524+0000", 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5610000000000004e-06 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208574+0000", 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9617999999999998e-05 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208591+0000", 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7555999999999999e-05 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115303 5.1 5:829b802b:::benchmark_data_smithi062_23645_object115302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.208654+0000", 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0071393940000000003, 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0078150570000000003, 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:31.263 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115303 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208654+0000", 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208654+0000", 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208655+0000", 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.057e-06 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208744+0000", 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8461000000000006e-05 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208754+0000", 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0268999999999999e-05 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208761+0000", 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3139999999999998e-06 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208821+0000", 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0257999999999998e-05 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.208963+0000", 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000141941 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209195+0000", 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023111099999999999 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.214015+0000", 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0048207450000000004 2024-09-12T18:14:31.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216450+0000", 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024342309999999998 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:115301 5.5 e45/21 5:af6ef284:::benchmark_data_smithi062_23645_object115300:head v 45'7287, mlcod=45'7285)", 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.209003+0000", 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0067906240000000003, 2024-09-12T18:14:31.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007549297, 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209003+0000", 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209003+0000", 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209004+0000", 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3799999999999997e-07 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209053+0000", 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9122000000000002e-05 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209061+0000", 2024-09-12T18:14:31.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5790000000000004e-06 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209068+0000", 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6930000000000001e-06 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209143+0000", 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4738000000000002e-05 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209159+0000", 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6379999999999999e-05 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115306 5.d 5:b589314b:::benchmark_data_smithi062_23645_object115305:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.209132+0000", 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0066617509999999996, 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0074807579999999997, 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.272 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115306 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209132+0000", 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209132+0000", 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209133+0000", 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209205+0000", 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2589000000000006e-05 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209214+0000", 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9390000000000003e-06 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209221+0000", 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4450000000000001e-06 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210648+0000", 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001427703 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.210767+0000", 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119026 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:115309 5.1 5:8f665314:::benchmark_data_smithi062_23645_object115308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:31.209501+0000", 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0062926400000000004, 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0071845420000000004, 2024-09-12T18:14:31.276 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 115309 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209501+0000", 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209501+0000", 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209502+0000", 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5300000000000004e-07 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209579+0000", 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7578999999999997e-05 2024-09-12T18:14:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209588+0000", 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8400000000000001e-06 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.209594+0000", 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0669999999999997e-06 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.211577+0000", 2024-09-12T18:14:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019827709999999999 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.211702+0000", 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000125284 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.211859+0000", 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000157152 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216438+0000", 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045785959999999999 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216606+0000", 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00016797000000000001 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:31.216675+0000", 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9653999999999994e-05 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.281 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.282 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.282 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:31.282 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 16 2024-09-12T18:14:31.282 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:31.283 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:31.279+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:31.284 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:31.384 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:31.379+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:31.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 51 16 115745 115729 141.809 135.188 0.00847231 0.00704725 2024-09-12T18:14:31.474 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:31.475 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:31.475 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:31.475 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:31.475 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:31.485 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:31.481+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:31.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:31.572 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:31.586 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:31.585+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:31.687 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:31.685+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:31.696 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.402130713000005, 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.697 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:31.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:31.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:31.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:31.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 78.597802411000004, 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:31.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:31.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:31.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.710 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.302206737999995, 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:31.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:31.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.302113062999993, 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:31.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:31.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:31.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.302043832999999, 2024-09-12T18:14:31.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:31.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.728 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.301953066999999, 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:31.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:31.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.734 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.301892043999999, 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:31.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.740 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.301833285000001, 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:31.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.746 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.301770235000006, 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:31.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:31.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:31.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:31.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:31.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:31.754 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.300969860999999, 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.755 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:31.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:31.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:31.761 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.300831658999996, 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:31.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:31.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:31.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.768 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.300768409, 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:31.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:31.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.775 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.300368442000007, 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:31.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:31.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:31.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:31.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.783 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.783 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.783 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.783 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.300177947999998, 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:31.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:31.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.790 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.300091050999995, 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:31.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:31.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:31.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.299967429000006, 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:31.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:31.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:31.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:31.804 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.804 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.804 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.299575829000005, 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:31.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:31.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.809 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.4410128010000003, 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.810 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:31.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:31.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:31.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:31.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.817 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.4329904239999998, 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:31.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:31.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.4214051379999999, 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:31.824 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:31.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:31.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:31.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:31.831 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:31.832 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:31.833 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:31.827+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:31.833 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:31.833 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:31.834 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:31.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:31.835 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:31.835 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:31.835 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:31.917 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T18:14:31.937 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:31.931+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:31.992 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:31.992 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:32.015 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:32.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:14:32.030 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-09-12T18:14:32.034 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:32.033+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:32.135 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.131+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:32.209 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:32.209 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:32.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:32.277 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.275+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:32.337 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:32.333+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:32.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 52 16 117903 117887 141.676 134.875 0.0117295 0.00705359 2024-09-12T18:14:32.429 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:32.430 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:32.438 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.435+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:32.452 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:32.539 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.535+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:32.608 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:32.608 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:32.631 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:32.641 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.639+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:32.742 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:32.741+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:32.790 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:32.790 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:32.812 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:32.843 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.839+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:32.944 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:32.939+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:33.009 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:33.009 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:33.011 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:14:33.030 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:33.045 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:33.041+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:33.148 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:33.143+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:33.185 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:33.186 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:33.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:33.249 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:33.247+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:33.348 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:33.345+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:33.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 53 16 120069 120053 141.557 135.375 0.00436044 0.00705969 2024-09-12T18:14:33.405 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:33.406 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:33.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:33.477 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:33.475+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:33.550 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:33.547+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:33.583 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:33.583 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:33.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:33.650 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:33.649+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:33.751 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:33.747+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:33.762 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:33.762 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:33.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:33.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:33.870 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:33.869+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:33.954 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:33.949+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:33.984 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:33.985 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:34.003 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:34.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:34.023 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:34.026 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:34.027 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:34.054 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:34.051+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:34.155 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:34.151+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:34.210 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:34.210 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.915159121000002, 2024-09-12T18:14:34.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:34.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:34.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:34.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:34.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:34.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.220 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.110830819, 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:34.221 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:34.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:34.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:34.229 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.815235146000006, 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:34.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:34.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:34.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:34.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:34.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:34.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:34.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.815141471000004, 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.240 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:34.245 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.815072240999996, 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:34.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:34.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.251 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.814981474999996, 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:34.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:34.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.257 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.814920451999996, 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:34.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.814861692999997, 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.263 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:34.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:34.268 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.814798643000003, 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:34.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:34.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.275 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:34.275 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.813998268999995, 2024-09-12T18:14:34.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:34.276 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.276 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.276 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.276 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:34.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:34.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:34.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.813860066999993, 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.282 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:34.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:34.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.813796816999997, 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:34.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.813396850000004, 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:34.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:34.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.813206355999995, 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:34.299 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:34.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:34.304 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.813119459000006, 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:34.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:34.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.310 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.812995837000003, 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:34.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 70.812604237000002, 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.316 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:34.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 6.9540412089999997, 2024-09-12T18:14:34.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:34.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:34.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 6.946018832, 2024-09-12T18:14:34.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:34.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 6.9344335460000002, 2024-09-12T18:14:34.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:34.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:34.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:34.338 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:34.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:34.340 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:34.335+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:34.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 54 16 122268 122252 141.48 137.438 0.00532561 0.00706337 2024-09-12T18:14:34.441 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:34.437+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:34.491 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:34.491 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122438 5.0 5:01b55a3b:::benchmark_data_smithi062_23645_object122437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.489190+0000", 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001820505, 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001845705, 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122438 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489190+0000", 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489190+0000", 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489190+0000", 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0900000000000002e-07 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489228+0000", 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7741999999999999e-05 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489239+0000", 2024-09-12T18:14:34.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0689e-05 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489244+0000", 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.344e-06 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489289+0000", 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5219999999999997e-05 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489420+0000", 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013104100000000001 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:122436 5.7 e46/21 5:e8d37abb:::benchmark_data_smithi062_23645_object122435:head v 46'7549, mlcod=46'7546)", 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.489557+0000", 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001452919, 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015389990000000001, 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.496 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489557+0000", 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489557+0000", 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489558+0000", 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489589+0000", 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1170999999999997e-05 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489598+0000", 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-06 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489605+0000", 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8580000000000002e-06 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489656+0000", 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0822000000000002e-05 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489671+0000", 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.573e-05 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.500 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:122439 5.7 e46/21)", 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.490773+0000", 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00023750600000000001, 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000374249, 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.490773+0000", 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.490773+0000", 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.490774+0000", 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6799999999999999e-07 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.490818+0000", 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4778999999999999e-05 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.490830+0000", 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1313e-05 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.490836+0000", 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.331e-06 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122422 5.0 5:091128d0:::benchmark_data_smithi062_23645_object122421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.482063+0000", 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0089473320000000005, 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091280690000000008, 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.504 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122422 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482063+0000", 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482063+0000", 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482064+0000", 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0399999999999995e-07 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482102+0000", 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8526999999999999e-05 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482114+0000", 2024-09-12T18:14:34.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1231e-05 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482121+0000", 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0639999999999996e-06 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482230+0000", 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109496 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.482364+0000", 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013374799999999999 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122426 5.8 5:1e44358f:::benchmark_data_smithi062_23645_object122425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.484478+0000", 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0065325469999999997, 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067828430000000002, 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122426 2024-09-12T18:14:34.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484478+0000", 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484478+0000", 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484479+0000", 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0399999999999995e-07 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484543+0000", 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4456999999999996e-05 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484551+0000", 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6179999999999997e-06 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484555+0000", 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6689999999999997e-06 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484602+0000", 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6239999999999998e-05 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484958+0000", 2024-09-12T18:14:34.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035622900000000001 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122427 5.e 5:7f529504:::benchmark_data_smithi062_23645_object122426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.484567+0000", 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0064430269999999996, 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067536899999999997, 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.513 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122427 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484567+0000", 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484567+0000", 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484568+0000", 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0900000000000002e-07 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484605+0000", 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7311999999999998e-05 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484611+0000", 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7359999999999998e-06 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484614+0000", 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484663+0000", 2024-09-12T18:14:34.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8704e-05 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.484786+0000", 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012295599999999999 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.517 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122431 5.c 5:3a3fa231:::benchmark_data_smithi062_23645_object122430:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.485190+0000", 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0058201520000000003, 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061871269999999997, 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:34.518 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122431 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.485190+0000", 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.485190+0000", 2024-09-12T18:14:34.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.485191+0000", 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8200000000000008e-07 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.485285+0000", 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3926999999999997e-05 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.485295+0000", 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6889999999999999e-06 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.485301+0000", 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5819999999999998e-06 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486315+0000", 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010137239999999999 2024-09-12T18:14:34.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486474+0000", 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015909299999999999 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486609+0000", 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013428800000000001 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489505+0000", 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002896675 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122433 5.8 5:1f2a57ce:::benchmark_data_smithi062_23645_object122432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.523 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.486881+0000", 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0041295539999999997, 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004563147, 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122433 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.524 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486881+0000", 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486881+0000", 2024-09-12T18:14:34.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486882+0000", 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0330000000000001e-06 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486926+0000", 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3738e-05 2024-09-12T18:14:34.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486937+0000", 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0929e-05 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.486943+0000", 2024-09-12T18:14:34.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5729999999999996e-06 2024-09-12T18:14:34.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487372+0000", 2024-09-12T18:14:34.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042905900000000003 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487525+0000", 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015284599999999999 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122434 5.a 5:59b385df:::benchmark_data_smithi062_23645_object122433:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.487812+0000", 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031986470000000002, 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036888049999999999, 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122434 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487812+0000", 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487812+0000", 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487813+0000", 2024-09-12T18:14:34.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1900000000000001e-07 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487914+0000", 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010134800000000001 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487927+0000", 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3456e-05 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487935+0000", 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.187e-06 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487999+0000", 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4292e-05 2024-09-12T18:14:34.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488122+0000", 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123125 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:122432 5.1 e46/21 5:8a14a281:::benchmark_data_smithi062_23645_object122431:head v 46'7635, mlcod=46'7633)", 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.487829+0000", 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031819019999999999, 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037239819999999998, 2024-09-12T18:14:34.534 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487829+0000", 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487829+0000", 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487829+0000", 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7599999999999997e-07 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487939+0000", 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109378 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487947+0000", 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6289999999999999e-06 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487953+0000", 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7400000000000001e-06 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488018+0000", 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5480000000000003e-05 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488037+0000", 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8651000000000002e-05 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122435 5.e 5:783fc93a:::benchmark_data_smithi062_23645_object122434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.487954+0000", 2024-09-12T18:14:34.538 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003056788, 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036508460000000001, 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122435 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.539 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487954+0000", 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487954+0000", 2024-09-12T18:14:34.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487954+0000", 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5000000000000002e-07 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.487993+0000", 2024-09-12T18:14:34.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9122000000000003e-05 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488002+0000", 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7099999999999996e-06 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488008+0000", 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2450000000000003e-06 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488058+0000", 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9293999999999999e-05 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.488196+0000", 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000138715 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122437 5.5 5:af7f7be0:::benchmark_data_smithi062_23645_object122436:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.489095+0000", 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001915225, 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002575141, 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122437 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489095+0000", 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489095+0000", 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489096+0000", 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8199999999999998e-07 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489153+0000", 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489165+0000", 2024-09-12T18:14:34.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2116999999999999e-05 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489171+0000", 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.686e-06 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489286+0000", 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114679 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489421+0000", 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013523100000000001 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.489552+0000", 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130288 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2024-09-12T18:14:34.548 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:34.551 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:34.549+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:34.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:34.651 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:34.649+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:34.713 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:34.713 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:34.713 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:34.714 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:34.714 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:34.736 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:34.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-12T18:14:34.753 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:34.749+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:34.853 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:34.851+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:34.901 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.494586353000003, 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.902 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:34.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:34.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.494400458000001, 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:34.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:34.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:34.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.913 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.494288706000006, 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:34.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:34.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.919 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.494124884000001, 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.494064117999997, 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:34.924 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.928 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.653337215000001, 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:34.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.270855668000003, 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:34.933 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:34.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:34.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.175220522, 2024-09-12T18:14:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:34.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:34.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:34.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.3841446150000003, 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:34.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:106895 5.3 5:c2b29f11:::benchmark_data_smithi062_23645_object106894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.8515028909999991, 2024-09-12T18:14:34.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017774775999999999, 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 106895 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048471+0000", 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8200000000000008e-07 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048565+0000", 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4252999999999994e-05 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048580+0000", 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5285999999999999e-05 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048588+0000", 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6669999999999996e-06 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055671+0000", 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00708312 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055782+0000", 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011069999999999999 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055907+0000", 2024-09-12T18:14:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012498699999999999 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.064148+0000", 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082411059999999998 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066193+0000", 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020450830000000001 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066222+0000", 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066245+0000", 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2252e-05 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7837630910000009, 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:34.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:34.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:34.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109252 5.a 5:5f8d3e25:::benchmark_data_smithi062_23645_object109251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.6626019870000004, 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019636572000000001, 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109252 2024-09-12T18:14:34.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237372+0000", 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1230000000000001e-06 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237434+0000", 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1991999999999999e-05 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237444+0000", 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237449+0000", 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237785+0000", 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033586800000000002 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237880+0000", 2024-09-12T18:14:34.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5476999999999994e-05 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237995+0000", 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114592 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.241563+0000", 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003567874 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256915+0000", 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015352648999999999 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256968+0000", 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2095000000000002e-05 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257007+0000", 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9836000000000003e-05 2024-09-12T18:14:34.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.6466378810000002, 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:34.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.6457053689999999, 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:34.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.6456049070000001, 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:34.981 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:34.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:34.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:34.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.6354828470000005, 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:34.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:34.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:34.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122182 5.a 5:507fd96f:::benchmark_data_smithi062_23645_object122181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.361461+0000", 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.538511556, 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017697094, 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:34.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122182 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361461+0000", 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361461+0000", 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361462+0000", 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8200000000000001e-07 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361487+0000", 2024-09-12T18:14:34.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5007999999999998e-05 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361491+0000", 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9609999999999996e-06 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361494+0000", 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7839999999999999e-06 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:34.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.365857+0000", 2024-09-12T18:14:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043631649999999996 2024-09-12T18:14:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.366000+0000", 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014258599999999999 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.379039+0000", 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013038851000000001 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.379085+0000", 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6548000000000002e-05 2024-09-12T18:14:35.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.379158+0000", 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2909000000000003e-05 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122189 5.a 5:50aea754:::benchmark_data_smithi062_23645_object122188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:35.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.53681710100000002, 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018313243, 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122189 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:14:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363230+0000", 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3151999999999994e-05 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363237+0000", 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1659999999999997e-06 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363241+0000", 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6949999999999999e-06 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.370442+0000", 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072006099999999996 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.370581+0000", 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013934599999999999 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.381347+0000", 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010765769 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.381400+0000", 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2408999999999999e-05 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.381469+0000", 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9405000000000004e-05 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.009 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122316 5.5 5:ada84853:::benchmark_data_smithi062_23645_object122315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.473474226, 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020857733999999999, 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122316 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:35.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1800000000000005e-07 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426617+0000", 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011740599999999999 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426633+0000", 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426656+0000", 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3207e-05 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430618+0000", 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039619390000000003 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430743+0000", 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124117 2024-09-12T18:14:35.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430875+0000", 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013285900000000001 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.438203+0000", 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073278010000000001 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447266+0000", 2024-09-12T18:14:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090626140000000001 2024-09-12T18:14:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447316+0000", 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9951000000000003e-05 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447356+0000", 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0528999999999998e-05 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122622 5.0 5:0a5b6dcd:::benchmark_data_smithi062_23645_object122621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.570916+0000", 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.32905659300000001, 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017370623000000002, 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.017 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122622 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.570916+0000", 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.570916+0000", 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.570917+0000", 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5000000000000002e-07 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.570950+0000", 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2879000000000001e-05 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.570962+0000", 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1972e-05 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.570967+0000", 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.31e-06 2024-09-12T18:14:35.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.575863+0000", 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048957699999999998 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.576008+0000", 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014479200000000001 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:35.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.588153+0000", 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012145888000000001 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.588209+0000", 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5878000000000003e-05 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.588287+0000", 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7484000000000006e-05 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.023 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:35.025 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:35.021+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:35.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:35.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:14:35.126 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:35.125+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:35.179 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:35.180 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:35.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.180 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:123921 5.7 5:e12f9431:::benchmark_data_smithi062_23645_object123920:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.180 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.174326+0000", 2024-09-12T18:14:35.180 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00534222, 2024-09-12T18:14:35.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053621509999999999, 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 123921 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174326+0000", 2024-09-12T18:14:35.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174326+0000", 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174327+0000", 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5499999999999997e-07 2024-09-12T18:14:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174382+0000", 2024-09-12T18:14:35.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5433999999999998e-05 2024-09-12T18:14:35.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174429+0000", 2024-09-12T18:14:35.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6527999999999999e-05 2024-09-12T18:14:35.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174437+0000", 2024-09-12T18:14:35.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2879999999999993e-06 2024-09-12T18:14:35.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174490+0000", 2024-09-12T18:14:35.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2797999999999998e-05 2024-09-12T18:14:35.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174623+0000", 2024-09-12T18:14:35.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133003 2024-09-12T18:14:35.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:35.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174767+0000", 2024-09-12T18:14:35.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014375 2024-09-12T18:14:35.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177329+0000", 2024-09-12T18:14:35.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002562262 2024-09-12T18:14:35.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.191 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.192 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.193 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:123923 5.2 5:483c6d61:::benchmark_data_smithi062_23645_object123922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.193 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.174991+0000", 2024-09-12T18:14:35.193 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0046771620000000003, 2024-09-12T18:14:35.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0047433270000000003, 2024-09-12T18:14:35.193 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.194 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.194 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.194 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.194 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.195 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.195 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 123923 2024-09-12T18:14:35.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.197 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174991+0000", 2024-09-12T18:14:35.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174991+0000", 2024-09-12T18:14:35.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.174992+0000", 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.175055+0000", 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2686000000000003e-05 2024-09-12T18:14:35.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.175069+0000", 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4559000000000001e-05 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.175078+0000", 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5080000000000005e-06 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.175142+0000", 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4233000000000007e-05 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.175267+0000", 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012501400000000001 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.175398+0000", 2024-09-12T18:14:35.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013121699999999999 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177742+0000", 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002344311 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:123928 5.1 5:858b64ab:::benchmark_data_smithi062_23645_object123927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.177143+0000", 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0025256509999999999, 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026369560000000002, 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 123928 2024-09-12T18:14:35.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177143+0000", 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177143+0000", 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177144+0000", 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1340000000000001e-06 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177197+0000", 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3542999999999999e-05 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177217+0000", 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9372e-05 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177225+0000", 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3599999999999996e-06 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177285+0000", 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0523000000000003e-05 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177417+0000", 2024-09-12T18:14:35.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013133900000000001 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177503+0000", 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6279999999999994e-05 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:123926 5.c e46/21 5:3c182427:::benchmark_data_smithi062_23645_object123925:head v 46'7647, mlcod=46'7645)", 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.177445+0000", 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0022232390000000001, 2024-09-12T18:14:35.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023706040000000001, 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177445+0000", 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177445+0000", 2024-09-12T18:14:35.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177446+0000", 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177518+0000", 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2353000000000003e-05 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177530+0000", 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1763000000000001e-05 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177536+0000", 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3720000000000001e-06 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177590+0000", 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3748000000000001e-05 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177610+0000", 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0673e-05 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:123929 5.3 e46/21 5:ce174b0e:::benchmark_data_smithi062_23645_object123928:head v 46'7821, mlcod=46'7819)", 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.177923+0000", 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001744981, 2024-09-12T18:14:35.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001928716, 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177923+0000", 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177923+0000", 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177924+0000", 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8800000000000002e-07 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177982+0000", 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7951000000000001e-05 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.177995+0000", 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3687e-05 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178002+0000", 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9580000000000001e-06 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178049+0000", 2024-09-12T18:14:35.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6202999999999998e-05 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178067+0000", 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8270999999999998e-05 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:123930 5.2 5:4cb4f0ba:::benchmark_data_smithi062_23645_object123929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.178572+0000", 2024-09-12T18:14:35.217 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001095941, 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001313867, 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 123930 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178572+0000", 2024-09-12T18:14:35.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178572+0000", 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178573+0000", 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6099999999999999e-07 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178646+0000", 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2990000000000004e-05 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178661+0000", 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4538e-05 2024-09-12T18:14:35.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178670+0000", 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0180000000000007e-06 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178725+0000", 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5532999999999998e-05 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.178864+0000", 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013834700000000001 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179015+0000", 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015136899999999999 2024-09-12T18:14:35.222 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.223 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.223 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.223 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:123931 5.f 5:f93cf112:::benchmark_data_smithi062_23645_object123930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.223 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:35.179447+0000", 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000221361, 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00047429500000000001, 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.224 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 123931 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179447+0000", 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179447+0000", 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179448+0000", 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9099999999999991e-07 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179533+0000", 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5204000000000006e-05 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179545+0000", 2024-09-12T18:14:35.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1932e-05 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179552+0000", 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2710000000000003e-06 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179600+0000", 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7923000000000002e-05 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:35.179703+0000", 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000102538 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:14:35.228 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:35.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:35.230 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:35.227+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:35.331 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:35.327+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:35.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 55 16 124438 124422 141.373 135.625 0.00745738 0.00706885 2024-09-12T18:14:35.427 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:35.427 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:35.427 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:35.427 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:35.427 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:35.431 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:35.427+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:35.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:35.533 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:35.529+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:35.605 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:35.606 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:35.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:35.606 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:35.606 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.606 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:35.606 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 83.310305440999997, 2024-09-12T18:14:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.608 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:35.608 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:35.608 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:35.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.608 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:35.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.610 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.610 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:35.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.610 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:35.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:35.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:35.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:35.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:35.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:35.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:35.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:35.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:35.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:35.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:35.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:35.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:35.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:35.623 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.623 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.623 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 82.505977138999995, 2024-09-12T18:14:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:35.624 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:35.625 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:35.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:35.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:35.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:35.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:35.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:35.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:35.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:35.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:35.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:35.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.635 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.210381466000001, 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:35.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.641 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.210287790999999, 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:35.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:35.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.210218561000005, 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:35.647 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:35.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:35.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.210127795000005, 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.653 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:35.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.659 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.210066772000005, 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:35.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.210008013000007, 2024-09-12T18:14:35.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:35.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:35.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.209944962999998, 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.209144589000005, 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.209006387000002, 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.208943137000006, 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.208543169999999, 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.208352676000004, 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.208265779000001, 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.208142156999997, 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 72.207750556999997, 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.3491875289999999, 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.3411651520000003, 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.3295798659999996, 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:35.742 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:35.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:35.744 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:35.739+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:35.844 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:35.841+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125515 5.8 5:166aa55e:::benchmark_data_smithi062_23645_object125514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.901013+0000", 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014075590000000001, 2024-09-12T18:14:35.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014337729999999999, 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125515 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901013+0000", 2024-09-12T18:14:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901013+0000", 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901014+0000", 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2600000000000001e-07 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901077+0000", 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2918999999999998e-05 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901090+0000", 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2605e-05 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901097+0000", 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6890000000000004e-06 2024-09-12T18:14:35.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901152+0000", 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5127000000000003e-05 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901281+0000", 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128596 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125516 5.c 5:3049c867:::benchmark_data_smithi062_23645_object125515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.901116+0000", 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0013048630000000001, 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013982910000000001, 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125516 2024-09-12T18:14:35.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901116+0000", 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901116+0000", 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901116+0000", 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901159+0000", 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2991000000000002e-05 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901169+0000", 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5559999999999996e-06 2024-09-12T18:14:35.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901175+0000", 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.84e-06 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901293+0000", 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011791200000000001 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901420+0000", 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127136 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901575+0000", 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015549800000000001 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125519 5.0 5:0aa098e7:::benchmark_data_smithi062_23645_object125518:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.912 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.901191+0000", 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0012300119999999999, 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001385446, 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125519 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901191+0000", 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901191+0000", 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901191+0000", 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9400000000000005e-07 2024-09-12T18:14:35.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901228+0000", 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6708999999999997e-05 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901236+0000", 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2199999999999992e-06 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901244+0000", 2024-09-12T18:14:35.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:14:35.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901324+0000", 2024-09-12T18:14:35.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9653999999999993e-05 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901438+0000", 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113892 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:125518 5.7 e46/21 5:ef3ef68c:::benchmark_data_smithi062_23645_object125517:head v 46'7737, mlcod=46'7733)", 2024-09-12T18:14:35.917 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.901758+0000", 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00066287400000000004, 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094459600000000002, 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901758+0000", 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901758+0000", 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901758+0000", 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901815+0000", 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6530000000000003e-05 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901827+0000", 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2048999999999999e-05 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901833+0000", 2024-09-12T18:14:35.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4450000000000001e-06 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901880+0000", 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6251000000000002e-05 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901897+0000", 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7203000000000001e-05 2024-09-12T18:14:35.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:125520 5.1 e46/21 5:86333ede:::benchmark_data_smithi062_23645_object125519:head v 46'7825, mlcod=46'7823)", 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.902002+0000", 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00041857999999999999, 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00074953200000000002, 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.922 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902002+0000", 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902002+0000", 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902003+0000", 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902048+0000", 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5813999999999999e-05 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902060+0000", 2024-09-12T18:14:35.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1606e-05 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902066+0000", 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8220000000000003e-06 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902126+0000", 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9935999999999997e-05 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.902138+0000", 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2223e-05 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125497 5.e 5:7809b57b:::benchmark_data_smithi062_23645_object125496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.890931+0000", 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.011489833, 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011873355, 2024-09-12T18:14:35.926 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125497 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.890931+0000", 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.890931+0000", 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.890931+0000", 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.890955+0000", 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3159999999999998e-05 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.890961+0000", 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4409999999999998e-06 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.890966+0000", 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1390000000000003e-06 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.891025+0000", 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9061999999999998e-05 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.891140+0000", 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115216 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125506 5.6 5:6d99911b:::benchmark_data_smithi062_23645_object125505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.897331+0000", 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050900449999999996, 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055305659999999998, 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.931 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125506 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897331+0000", 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897331+0000", 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897332+0000", 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897363+0000", 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1405999999999997e-05 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897375+0000", 2024-09-12T18:14:35.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2169e-05 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897383+0000", 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2749999999999995e-06 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897443+0000", 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9033999999999998e-05 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897585+0000", 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014236199999999999 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897678+0000", 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3313999999999995e-05 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.935 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125507 5.4 5:2fca7438:::benchmark_data_smithi062_23645_object125506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.897407+0000", 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050139360000000001, 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005517826, 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125507 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.936 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897407+0000", 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897407+0000", 2024-09-12T18:14:35.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897407+0000", 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7899999999999999e-07 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897435+0000", 2024-09-12T18:14:35.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8149000000000001e-05 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897444+0000", 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9619999999999999e-06 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897451+0000", 2024-09-12T18:14:35.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7340000000000002e-06 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897514+0000", 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2988000000000001e-05 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897665+0000", 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150808 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.940 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125509 5.6 5:6c7da9f4:::benchmark_data_smithi062_23645_object125508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.897792+0000", 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.004628933, 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051884660000000001, 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125509 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897792+0000", 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897792+0000", 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897793+0000", 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1399999999999995e-07 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897877+0000", 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4000999999999998e-05 2024-09-12T18:14:35.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897889+0000", 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2666e-05 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897897+0000", 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2529999999999998e-06 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901061+0000", 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031640689999999998 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901178+0000", 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117533 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.901254+0000", 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6035e-05 2024-09-12T18:14:35.945 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125511 5.c 5:3eb82b9b:::benchmark_data_smithi062_23645_object125510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.897912+0000", 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0045082100000000003, 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051287859999999998, 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.946 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125511 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897912+0000", 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897912+0000", 2024-09-12T18:14:35.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897913+0000", 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9999999999999997e-07 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897955+0000", 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2135999999999998e-05 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897963+0000", 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1769999999999998e-06 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.897969+0000", 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0800000000000002e-06 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.898036+0000", 2024-09-12T18:14:35.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6515999999999998e-05 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.898214+0000", 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017778499999999999 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.898353+0000", 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013972 2024-09-12T18:14:35.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:125510 5.7 e46/21 5:e8152aa1:::benchmark_data_smithi062_23645_object125509:head v 46'7736, mlcod=46'7732)", 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.899445+0000", 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002975906, 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036549289999999999, 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899445+0000", 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899445+0000", 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899445+0000", 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7400000000000003e-07 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899525+0000", 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9246000000000007e-05 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899534+0000", 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9209999999999998e-06 2024-09-12T18:14:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899540+0000", 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6980000000000001e-06 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899588+0000", 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7997999999999997e-05 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.899605+0000", 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7198999999999999e-05 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125512 5.5 5:a6488e06:::benchmark_data_smithi062_23645_object125511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.900385+0000", 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020352090000000001, 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027644430000000001, 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125512 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900385+0000", 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900385+0000", 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900387+0000", 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.13e-06 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900425+0000", 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8850000000000002e-05 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900436+0000", 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0444e-05 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900443+0000", 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.435e-06 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900485+0000", 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1321e-05 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900583+0000", 2024-09-12T18:14:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8735999999999998e-05 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900667+0000", 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3548999999999996e-05 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125513 5.e 5.6a05096e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.900461+0000", 2024-09-12T18:14:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0019594450000000002, 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027452420000000002, 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125513 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900461+0000", 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900461+0000", 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900462+0000", 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4799999999999997e-07 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900498+0000", 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6001000000000003e-05 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900507+0000", 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1139999999999995e-06 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900513+0000", 2024-09-12T18:14:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0360000000000003e-06 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125514 5.6 5.21379d56 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.900525+0000", 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001895433, 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002724013, 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125514 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900525+0000", 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900525+0000", 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900526+0000", 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-07 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900552+0000", 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6324000000000001e-05 2024-09-12T18:14:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900574+0000", 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1415000000000001e-05 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.900580+0000", 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7399999999999998e-06 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2024-09-12T18:14:35.968 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:35.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:35.970 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:35.967+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:14:36.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:36.030 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T18:14:36.070 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:36.065+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:36.143 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-09-12T18:14:36.143 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-09-12T18:14:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:36.167 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:36.167 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:36.167 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:36.167 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:36.168 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:36.171 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:36.167+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:36.177 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:36.178 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:36.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:36.195 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:36.195 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:36.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:36.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:36.277 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:36.275+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:36.372 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:36.369+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:36.391 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:36.392 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:36.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 56 16 126587 126571 141.247 134.312 0.00375233 0.00707545 2024-09-12T18:14:36.411 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:36.473 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:36.469+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:36.562 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:36.562 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:36.574 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:36.571+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:36.585 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:36.676 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:36.673+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:36.776 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:36.771+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:36.781 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:36.781 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:36.803 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:36.894 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:36.893+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:36.979 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:36.977+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:37.003 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:37.003 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:37.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:37.080 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.075+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.181 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.179+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.185 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:37.185 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:37.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:37.293 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.291+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.384 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.379+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.400 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:37.400 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:37.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 57 16 128707 128691 141.093 132.5 0.00913541 0.00708286 2024-09-12T18:14:37.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:37.509 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.507+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.586 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.583+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.618 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:37.618 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:37.638 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:37.687 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:37.685+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:37.788 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:37.783+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:37.798 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:37.798 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:37.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:37.906 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:37.905+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:37.991 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:37.985+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:38.016 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:38.016 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:38.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:38.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:14:38.122 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:38.121+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:38.192 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:38.187+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:38.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:38.232 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:38.233 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:38.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:38.297 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:38.295+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:38.322 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:38.341 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:38.341 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:38.361 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:38.361 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:38.365 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:38.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:38.393 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:38.391+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:38.404 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 58 16 130862 130846 140.982 134.688 0.00556421 0.00708867 2024-09-12T18:14:38.413 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:38.413 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:38.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.413 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130850 5.a 5:54a68536:::benchmark_data_smithi062_23645_object130849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.401975+0000", 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010797163, 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010825992, 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130850 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.401975+0000", 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.401975+0000", 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.401976+0000", 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4300000000000001e-07 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.402001+0000", 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5647e-05 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.402013+0000", 2024-09-12T18:14:38.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1199000000000001e-05 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.402019+0000", 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4670000000000001e-06 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.402706+0000", 2024-09-12T18:14:38.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068726699999999998 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.402860+0000", 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153559 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130855 5.a 5:5d91fbdc:::benchmark_data_smithi062_23645_object130854:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.418 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.403126+0000", 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0096456770000000001, 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097467439999999999, 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130855 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.403126+0000", 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.403126+0000", 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.403127+0000", 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.404560+0000", 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00143246 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.404590+0000", 2024-09-12T18:14:38.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0212000000000001e-05 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.404600+0000", 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6989999999999998e-06 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.404858+0000", 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000258421 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.404972+0000", 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011422 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130861 5.a 5:536d7e3b:::benchmark_data_smithi062_23645_object130860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.423 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.405557+0000", 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0072146579999999997, 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.007378997, 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130861 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.405557+0000", 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.405557+0000", 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.405558+0000", 2024-09-12T18:14:38.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6799999999999999e-07 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.405621+0000", 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3281999999999995e-05 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.405632+0000", 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0429e-05 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.405638+0000", 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.406768+0000", 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011305340000000001 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.406890+0000", 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012180600000000001 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130863 5.a 5:55253ccd:::benchmark_data_smithi062_23645_object130862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.407075+0000", 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0056974950000000003, 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059303990000000003, 2024-09-12T18:14:38.428 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130863 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407075+0000", 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407075+0000", 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407075+0000", 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9100000000000002e-07 2024-09-12T18:14:38.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407124+0000", 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8155999999999998e-05 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407133+0000", 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5850000000000006e-06 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407140+0000", 2024-09-12T18:14:38.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9079999999999998e-06 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.408866+0000", 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017261819999999999 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.408990+0000", 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012374700000000001 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.432 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130864 5.a 5:598ba7a0:::benchmark_data_smithi062_23645_object130863:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.407637+0000", 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0051352639999999996, 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054340380000000004, 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.433 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130864 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407637+0000", 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407637+0000", 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407637+0000", 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8800000000000002e-07 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407694+0000", 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6742e-05 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407703+0000", 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7849999999999997e-06 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.407708+0000", 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6419999999999998e-06 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.410997+0000", 2024-09-12T18:14:38.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032895160000000001 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.411148+0000", 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015106900000000001 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130867 5.b 5:de3197f9:::benchmark_data_smithi062_23645_object130866:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.409146+0000", 2024-09-12T18:14:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0036258610000000002, 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039890259999999997, 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130867 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.409146+0000", 2024-09-12T18:14:38.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.409146+0000", 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.409147+0000", 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.33e-07 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.409225+0000", 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8170000000000005e-05 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.409242+0000", 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6931000000000001e-05 2024-09-12T18:14:38.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.409250+0000", 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.157e-06 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.411335+0000", 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020841750000000002 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.411442+0000", 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107476 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130870 5.b 5:d0ed0458:::benchmark_data_smithi062_23645_object130869:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.412841+0000", 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999309, 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00036407099999999999, 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130870 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412841+0000", 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412841+0000", 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412842+0000", 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412867+0000", 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4947e-05 2024-09-12T18:14:38.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412877+0000", 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9480000000000003e-06 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412882+0000", 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2140000000000004e-06 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412928+0000", 2024-09-12T18:14:38.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5222000000000002e-05 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413028+0000", 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100818 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130871 5.b 5.43144c9b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.412904+0000", 2024-09-12T18:14:38.447 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998679, 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000363245, 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130871 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412904+0000", 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412904+0000", 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412904+0000", 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.34e-07 2024-09-12T18:14:38.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412931+0000", 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6500999999999999e-05 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412938+0000", 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7739999999999999e-06 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412941+0000", 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6459999999999999e-06 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130872 5.5 5:a3f872e3:::benchmark_data_smithi062_23645_object130871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.412951+0000", 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998207, 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037132099999999998, 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.451 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130872 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412951+0000", 2024-09-12T18:14:38.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412951+0000", 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412952+0000", 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7100000000000002e-07 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412986+0000", 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4199000000000002e-05 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.412994+0000", 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5889999999999997e-06 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413001+0000", 2024-09-12T18:14:38.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.25e-06 2024-09-12T18:14:38.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413051+0000", 2024-09-12T18:14:38.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0309999999999998e-05 2024-09-12T18:14:38.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413179+0000", 2024-09-12T18:14:38.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127751 2024-09-12T18:14:38.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413303+0000", 2024-09-12T18:14:38.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012363000000000001 2024-09-12T18:14:38.458 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.458 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.458 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.458 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:130873 5.4 5:2d7dc8c7:::benchmark_data_smithi062_23645_object130872:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:38.459 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.413017+0000", 2024-09-12T18:14:38.459 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997544, 2024-09-12T18:14:38.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037484200000000001, 2024-09-12T18:14:38.459 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.459 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.459 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.460 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.460 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.460 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.460 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 130873 2024-09-12T18:14:38.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.460 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413017+0000", 2024-09-12T18:14:38.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413017+0000", 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413018+0000", 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413047+0000", 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8711999999999999e-05 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413054+0000", 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8909999999999998e-06 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413059+0000", 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5670000000000002e-06 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413134+0000", 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4875000000000004e-05 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.413253+0000", 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119039 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.464 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.465 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:38.465 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 10 2024-09-12T18:14:38.465 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:38.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:38.509 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:38.507+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:38.594 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:38.591+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:38.659 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:38.659 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:38.659 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:38.659 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:38.659 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:38.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:38.695 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:38.693+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:38.796 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:38.793+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:38.881 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:38.881 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 75.474668163999993, 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.882 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:38.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:38.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:38.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:38.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:38.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:38.889 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 75.474482269000006, 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:38.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:38.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:38.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:38.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.895 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 75.474370516999997, 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:38.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:38.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 75.474206695000007, 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.902 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:38.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 75.474145929000002, 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:38.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:38.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:38.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.633419025999999, 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.912 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:38.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.916 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.250937479000001, 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.917 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:38.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:38.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:61352 5.3 5:c9d38963:::benchmark_data_smithi062_23645_object61351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 35.155302333000002, 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017884984, 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.923 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 61352 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724752+0000", 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724753+0000", 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724807+0000", 2024-09-12T18:14:38.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3791e-05 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724814+0000", 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5120000000000002e-06 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.724830+0000", 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5345999999999998e-05 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730330+0000", 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055003140000000001 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730461+0000", 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013067600000000001 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.730594+0000", 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133421 2024-09-12T18:14:38.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.732908+0000", 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023140090000000001 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742552+0000", 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096443180000000007 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742600+0000", 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8041999999999998e-05 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:03.742637+0000", 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6937000000000002e-05 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.929 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.364226426, 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:38.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:106895 5.3 5:c2b29f11:::benchmark_data_smithi062_23645_object106894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.831584702000001, 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017774775999999999, 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 106895 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.935 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048470+0000", 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048471+0000", 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8200000000000008e-07 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048565+0000", 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4252999999999994e-05 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048580+0000", 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5285999999999999e-05 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.048588+0000", 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6669999999999996e-06 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055671+0000", 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00708312 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055782+0000", 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011069999999999999 2024-09-12T18:14:38.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.055907+0000", 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012498699999999999 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.064148+0000", 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082411059999999998 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066193+0000", 2024-09-12T18:14:38.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020450830000000001 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066222+0000", 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.066245+0000", 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2252e-05 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.940 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.763844902000001, 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:38.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109252 5.a 5:5f8d3e25:::benchmark_data_smithi062_23645_object109251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.642683798, 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019636572000000001, 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.947 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109252 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237372+0000", 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1230000000000001e-06 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237434+0000", 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1991999999999999e-05 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237444+0000", 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237449+0000", 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237785+0000", 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033586800000000002 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237880+0000", 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5476999999999994e-05 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237995+0000", 2024-09-12T18:14:38.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114592 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.241563+0000", 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003567874 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256915+0000", 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015352648999999999 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256968+0000", 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2095000000000002e-05 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257007+0000", 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9836000000000003e-05 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.953 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.626719692, 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:38.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:38.960 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.62578718, 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:38.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:38.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:38.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.625686718000001, 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.967 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:38.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:38.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.615564658, 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:38.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:38.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:38.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:38.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122182 5.a 5:507fd96f:::benchmark_data_smithi062_23645_object122181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.361461+0000", 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5185933670000002, 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017697094, 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.981 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122182 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361461+0000", 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361461+0000", 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361462+0000", 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8200000000000001e-07 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361487+0000", 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5007999999999998e-05 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361491+0000", 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9609999999999996e-06 2024-09-12T18:14:38.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.361494+0000", 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7839999999999999e-06 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.365857+0000", 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043631649999999996 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.366000+0000", 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014258599999999999 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.379039+0000", 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013038851000000001 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.379085+0000", 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6548000000000002e-05 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.379158+0000", 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2909000000000003e-05 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122189 5.a 5:50aea754:::benchmark_data_smithi062_23645_object122188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:38.986 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5168989120000003, 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018313243, 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122189 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363156+0000", 2024-09-12T18:14:38.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9100000000000003e-07 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363230+0000", 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3151999999999994e-05 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363237+0000", 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1659999999999997e-06 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.363241+0000", 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6949999999999999e-06 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.370442+0000", 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072006099999999996 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.370581+0000", 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013934599999999999 2024-09-12T18:14:38.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.381347+0000", 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010765769 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.381400+0000", 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2408999999999999e-05 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.381469+0000", 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9405000000000004e-05 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122316 5.5 5:ada84853:::benchmark_data_smithi062_23645_object122315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4535560370000002, 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020857733999999999, 2024-09-12T18:14:38.992 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122316 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1800000000000005e-07 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:38.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426617+0000", 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011740599999999999 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426633+0000", 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426656+0000", 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3207e-05 2024-09-12T18:14:38.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430618+0000", 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039619390000000003 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430743+0000", 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124117 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430875+0000", 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013285900000000001 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.438203+0000", 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073278010000000001 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447266+0000", 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090626140000000001 2024-09-12T18:14:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447316+0000", 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9951000000000003e-05 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447356+0000", 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0528999999999998e-05 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:38.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125560 5.0 5:0778113e:::benchmark_data_smithi062_23645_object125559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.922093+0000", 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 2.9579611749999999, 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018663478000000001, 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125560 2024-09-12T18:14:38.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922093+0000", 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922093+0000", 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922094+0000", 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.063e-06 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922166+0000", 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1130000000000005e-05 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922187+0000", 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1594999999999999e-05 2024-09-12T18:14:39.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922215+0000", 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8041000000000001e-05 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.930151+0000", 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079359719999999995 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.930248+0000", 2024-09-12T18:14:39.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6422999999999995e-05 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.940664+0000", 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010416448 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:39.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.940714+0000", 2024-09-12T18:14:39.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0182999999999997e-05 2024-09-12T18:14:39.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.940757+0000", 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2623000000000002e-05 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.005 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:39.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:39.008 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:39.005+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:39.047 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:14:39.107 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:39.103+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:39.168 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:39.168 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:39.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.168 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:132418 5.2 5:48aba036:::benchmark_data_smithi062_23645_object132417:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.163301+0000", 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0054268420000000003, 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0054532579999999999, 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 132418 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163301+0000", 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163301+0000", 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163302+0000", 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0240000000000001e-06 2024-09-12T18:14:39.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163378+0000", 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6390999999999994e-05 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163390+0000", 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1449e-05 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163397+0000", 2024-09-12T18:14:39.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8950000000000001e-06 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163449+0000", 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2191000000000002e-05 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163589+0000", 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014009100000000001 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.163795+0000", 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020572900000000001 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166915+0000", 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0031207990000000001 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:132415 5.5 e48/21 5:a68e7be9:::benchmark_data_smithi062_23645_object132414:head v 48'8395, mlcod=48'8392)", 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.165442+0000", 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0032861489999999999, 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033844439999999999, 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165442+0000", 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165442+0000", 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165442+0000", 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165468+0000", 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5658999999999999e-05 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165475+0000", 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7479999999999996e-06 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165479+0000", 2024-09-12T18:14:39.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7489999999999998e-06 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165529+0000", 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9353e-05 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165551+0000", 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2081000000000001e-05 2024-09-12T18:14:39.177 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:132420 5.1 5:8de4a091:::benchmark_data_smithi062_23645_object132419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.165921+0000", 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0028072230000000002, 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029593739999999999, 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.178 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 132420 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165921+0000", 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165921+0000", 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.165922+0000", 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1030000000000001e-06 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166025+0000", 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103688 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166037+0000", 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1283e-05 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166043+0000", 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.849e-06 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166098+0000", 2024-09-12T18:14:39.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4772999999999999e-05 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166183+0000", 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4895000000000006e-05 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166276+0000", 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3022000000000005e-05 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.182 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:132421 5.c e48/21 5:3172b607:::benchmark_data_smithi062_23645_object132420:head v 48'8170, mlcod=48'8168)", 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.166565+0000", 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0021624109999999999, 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023762420000000002, 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166565+0000", 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166565+0000", 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166566+0000", 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9399999999999995e-07 2024-09-12T18:14:39.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166628+0000", 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1984999999999997e-05 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166638+0000", 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0294e-05 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166644+0000", 2024-09-12T18:14:39.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4709999999999998e-06 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166695+0000", 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1489000000000001e-05 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.166723+0000", 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.773e-05 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:132422 5.d 5:b0ab6c60:::benchmark_data_smithi062_23645_object132421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.167135+0000", 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001592443, 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001861073, 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.187 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 132422 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167135+0000", 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167135+0000", 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167136+0000", 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4499999999999996e-07 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167186+0000", 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0315000000000002e-05 2024-09-12T18:14:39.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167199+0000", 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2941e-05 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167206+0000", 2024-09-12T18:14:39.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167266+0000", 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9419000000000001e-05 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167409+0000", 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014365499999999999 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.193 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:132423 5.1 5:8252b58b:::benchmark_data_smithi062_23645_object132422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.167222+0000", 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001506032, 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001834268, 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.194 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 132423 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167222+0000", 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167222+0000", 2024-09-12T18:14:39.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167222+0000", 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3300000000000002e-07 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167263+0000", 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1087000000000002e-05 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167269+0000", 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5609999999999998e-06 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.167273+0000", 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4449999999999998e-06 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168117+0000", 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084387899999999996 2024-09-12T18:14:39.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168211+0000", 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3511999999999995e-05 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168307+0000", 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5772000000000004e-05 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:132432 5.1 5.203bbc11 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:39.168825+0000", 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9999022, 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0002901, 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.199 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 132432 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168825+0000", 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168825+0000", 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168826+0000", 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1100000000000004e-07 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168896+0000", 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9381999999999994e-05 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168913+0000", 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7812000000000002e-05 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:39.168921+0000", 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4279999999999999e-06 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:14:39.202 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:39.204 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:39.209 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:39.203+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:39.310 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:39.305+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:39.357 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:39.357 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:39.357 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:39.358 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:39.358 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:39.377 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:39.405 INFO:tasks.radosbench.radosbench.0.smithi062.stdout: 59 16 132945 132929 140.799 130.188 0.00393067 0.0070978 2024-09-12T18:14:39.418 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:39.417+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:39.511 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:39.509+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:39.573 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 87.277619055000002, 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.574 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.575 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:39.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.578 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:39.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.580 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 86.473290753000001, 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:39.581 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:39.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.583 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:39.584 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177695080000007, 2024-09-12T18:14:39.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:39.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.589 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:39.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.593 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177601405000004, 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:39.597 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:39.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:39.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:39.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:39.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:39.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.603 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177532174999996, 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.604 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.606 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.607 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.608 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:39.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177441408999996, 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:39.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:39.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.615 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177380385999996, 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:39.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177321626999998, 2024-09-12T18:14:39.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:39.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:39.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:39.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.628 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.177258577000003, 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:39.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:39.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.634 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.176458202999996, 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:39.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:39.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.640 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.176320000999993, 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:39.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:39.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:39.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.176256750999997, 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.647 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:39.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.175856784000004, 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.653 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:39.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.175666289999995, 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:39.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:39.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.175579393000007, 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.665 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:39.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:39.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.175455771000003, 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:39.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:39.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:39.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 76.175064171000002, 2024-09-12T18:14:39.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:39.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.683 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.316501143, 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:39.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.308478766, 2024-09-12T18:14:39.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.692 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:39.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.697 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.29689348, 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:39.698 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:39.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:39.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:39.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:39.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:39.705 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:39.707 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:39.703+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:39.707 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:39.809 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:39.803+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:39.865 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:39.865 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133947 5.6 5:6d5d4cd0:::benchmark_data_smithi062_23645_object133946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.859994+0000", 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0052449489999999996, 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052704259999999999, 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133947 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.859994+0000", 2024-09-12T18:14:39.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.859994+0000", 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.859995+0000", 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4099999999999997e-07 2024-09-12T18:14:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860058+0000", 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3048999999999999e-05 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860069+0000", 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.116e-05 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860076+0000", 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7329999999999997e-06 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860112+0000", 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6402000000000001e-05 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860233+0000", 2024-09-12T18:14:39.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120637 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860417+0000", 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018431 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863060+0000", 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026428929999999999 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133948 5.e 5:75723e44:::benchmark_data_smithi062_23645_object133947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.860090+0000", 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0051491000000000002, 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052576009999999998, 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.872 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133948 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860090+0000", 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860090+0000", 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860090+0000", 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860125+0000", 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4962999999999997e-05 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860133+0000", 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4189999999999996e-06 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860137+0000", 2024-09-12T18:14:39.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9529999999999998e-06 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860182+0000", 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4965000000000001e-05 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860311+0000", 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128601 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864036+0000", 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037248110000000002 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133949 5.8 5:16704f08:::benchmark_data_smithi062_23645_object133948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.860553+0000", 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0046859830000000003, 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004857348, 2024-09-12T18:14:39.877 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133949 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860553+0000", 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860553+0000", 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860554+0000", 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9699999999999994e-07 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860613+0000", 2024-09-12T18:14:39.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9243999999999997e-05 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860622+0000", 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5550000000000008e-06 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860629+0000", 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5819999999999998e-06 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860683+0000", 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4196000000000001e-05 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.860825+0000", 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014135100000000001 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133953 5.3 5:cceef3f9:::benchmark_data_smithi062_23645_object133952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.862763+0000", 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024761050000000001, 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027052729999999998, 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.882 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133953 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862763+0000", 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862763+0000", 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862763+0000", 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862827+0000", 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4022000000000005e-05 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862843+0000", 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6263999999999999e-05 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862849+0000", 2024-09-12T18:14:39.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0640000000000001e-06 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862897+0000", 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8900000000000003e-05 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.862995+0000", 2024-09-12T18:14:39.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7473999999999995e-05 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863096+0000", 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100883 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.888 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133954 5.0 5:0181d55e:::benchmark_data_smithi062_23645_object133953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.888 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.863290+0000", 2024-09-12T18:14:39.888 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001948967, 2024-09-12T18:14:39.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022393420000000001, 2024-09-12T18:14:39.889 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.889 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.889 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:39.889 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.889 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.890 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.890 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133954 2024-09-12T18:14:39.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.890 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863290+0000", 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863290+0000", 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863291+0000", 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5499999999999996e-07 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863345+0000", 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4143e-05 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863359+0000", 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3708e-05 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863368+0000", 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0010000000000007e-06 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863422+0000", 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4057000000000001e-05 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863569+0000", 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000147369 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133955 5.5 5:aa363f5b:::benchmark_data_smithi062_23645_object133954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.863384+0000", 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0018545110000000001, 2024-09-12T18:14:39.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022005969999999999, 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133955 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863384+0000", 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863384+0000", 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863385+0000", 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863418+0000", 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3059999999999999e-05 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863427+0000", 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:14:39.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863434+0000", 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3539999999999996e-06 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863487+0000", 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3412000000000003e-05 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863567+0000", 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0275e-05 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863642+0000", 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4449000000000005e-05 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.899 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133957 5.a 5:5e8bb7c5:::benchmark_data_smithi062_23645_object133956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.863585+0000", 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0016533470000000001, 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020617999999999999, 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.900 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133957 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863585+0000", 2024-09-12T18:14:39.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863585+0000", 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863586+0000", 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0400000000000005e-07 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863665+0000", 2024-09-12T18:14:39.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8708999999999995e-05 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863675+0000", 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.046e-05 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863683+0000", 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2540000000000003e-06 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863734+0000", 2024-09-12T18:14:39.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1362000000000001e-05 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.863858+0000", 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012436399999999999 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.906 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:133956 5.7 e48/21 5:e367dba4:::benchmark_data_smithi062_23645_object133955:head v 48'8278, mlcod=48'8275)", 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.864676+0000", 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00056264499999999996, 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010298180000000001, 2024-09-12T18:14:39.907 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864676+0000", 2024-09-12T18:14:39.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864676+0000", 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864677+0000", 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864721+0000", 2024-09-12T18:14:39.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4681000000000001e-05 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864731+0000", 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864737+0000", 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9819999999999996e-06 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864806+0000", 2024-09-12T18:14:39.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9067999999999997e-05 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.864823+0000", 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7469000000000002e-05 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.913 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133958 5.0 5:01c9252e:::benchmark_data_smithi062_23645_object133957:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.865424+0000", 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.999815, 2024-09-12T18:14:39.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033941499999999997, 2024-09-12T18:14:39.915 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.915 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.915 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:39.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.916 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133958 2024-09-12T18:14:39.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.916 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865424+0000", 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865424+0000", 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865425+0000", 2024-09-12T18:14:39.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4200000000000004e-07 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865501+0000", 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6048000000000001e-05 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865510+0000", 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2189999999999993e-06 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865515+0000", 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1930000000000001e-06 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865699+0000", 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018357599999999999 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133959 5.3 5.a491be33 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.865683+0000", 2024-09-12T18:14:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9995556, 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135038, 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133959 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:39.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865683+0000", 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865683+0000", 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:39.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865684+0000", 2024-09-12T18:14:39.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:14:39.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:39.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865759+0000", 2024-09-12T18:14:39.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5030000000000005e-05 2024-09-12T18:14:39.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865767+0000", 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2220000000000002e-06 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.865773+0000", 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1659999999999999e-06 2024-09-12T18:14:39.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.925 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:39.925 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.925 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:39.925 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:39.925 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 10 2024-09-12T18:14:39.925 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:39.927 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:39.927 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:39.925+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.027 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:40.023+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:40.120 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:40.120 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:40.127 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:40.123+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:40.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:40.229 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:40.225+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.329 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:40.325+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.333 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:40.333 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:40.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:40.333 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 76.926505234999993, 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:40.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:40.340 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 76.926319340000006, 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:40.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:40.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:40.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 76.926207587999997, 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:40.347 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:40.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:40.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:40.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 76.926043766000006, 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:40.353 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:40.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:40.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 76.925983000000002, 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:40.357 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:40.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:40.361 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 55.085256096999998, 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:40.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.702774550000001, 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:40.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.816063497, 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:40.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.215681973000001, 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.378 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:40.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:40.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109252 5.a 5:5f8d3e25:::benchmark_data_smithi062_23645_object109251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:40.384 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.094520869, 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019636572000000001, 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109252 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.385 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237372+0000", 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1230000000000001e-06 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237434+0000", 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1991999999999999e-05 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237444+0000", 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237449+0000", 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237785+0000", 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033586800000000002 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237880+0000", 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5476999999999994e-05 2024-09-12T18:14:40.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237995+0000", 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114592 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.241563+0000", 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003567874 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256915+0000", 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015352648999999999 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256968+0000", 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2095000000000002e-05 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257007+0000", 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9836000000000003e-05 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.390 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.078556763, 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.391 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:40.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.077624251, 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.397 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:40.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.077523789000001, 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.403 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:40.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.067401729, 2024-09-12T18:14:40.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:40.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:40.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:40.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122316 5.5 5:ada84853:::benchmark_data_smithi062_23645_object122315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:40.415 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.9053931080000002, 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020857733999999999, 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122316 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1800000000000005e-07 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426617+0000", 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011740599999999999 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426633+0000", 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426656+0000", 2024-09-12T18:14:40.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3207e-05 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430618+0000", 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039619390000000003 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430743+0000", 2024-09-12T18:14:40.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124117 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430875+0000", 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013285900000000001 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.438203+0000", 2024-09-12T18:14:40.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073278010000000001 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447266+0000", 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090626140000000001 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447316+0000", 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9951000000000003e-05 2024-09-12T18:14:40.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447356+0000", 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0528999999999998e-05 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:125560 5.0 5:0778113e:::benchmark_data_smithi062_23645_object125559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:35.922093+0000", 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4097982460000003, 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018663478000000001, 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 125560 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.423 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922093+0000", 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922093+0000", 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922094+0000", 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.063e-06 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922166+0000", 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1130000000000005e-05 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922187+0000", 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1594999999999999e-05 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.922215+0000", 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8041000000000001e-05 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.930151+0000", 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079359719999999995 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.930248+0000", 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6422999999999995e-05 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.940664+0000", 2024-09-12T18:14:40.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010416448 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.940714+0000", 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0182999999999997e-05 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:35.940757+0000", 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2623000000000002e-05 2024-09-12T18:14:40.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131973 5.4 5:28405c94:::benchmark_data_smithi062_23645_object131972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.3743164720000001, 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021608138999999998, 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.429 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131973 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957576+0000", 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957615+0000", 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8659999999999999e-05 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957627+0000", 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.272e-05 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957634+0000", 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0790000000000003e-06 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963227+0000", 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055927169999999997 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963339+0000", 2024-09-12T18:14:40.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112178 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979102+0000", 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015763202 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979141+0000", 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8195999999999998e-05 2024-09-12T18:14:40.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979183+0000", 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2710000000000003e-05 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131974 5.4 5:2e0197ac:::benchmark_data_smithi062_23645_object131973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:40.435 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.374246984, 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021614395000000002, 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131974 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.436 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6100000000000001e-07 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957683+0000", 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8182999999999997e-05 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957691+0000", 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.464e-06 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957697+0000", 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8900000000000004e-06 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967085+0000", 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093878329999999999 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967218+0000", 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133399 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979188+0000", 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011970003999999999 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979211+0000", 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3234000000000002e-05 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979259+0000", 2024-09-12T18:14:40.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7926999999999997e-05 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133236 5.5 5:a7b48dca:::benchmark_data_smithi062_23645_object133235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.535809+0000", 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.79608222299999998, 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018915299, 2024-09-12T18:14:40.442 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133236 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535809+0000", 2024-09-12T18:14:40.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535809+0000", 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535810+0000", 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535876+0000", 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5897999999999998e-05 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535885+0000", 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0909999999999999e-06 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535892+0000", 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1799999999999999e-06 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.535946+0000", 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3053000000000002e-05 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.536032+0000", 2024-09-12T18:14:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6588999999999994e-05 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.536110+0000", 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7881999999999997e-05 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.539682+0000", 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035720019999999999 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.554671+0000", 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014988839 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.554702+0000", 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1656999999999999e-05 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.554725+0000", 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2257000000000001e-05 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:133762 5.4 5:2f7a0206:::benchmark_data_smithi062_23645_object133761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:39.769077+0000", 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.56281422699999994, 2024-09-12T18:14:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018861139999999998, 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 133762 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.769077+0000", 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.769077+0000", 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.769079+0000", 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2100000000000001e-06 2024-09-12T18:14:40.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.769191+0000", 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112607 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.769202+0000", 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0383e-05 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.769209+0000", 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.773591+0000", 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043825410000000002 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:40.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.773753+0000", 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162065 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.787861+0000", 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014107378 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.787894+0000", 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3720999999999998e-05 2024-09-12T18:14:40.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:39.787939+0000", 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4289999999999998e-05 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:40.455 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:40.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:40.457 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:40.453+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Total time run: 60.0066 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Total writes made: 135106 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Write size: 65536 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Object size: 65536 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Bandwidth (MB/sec): 140.72 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Stddev Bandwidth: 28.8655 2024-09-12T18:14:40.458 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Max bandwidth (MB/sec): 233.75 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Min bandwidth (MB/sec): 51.0625 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Average IOPS: 2251 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Stddev IOPS: 461.848 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Max IOPS: 3740 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Min IOPS: 817 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Average Latency(s): 0.00710184 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Stddev Latency(s): 0.0115271 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Max latency(s): 1.03706 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Min latency(s): 0.0015127 2024-09-12T18:14:40.459 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Cleaning up (deleting benchmark objects) 2024-09-12T18:14:40.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:40.558 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:40.557+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.601 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:40.612 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:40.612 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:40.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.612 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135600 5.1 5:8b8491d5:::benchmark_data_smithi062_23645_object491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.604402+0000", 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0078668379999999993, 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0078924760000000007, 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135600 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604402+0000", 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604402+0000", 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604403+0000", 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:14:40.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604406+0000", 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7129999999999999e-06 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604413+0000", 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5769999999999999e-06 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604418+0000", 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604455+0000", 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7539000000000001e-05 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604535+0000", 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0105000000000006e-05 2024-09-12T18:14:40.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604603+0000", 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7379000000000007e-05 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611157+0000", 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0065540709999999999 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135605 5.9 5:9869b0e7:::benchmark_data_smithi062_23645_object496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.604487+0000", 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0077814959999999997, 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007887135, 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.618 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135605 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604487+0000", 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604487+0000", 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604488+0000", 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0999999999999999e-07 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604489+0000", 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3710000000000001e-06 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604493+0000", 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1609999999999996e-06 2024-09-12T18:14:40.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604496+0000", 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.903e-06 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604534+0000", 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7481999999999998e-05 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604618+0000", 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4165999999999993e-05 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135606 5.f 5:f3fbebb0:::benchmark_data_smithi062_23645_object497:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.604503+0000", 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0077654400000000002, 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0079364459999999998, 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.622 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135606 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604503+0000", 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604503+0000", 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604504+0000", 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9599999999999999e-07 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604506+0000", 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.714e-06 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604512+0000", 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9900000000000002e-06 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.604517+0000", 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9930000000000003e-06 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.606647+0000", 2024-09-12T18:14:40.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021302180000000001 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.606720+0000", 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3514000000000001e-05 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135608 5.9 5:95170dec:::benchmark_data_smithi062_23645_object499:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.605870+0000", 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0063992390000000001, 2024-09-12T18:14:40.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0066327089999999997, 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135608 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.605870+0000", 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.605870+0000", 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.605871+0000", 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.04e-06 2024-09-12T18:14:40.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.605875+0000", 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4460000000000003e-06 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.605888+0000", 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3288999999999999e-05 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.629 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.605896+0000", 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4039999999999998e-06 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.606320+0000", 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00042401 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.606392+0000", 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2502000000000005e-05 2024-09-12T18:14:40.630 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135609 5.9 5:97d8a8d5:::benchmark_data_smithi062_23645_object500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.607011+0000", 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.005258347, 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005556376, 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.631 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135609 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607011+0000", 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607011+0000", 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607011+0000", 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7899999999999998e-07 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607014+0000", 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1860000000000001e-06 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607023+0000", 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2800000000000003e-06 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607030+0000", 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5630000000000003e-06 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609514+0000", 2024-09-12T18:14:40.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024838130000000001 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609583+0000", 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9128999999999995e-05 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135610 5.9 5:914724a7:::benchmark_data_smithi062_23645_object501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.607042+0000", 2024-09-12T18:14:40.635 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0052264360000000001, 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0055855799999999997, 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135610 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607042+0000", 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607042+0000", 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607043+0000", 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8099999999999998e-07 2024-09-12T18:14:40.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607045+0000", 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.04e-06 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607051+0000", 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7790000000000001e-06 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607056+0000", 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1019999999999996e-06 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611149+0000", 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040935650000000004 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611222+0000", 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2924999999999997e-05 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.639 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135613 5.d 5:bb4648c7:::benchmark_data_smithi062_23645_object504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.607164+0000", 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0051049829999999996, 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005526202, 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.640 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135613 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607164+0000", 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607164+0000", 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607165+0000", 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1100000000000004e-07 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607168+0000", 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1719999999999999e-06 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607178+0000", 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.499e-06 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607183+0000", 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4070000000000001e-06 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607219+0000", 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6114e-05 2024-09-12T18:14:40.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607298+0000", 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9265999999999996e-05 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:135611 5.c e48/21 5:339729b3:::benchmark_data_smithi062_23645_object502:head v 48'8382, mlcod=48'8380)", 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.607337+0000", 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049314370000000003, 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0054160110000000001, 2024-09-12T18:14:40.644 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607337+0000", 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607337+0000", 2024-09-12T18:14:40.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607338+0000", 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607343+0000", 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5600000000000004e-06 2024-09-12T18:14:40.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607351+0000", 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3380000000000005e-06 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607356+0000", 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0869999999999997e-06 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.647 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607402+0000", 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5623e-05 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607419+0000", 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7470999999999999e-05 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:135612 5.3 e48/21 5:c371abc5:::benchmark_data_smithi062_23645_object503:head v 48'8591, mlcod=48'8589)", 2024-09-12T18:14:40.648 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.607442+0000", 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0048267700000000002, 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053601860000000003, 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607442+0000", 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607442+0000", 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607443+0000", 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8200000000000001e-07 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607446+0000", 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.613e-06 2024-09-12T18:14:40.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607453+0000", 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1400000000000002e-06 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607458+0000", 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6190000000000002e-06 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607509+0000", 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1060000000000002e-05 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607529+0000", 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9746999999999999e-05 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.652 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135614 5.2 5:4f460ff5:::benchmark_data_smithi062_23645_object505:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.607693+0000", 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0045764120000000002, 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051386540000000003, 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135614 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.653 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607693+0000", 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607693+0000", 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607693+0000", 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2399999999999998e-07 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607696+0000", 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2100000000000002e-06 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607705+0000", 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6430000000000001e-06 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607711+0000", 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8710000000000002e-06 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607755+0000", 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4008999999999998e-05 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607879+0000", 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012429699999999999 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.607979+0000", 2024-09-12T18:14:40.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000100214 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612422+0000", 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0044428380000000002 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135616 5.d 5:b9175b1f:::benchmark_data_smithi062_23645_object507:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.609880+0000", 2024-09-12T18:14:40.657 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0023889739999999999, 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029885749999999998, 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135616 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609880+0000", 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609880+0000", 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609881+0000", 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609883+0000", 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8329999999999998e-06 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609891+0000", 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.391e-06 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609894+0000", 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7340000000000002e-06 2024-09-12T18:14:40.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.609935+0000", 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0944e-05 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.610011+0000", 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5569999999999996e-05 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:135619 5.c e48/21 5:37dbaee3:::benchmark_data_smithi062_23645_object510:head v 48'8383, mlcod=48'8380)", 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.611363+0000", 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00090604200000000002, 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0015355989999999999, 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611363+0000", 2024-09-12T18:14:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611363+0000", 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611364+0000", 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8199999999999999e-07 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611369+0000", 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1989999999999997e-06 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611380+0000", 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1497e-05 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611387+0000", 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3779999999999998e-06 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611432+0000", 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5154000000000002e-05 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.611443+0000", 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1276e-05 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.665 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135620 5.2 5:4676168f:::benchmark_data_smithi062_23645_object511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.612390+0000", 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9998784, 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00053720299999999999, 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135620 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612390+0000", 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612390+0000", 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612391+0000", 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:14:40.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612395+0000", 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.799e-06 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612405+0000", 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0112000000000001e-05 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612409+0000", 2024-09-12T18:14:40.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2880000000000003e-06 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612446+0000", 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7146e-05 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612552+0000", 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000105917 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:40.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612634+0000", 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1324999999999998e-05 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135623 5.f 5:f695cfc2:::benchmark_data_smithi062_23645_object514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.612686+0000", 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9995832, 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027591999999999997, 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.670 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135623 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612686+0000", 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612686+0000", 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612687+0000", 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612691+0000", 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0149999999999997e-06 2024-09-12T18:14:40.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612701+0000", 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0169e-05 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612708+0000", 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2490000000000004e-06 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:40.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612765+0000", 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6523000000000001e-05 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612902+0000", 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013744899999999999 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:135625 5.f 5.71642f6f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:40.612848+0000", 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9994211, 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014809099999999999, 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 135625 2024-09-12T18:14:40.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612848+0000", 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612848+0000", 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612849+0000", 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612852+0000", 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3220000000000001e-06 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612862+0000", 2024-09-12T18:14:40.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5990000000000008e-06 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:40.612868+0000", 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3890000000000002e-06 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 15 2024-09-12T18:14:40.678 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:40.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-09-12T18:14:40.680 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:40.681 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:40.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:40.682 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:40.677+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.682 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:40.682 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:40.682 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:40.780 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:40.775+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:40.871 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:40.871 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:40.881 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:40.877+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:40.891 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:40.982 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:40.979+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:14:41.083 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.079+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.085 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:41.085 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:41.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:41.184 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.179+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.244 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:14:41.245 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:41.245 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T18:14:41.245 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.480496 2024-09-12T18:14:41.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.4804962989816397 2024-09-12T18:14:41.259 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:41.259 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:41.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:41.285 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:41.281+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:41.386 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.383+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.465 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:41.465 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:41.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:41.489 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:41.485+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:41.590 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.587+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.672 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:41.673 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:41.690 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.687+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.694 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:41.790 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.787+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.850 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:41.850 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:41.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:41.890 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.887+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:41.991 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:41.987+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:42.021 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:42.021 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:42.042 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:14:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.2 primary-affinity to 0.480496 (8314892) 2024-09-12T18:14:42.092 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:42.087+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:42.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:42.233 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:42.231+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:42.294 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:42.291+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:42.304 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:42.304 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:42.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:42.396 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:42.393+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:42.473 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:42.473 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:42.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:42.496 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:42.493+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:42.597 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:42.595+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:42.599 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:42.599 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:42.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:42.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:42.698 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:42.695+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:42.744 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:42.744 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:42.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:42.806 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:42.805+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:42.824 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:42.847 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:42.847 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:42.869 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:42.869 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:42.870 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:42.870 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:42.876 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:42.877 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:42.877 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:42.877 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:42.877 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:42.891 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:42.935 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:42.933+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:43.001 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:42.997+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:43.061 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 90.765247385999999, 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.062 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:43.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.069 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.960919083999997, 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:43.070 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:43.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:43.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.665323411000003, 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.076 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:43.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:43.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.665229736000001, 2024-09-12T18:14:43.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:43.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:43.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.088 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.665160506000007, 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:43.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:43.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.094 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.665069740000007, 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:43.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:43.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.665008717000006, 2024-09-12T18:14:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:43.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:43.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.664949957999994, 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.109 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:43.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.115 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.664886908, 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:43.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.122 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.664086534000006, 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:43.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:43.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.663948332000004, 2024-09-12T18:14:43.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:43.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:43.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.135 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.663885081999993, 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.136 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:43.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:43.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.142 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.663485115, 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:43.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:43.149 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.150 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.150 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.663294621000006, 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:43.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:43.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.157 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.663207724000003, 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:43.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:43.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.164 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.663084101999999, 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.165 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:43.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 79.662692501999999, 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:43.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.176 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 15.804129474, 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:43.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:43.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:43.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:43.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.184 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 15.796107097, 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.185 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:43.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:43.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 15.784521810999999, 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:43.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:43.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:43.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:43.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:43.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:43.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:43.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:43.201 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:43.201 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:43.202 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:43.199+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:43.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:43.303 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:43.299+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:43.371 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:43.371 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139832 5.1 5:83c20e96:::benchmark_data_smithi062_23645_object4723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.367560+0000", 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031239530000000001, 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031445459999999998, 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.372 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139832 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367560+0000", 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367560+0000", 2024-09-12T18:14:43.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367560+0000", 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1600000000000002e-07 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367563+0000", 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6960000000000001e-06 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367570+0000", 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4100000000000002e-06 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367578+0000", 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2649999999999999e-06 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369220+0000", 2024-09-12T18:14:43.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016422120000000001 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369336+0000", 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011616399999999999 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369446+0000", 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011014 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.376 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139833 5.6 5:61690077:::benchmark_data_smithi062_23645_object4724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.369628+0000", 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0010561520000000001, 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011200509999999999, 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.377 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139833 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369628+0000", 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369628+0000", 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369629+0000", 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9999999999999996e-07 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369632+0000", 2024-09-12T18:14:43.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8089999999999999e-06 2024-09-12T18:14:43.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369642+0000", 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7310000000000005e-06 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369647+0000", 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1059999999999999e-06 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369694+0000", 2024-09-12T18:14:43.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6303e-05 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369823+0000", 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012987299999999999 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369933+0000", 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109763 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.382 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139834 5.a 5:5171e7c1:::benchmark_data_smithi062_23645_object4725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.369660+0000", 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001023883, 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011236219999999999, 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139834 2024-09-12T18:14:43.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369660+0000", 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369660+0000", 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369660+0000", 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3500000000000002e-07 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369662+0000", 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8059999999999999e-06 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369667+0000", 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7520000000000004e-06 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369670+0000", 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0939999999999999e-06 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369714+0000", 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4137000000000001e-05 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369845+0000", 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013083800000000001 2024-09-12T18:14:43.386 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139835 5.e 5:7f1bebfb:::benchmark_data_smithi062_23645_object4726:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.369678+0000", 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001006257, 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011377309999999999, 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139835 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369678+0000", 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369678+0000", 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369678+0000", 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.08e-07 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369680+0000", 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9889999999999999e-06 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369686+0000", 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2750000000000001e-06 2024-09-12T18:14:43.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369690+0000", 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7510000000000002e-06 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369724+0000", 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3640999999999999e-05 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.369844+0000", 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001198 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.392 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139814 5.1 5:8e8d3ac7:::benchmark_data_smithi062_23645_object4705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.358537+0000", 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.012147312, 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012313604000000001, 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139814 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.393 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.358537+0000", 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.358537+0000", 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.358537+0000", 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.358540+0000", 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4549999999999998e-06 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.358546+0000", 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1829999999999999e-06 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.358551+0000", 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9049999999999996e-06 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.361628+0000", 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030773369999999999 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.361739+0000", 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110684 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.361849+0000", 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011006 2024-09-12T18:14:43.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365646+0000", 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037973130000000001 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139818 5.b 5:d02b6f2b:::benchmark_data_smithi062_23645_object4709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.363329+0000", 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0073549089999999998, 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00755911, 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139818 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363329+0000", 2024-09-12T18:14:43.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363329+0000", 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363330+0000", 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3379999999999999e-06 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363335+0000", 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1170000000000003e-06 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363356+0000", 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0052999999999999e-05 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363365+0000", 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6579999999999997e-06 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363426+0000", 2024-09-12T18:14:43.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1277000000000003e-05 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363549+0000", 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012272300000000001 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139822 5.2 5:49555a44:::benchmark_data_smithi062_23645_object4713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.363494+0000", 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0071901819999999998, 2024-09-12T18:14:43.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074256779999999998, 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139822 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363494+0000", 2024-09-12T18:14:43.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363494+0000", 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363494+0000", 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363501+0000", 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1550000000000004e-06 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363509+0000", 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8699999999999992e-06 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363517+0000", 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1519999999999992e-06 2024-09-12T18:14:43.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365278+0000", 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017615619999999999 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365413+0000", 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134776 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365607+0000", 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000193599 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139824 5.5 5:a76716d6:::benchmark_data_smithi062_23645_object4715:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.363561+0000", 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0071227749999999996, 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074070550000000001, 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.409 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139824 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363561+0000", 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363561+0000", 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363562+0000", 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363564+0000", 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5600000000000001e-06 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363575+0000", 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0348e-05 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363580+0000", 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6380000000000001e-06 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363663+0000", 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2894999999999998e-05 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363793+0000", 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012977900000000001 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363904+0000", 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111387 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139826 5.e 5:7146d224:::benchmark_data_smithi062_23645_object4717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.363776+0000", 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0069081389999999998, 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072278860000000002, 2024-09-12T18:14:43.414 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139826 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363776+0000", 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363776+0000", 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363777+0000", 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.78e-07 2024-09-12T18:14:43.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363781+0000", 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0249999999999996e-06 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363789+0000", 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6440000000000006e-06 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363796+0000", 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1339999999999998e-06 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365645+0000", 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001848541 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365753+0000", 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107562 2024-09-12T18:14:43.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139827 5.a 5:59ea699f:::benchmark_data_smithi062_23645_object4718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.363828+0000", 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.006855669, 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072164539999999998, 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139827 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363828+0000", 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363828+0000", 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363829+0000", 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363835+0000", 2024-09-12T18:14:43.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8019999999999997e-06 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363844+0000", 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8449999999999992e-06 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.363849+0000", 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6010000000000002e-06 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365270+0000", 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014209159999999999 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.365482+0000", 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000212062 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139828 5.e 5:79ce1ed6:::benchmark_data_smithi062_23645_object4719:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.423 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.364878+0000", 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0058056180000000002, 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062116890000000003, 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139828 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.364878+0000", 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.364878+0000", 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.364879+0000", 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5000000000000001e-07 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.364883+0000", 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.878e-06 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.364894+0000", 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.111e-05 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.364900+0000", 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2609999999999999e-06 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367165+0000", 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002264028 2024-09-12T18:14:43.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367269+0000", 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104058 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139829 5.6 5:6a9858eb:::benchmark_data_smithi062_23645_object4720:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.366216+0000", 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0044674989999999998, 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049289909999999998, 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139829 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.366216+0000", 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.366216+0000", 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.366217+0000", 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.366222+0000", 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6700000000000002e-06 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.366235+0000", 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.306e-05 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.366242+0000", 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0929999999999997e-06 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367156+0000", 2024-09-12T18:14:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091423299999999997 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367269+0000", 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112027 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367385+0000", 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116611 2024-09-12T18:14:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139830 5.2 5:4e0b4416:::benchmark_data_smithi062_23645_object4721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.367494+0000", 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031902929999999999, 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037175369999999999, 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139830 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367494+0000", 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367494+0000", 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367494+0000", 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6199999999999996e-07 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367498+0000", 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9249999999999997e-06 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367512+0000", 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3674e-05 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367518+0000", 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.677e-06 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367570+0000", 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2080999999999998e-05 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367686+0000", 2024-09-12T18:14:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011596500000000001 2024-09-12T18:14:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367799+0000", 2024-09-12T18:14:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113492 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139831 5.1 5:8f060046:::benchmark_data_smithi062_23645_object4722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.367532+0000", 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031521779999999998, 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037514559999999998, 2024-09-12T18:14:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139831 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367532+0000", 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367532+0000", 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367532+0000", 2024-09-12T18:14:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367535+0000", 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7149999999999998e-06 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367542+0000", 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9430000000000003e-06 2024-09-12T18:14:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367545+0000", 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2830000000000002e-06 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367594+0000", 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8307999999999999e-05 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367667+0000", 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3641999999999997e-05 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.367729+0000", 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1851000000000001e-05 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2024-09-12T18:14:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:43.449 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:43.449 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:43.443+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:43.549 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:43.547+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:43.651 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:43.649+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:43.655 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:43.655 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:43.655 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:43.655 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:43.655 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:43.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:43.752 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:43.749+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:43.852 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:43.847+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 80.480045493999995, 2024-09-12T18:14:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:43.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 80.479859598999994, 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.896 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:43.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.902 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 80.479747846999999, 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:43.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 80.479584024999994, 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:43.908 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:43.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:43.912 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 80.479523259000004, 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:43.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.638796356, 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:43.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.256314809000003, 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:43.921 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:43.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:43.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.369603756, 2024-09-12T18:14:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:43.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:43.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.769222232000001, 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:43.932 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.938 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109252 5.a 5:5f8d3e25:::benchmark_data_smithi062_23645_object109251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.648061127999998, 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019636572000000001, 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109252 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237372+0000", 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1230000000000001e-06 2024-09-12T18:14:43.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237434+0000", 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1991999999999999e-05 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237444+0000", 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237449+0000", 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237785+0000", 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033586800000000002 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237880+0000", 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5476999999999994e-05 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237995+0000", 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114592 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.241563+0000", 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003567874 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256915+0000", 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015352648999999999 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256968+0000", 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2095000000000002e-05 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257007+0000", 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9836000000000003e-05 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.944 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.632097022, 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:43.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.631164510000001, 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:43.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:43.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.956 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.631064047999999, 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.957 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:43.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:43.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:43.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.620941987999998, 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:43.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:43.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122316 5.5 5:ada84853:::benchmark_data_smithi062_23645_object122315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.4589333670000002, 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020857733999999999, 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.969 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122316 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1800000000000005e-07 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426617+0000", 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011740599999999999 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426633+0000", 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426656+0000", 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3207e-05 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430618+0000", 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039619390000000003 2024-09-12T18:14:43.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430743+0000", 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124117 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430875+0000", 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013285900000000001 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.438203+0000", 2024-09-12T18:14:43.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073278010000000001 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447266+0000", 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090626140000000001 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447316+0000", 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9951000000000003e-05 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447356+0000", 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0528999999999998e-05 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131973 5.4 5:28405c94:::benchmark_data_smithi062_23645_object131972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9278567310000003, 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021608138999999998, 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.975 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131973 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957576+0000", 2024-09-12T18:14:43.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:14:43.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957615+0000", 2024-09-12T18:14:43.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8659999999999999e-05 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957627+0000", 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.272e-05 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957634+0000", 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0790000000000003e-06 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963227+0000", 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055927169999999997 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963339+0000", 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112178 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979102+0000", 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015763202 2024-09-12T18:14:43.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979141+0000", 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8195999999999998e-05 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979183+0000", 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2710000000000003e-05 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131974 5.4 5:2e0197ac:::benchmark_data_smithi062_23645_object131973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.927787243, 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021614395000000002, 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.983 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131974 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:43.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6100000000000001e-07 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957683+0000", 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8182999999999997e-05 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957691+0000", 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.464e-06 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957697+0000", 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8900000000000004e-06 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967085+0000", 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093878329999999999 2024-09-12T18:14:43.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967218+0000", 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133399 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979188+0000", 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011970003999999999 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979211+0000", 2024-09-12T18:14:43.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3234000000000002e-05 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979259+0000", 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7926999999999997e-05 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139381 5.a 5:5feeed27:::benchmark_data_smithi062_23645_object4272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:43.988 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.75590949900000004, 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026944724999999999, 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139381 2024-09-12T18:14:43.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129525+0000", 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3599999999999999e-06 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129535+0000", 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0137e-05 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129558+0000", 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3510999999999999e-05 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129575+0000", 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6711e-05 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143187+0000", 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013611760000000001 2024-09-12T18:14:43.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143429+0000", 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024201999999999999 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156164+0000", 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012735020999999999 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:43.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156288+0000", 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012365799999999999 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156467+0000", 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017954700000000001 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139389 5.c 5:3039b67b:::benchmark_data_smithi062_23645_object4280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:43.994 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.75182993200000003, 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02037106, 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139389 2024-09-12T18:14:43.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133604+0000", 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029999999999999e-06 2024-09-12T18:14:43.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133612+0000", 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0600000000000008e-06 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133633+0000", 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0803000000000001e-05 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133648+0000", 2024-09-12T18:14:43.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5792999999999999e-05 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.142999+0000", 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093507350000000006 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143345+0000", 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034556000000000002 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:43.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143676+0000", 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033105400000000001 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.149483+0000", 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058074820000000001 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153750+0000", 2024-09-12T18:14:44.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042669250000000004 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153871+0000", 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012050899999999999 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153973+0000", 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102336 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139393 5.1 5:818bd9ed:::benchmark_data_smithi062_23645_object4284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.139590+0000", 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.74584164200000003, 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019970254, 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139393 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139590+0000", 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139590+0000", 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139592+0000", 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3459999999999999e-06 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139598+0000", 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.737e-06 2024-09-12T18:14:44.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139620+0000", 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1430999999999999e-05 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139635+0000", 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5637e-05 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139751+0000", 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115714 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139970+0000", 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021837899999999999 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.140136+0000", 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166384 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.149082+0000", 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0089462789999999997 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.159352+0000", 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010269868 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.159472+0000", 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119991 2024-09-12T18:14:44.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.159561+0000", 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8487999999999997e-05 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.008 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:44.010 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:44.005+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:44.010 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:44.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:14:44.111 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:44.107+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:44.163 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:44.163 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:44.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.163 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:141670 5.9 5:9d762b29:::benchmark_data_smithi062_23645_object6561:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.163 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.160473+0000", 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0029742509999999998, 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029975729999999999, 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 141670 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160473+0000", 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160473+0000", 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160473+0000", 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8199999999999998e-07 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160477+0000", 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3359999999999999e-06 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160486+0000", 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9979999999999992e-06 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160491+0000", 2024-09-12T18:14:44.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2410000000000003e-06 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160557+0000", 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6310999999999996e-05 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160712+0000", 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015457900000000001 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.167 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:141675 5.d 5:b5476550:::benchmark_data_smithi062_23645_object6566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.160508+0000", 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00293852, 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030342350000000001, 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.168 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.169 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 141675 2024-09-12T18:14:44.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.169 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160508+0000", 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160508+0000", 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160509+0000", 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9500000000000003e-07 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160511+0000", 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4490000000000002e-06 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160520+0000", 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1460000000000002e-06 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160524+0000", 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3409999999999999e-06 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160559+0000", 2024-09-12T18:14:44.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5750999999999997e-05 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160674+0000", 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000114912 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:141678 5.9 5:9da411b3:::benchmark_data_smithi062_23645_object6569:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.160611+0000", 2024-09-12T18:14:44.173 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0028353789999999999, 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002989795, 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 141678 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160611+0000", 2024-09-12T18:14:44.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160611+0000", 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160612+0000", 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160619+0000", 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9800000000000001e-06 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160635+0000", 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5608e-05 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.160641+0000", 2024-09-12T18:14:44.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4099999999999996e-06 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162952+0000", 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002310585 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.163057+0000", 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000105012 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:141680 5.7 5:ee7ac3ee:::benchmark_data_smithi062_23645_object6571:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.162465+0000", 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00098220300000000007, 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001192317, 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:44.178 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 141680 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162465+0000", 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162465+0000", 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162465+0000", 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.54e-07 2024-09-12T18:14:44.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162469+0000", 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3799999999999998e-06 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162476+0000", 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162481+0000", 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8439999999999997e-06 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162521+0000", 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0051e-05 2024-09-12T18:14:44.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162596+0000", 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:44.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162666+0000", 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0073000000000005e-05 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:141681 5.f 5:f1de6cdf:::benchmark_data_smithi062_23645_object6572:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.162662+0000", 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00078450999999999998, 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001057374, 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.184 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 141681 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162662+0000", 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162662+0000", 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162663+0000", 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162665+0000", 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4779999999999998e-06 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162673+0000", 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7680000000000008e-06 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162677+0000", 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7629999999999998e-06 2024-09-12T18:14:44.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162717+0000", 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0685000000000001e-05 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162803+0000", 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5384999999999996e-05 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:141682 5.d 5:bd625199:::benchmark_data_smithi062_23645_object6573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.162824+0000", 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00062249699999999996, 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00094992899999999996, 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.189 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 141682 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162824+0000", 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162824+0000", 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162825+0000", 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.09e-07 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162829+0000", 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8199999999999998e-06 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162838+0000", 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7919999999999998e-06 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162844+0000", 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5139999999999998e-06 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.162902+0000", 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8202999999999998e-05 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.163023+0000", 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120816 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:141659 5.1 e50/49 5:8d7fd5e0:::benchmark_data_smithi062_23645_object6550:head v 50'8827, mlcod=50'8823)", 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:44.157770+0000", 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0056767440000000001, 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060591719999999998, 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157770+0000", 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157770+0000", 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157771+0000", 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1699999999999998e-07 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157780+0000", 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9879999999999993e-06 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157788+0000", 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9419999999999995e-06 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157793+0000", 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8629999999999996e-06 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157843+0000", 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9496999999999997e-05 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:44.157860+0000", 2024-09-12T18:14:44.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6861999999999999e-05 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:14:44.198 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:44.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:44.211 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:44.207+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:44.313 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:44.309+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:44.347 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:44.347 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:44.347 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:44.347 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:44.347 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:44.366 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:44.454 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:44.453+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:44.514 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:44.513+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:44.556 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:44.556 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:44.556 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:44.556 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 92.261510442000002, 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:44.557 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.558 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.559 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.560 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.561 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:44.562 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:44.563 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 91.45718214, 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.564 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.565 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.566 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.567 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.568 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.569 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:44.570 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.571 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161586467000006, 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.572 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.573 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.574 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:44.575 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.576 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.577 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161492792000004, 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.578 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:44.579 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.580 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:44.581 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.582 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:44.583 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161423561999996, 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.584 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.585 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:44.586 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:44.587 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161332795999996, 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:44.589 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.590 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.592 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.593 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.594 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.595 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161271772999996, 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.596 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.597 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.597 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:44.597 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.597 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.597 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.597 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:44.598 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:44.599 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.600 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.601 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:44.602 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161213013999998, 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.603 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.605 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:44.606 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:44.606 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.609 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:44.610 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.611 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.161149964000003, 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.612 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.613 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.614 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:44.615 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.616 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.617 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.160349589999996, 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.618 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.619 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.620 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.621 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:44.622 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.160211387999993, 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:44.623 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.624 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:44.625 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.626 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.627 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.628 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.160148137999997, 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.629 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.630 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:44.631 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.632 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:44.633 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.634 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.159748171000004, 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.635 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.636 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:44.637 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:44.638 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.639 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.640 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.159557676999995, 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.641 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:44.642 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.643 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:44.644 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.645 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:44.646 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.159470780000007, 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.647 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:44.648 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.649 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.650 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:44.651 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.652 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.159347158000003, 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.653 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.654 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:44.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:44.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 81.158955558000002, 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:44.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.660 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:44.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.30039253, 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.663 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:44.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:44.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.669 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.292370153, 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:44.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:44.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.280784867000001, 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.676 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:44.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:44.681 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:44.682 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:44.683 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:44.681+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:44.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:44.783 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:44.781+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:44.840 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143443 5.5 5:a255f2d0:::benchmark_data_smithi062_23645_object8334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.838980+0000", 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0015859789999999999, 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016080689999999999, 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.841 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143443 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838980+0000", 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838980+0000", 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838980+0000", 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3300000000000002e-07 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838983+0000", 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5210000000000001e-06 2024-09-12T18:14:44.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838990+0000", 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0319999999999998e-06 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838995+0000", 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3399999999999997e-06 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839113+0000", 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117312 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839225+0000", 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111903 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839326+0000", 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101356 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.845 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143444 5.e 5:77115511:::benchmark_data_smithi062_23645_object8335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.839010+0000", 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0015561380000000001, 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001655393, 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143444 2024-09-12T18:14:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839010+0000", 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839010+0000", 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839010+0000", 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839013+0000", 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.345e-06 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839020+0000", 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2239999999999998e-06 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839026+0000", 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8549999999999998e-06 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839116+0000", 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0580000000000004e-05 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839183+0000", 2024-09-12T18:14:44.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6342999999999998e-05 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143428 5.c 5:3fafe7e1:::benchmark_data_smithi062_23645_object8319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.830209+0000", 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010357226000000001, 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010511347000000001, 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:44.850 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143428 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.830209+0000", 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.830209+0000", 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.830209+0000", 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6399999999999998e-07 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.830211+0000", 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.984e-06 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.830217+0000", 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1840000000000004e-06 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.830222+0000", 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9080000000000003e-06 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.834340+0000", 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041177030000000003 2024-09-12T18:14:44.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.834456+0000", 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116407 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.834558+0000", 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101283 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838951+0000", 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043932989999999998 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143438 5.8 5:1016a4d6:::benchmark_data_smithi062_23645_object8329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.836269+0000", 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.004297192, 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044911049999999996, 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.855 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143438 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836269+0000", 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836269+0000", 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836270+0000", 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4300000000000002e-07 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836273+0000", 2024-09-12T18:14:44.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.506e-06 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836283+0000", 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.04e-05 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836290+0000", 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836340+0000", 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0525000000000002e-05 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836475+0000", 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013507100000000001 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.859 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143439 5.2 5:481d0860:::benchmark_data_smithi062_23645_object8330:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.836315+0000", 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0042512729999999999, 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044772659999999997, 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143439 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.860 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836315+0000", 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836315+0000", 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836315+0000", 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9599999999999999e-07 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836318+0000", 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8700000000000001e-06 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836328+0000", 2024-09-12T18:14:44.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0349999999999999e-05 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836334+0000", 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7039999999999999e-06 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836372+0000", 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8274e-05 2024-09-12T18:14:44.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836504+0000", 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131261 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836604+0000", 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010074200000000001 2024-09-12T18:14:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839037+0000", 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002432301 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.865 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:143437 5.7 e50/21 5:e8c30148:::benchmark_data_smithi062_23645_object8328:head v 50'8836, mlcod=50'8834)", 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.836916+0000", 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0036494399999999999, 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003919695, 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836916+0000", 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836916+0000", 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836917+0000", 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8100000000000002e-07 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836922+0000", 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.899e-06 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836931+0000", 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7180000000000002e-06 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836936+0000", 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7080000000000002e-06 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836992+0000", 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5716e-05 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.837013+0000", 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0526999999999998e-05 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143440 5.0 5:04be0772:::benchmark_data_smithi062_23645_object8331:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.870 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.836940+0000", 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0036256460000000002, 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003940018, 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143440 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836940+0000", 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836940+0000", 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836941+0000", 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836945+0000", 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8190000000000002e-06 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836955+0000", 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.628e-06 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836961+0000", 2024-09-12T18:14:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6510000000000004e-06 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.837036+0000", 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4376999999999996e-05 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.837156+0000", 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120791 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.874 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143441 5.4 5:2e66348a:::benchmark_data_smithi062_23645_object8332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.836978+0000", 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035881870000000001, 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003943368, 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.875 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143441 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836978+0000", 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836978+0000", 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836978+0000", 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5700000000000002e-07 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836981+0000", 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2900000000000001e-06 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836988+0000", 2024-09-12T18:14:44.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9770000000000003e-06 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.836993+0000", 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5169999999999999e-06 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838984+0000", 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001990819 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.839072+0000", 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8480000000000007e-05 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:143442 5.c 5:365b4952:::benchmark_data_smithi062_23645_object8333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:44.838930+0000", 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001635606, 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002031419, 2024-09-12T18:14:44.879 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 143442 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:44.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838930+0000", 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838930+0000", 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838931+0000", 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0079999999999999e-06 2024-09-12T18:14:44.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838939+0000", 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7659999999999998e-06 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838958+0000", 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9170000000000001e-05 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.838966+0000", 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3069999999999997e-06 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.840673+0000", 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017075759999999999 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.840741+0000", 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7624000000000002e-05 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:44.840803+0000", 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2069999999999994e-05 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.884 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:44.885 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:44.885 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 9 2024-09-12T18:14:44.885 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:44.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:44.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:44.888 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:44.883+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:44.987 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:44.983+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:45.028 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:45.047 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:45.065 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:45.065 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:45.067 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:45.068 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:45.085 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:45.085 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:45.088 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:45.085+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:45.091 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:14:45.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:45.190 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:45.185+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:45.290 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:45.287+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:45.299 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:45.299 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:45.321 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:45.392 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:45.386+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:45.473 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:45.474 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:45.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:45.493 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:45.490+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:45.594 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:45.589+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:45.644 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:45.644 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:45.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:45.706 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:45.705+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:45.796 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:45.790+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:45.853 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:45.853 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:45.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:45.897 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:45.893+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:45.998 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:45.994+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:46.026 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:46.026 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:46.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:46.099 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:46.097+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:46.200 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:46.194+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:46.240 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:46.240 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:46.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:46.301 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:46.298+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:46.402 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:46.401+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:46.453 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:46.453 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:46.473 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:46.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-09-12T18:14:46.518 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:46.517+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:46.604 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:46.598+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:46.625 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:46.625 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:46.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:46.734 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:46.733+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:46.807 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:46.802+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:46.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:47.014 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.010+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:47.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:47.092 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:14:47.093 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:47.093 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.46693269097286116 2024-09-12T18:14:47.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.46693269097286116 2024-09-12T18:14:47.115 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.110+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:47.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:14:47.165 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:47.165 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:47.186 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:47.216 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:47.213+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:47.235 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:47.236 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:47.256 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:47.260 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:47.260 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:47.316 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:47.313+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149607 5.0 5:05929df2:::benchmark_data_smithi062_23645_object14498:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.334917+0000", 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0065882730000000004, 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066064690000000002, 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149607 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334917+0000", 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334917+0000", 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334918+0000", 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.006e-06 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334922+0000", 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2799999999999997e-06 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334931+0000", 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6049999999999998e-06 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334942+0000", 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0941000000000001e-05 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335839+0000", 2024-09-12T18:14:47.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00089743600000000005 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335974+0000", 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013519500000000001 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:149604 5.7 e51/21 5:edbeb39c:::benchmark_data_smithi062_23645_object14495:head v 51'9209, mlcod=51'9206)", 2024-09-12T18:14:47.346 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.334929+0000", 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0065759149999999999, 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066340000000000001, 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334929+0000", 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334929+0000", 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334930+0000", 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3200000000000001e-07 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334933+0000", 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9190000000000001e-06 2024-09-12T18:14:47.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334939+0000", 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1479999999999997e-06 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.334942+0000", 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8120000000000001e-06 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335828+0000", 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088524000000000003 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335845+0000", 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7696000000000001e-05 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149610 5.b 5:d3d3daf4:::benchmark_data_smithi062_23645_object14501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.350 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.335993+0000", 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0055118349999999997, 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055997349999999998, 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149610 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335993+0000", 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335993+0000", 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335994+0000", 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1100000000000002e-07 2024-09-12T18:14:47.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335995+0000", 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3769999999999999e-06 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.335999+0000", 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7189999999999999e-06 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336003+0000", 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7850000000000002e-06 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336039+0000", 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6140000000000003e-05 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337712+0000", 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016736100000000001 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149611 5.5 5:a72bb466:::benchmark_data_smithi062_23645_object14502:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.336036+0000", 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0054692960000000002, 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055884150000000002, 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.355 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149611 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336036+0000", 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336036+0000", 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336037+0000", 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.13e-07 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336039+0000", 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5890000000000001e-06 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336049+0000", 2024-09-12T18:14:47.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5810000000000003e-06 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336054+0000", 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4709999999999998e-06 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336096+0000", 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1839999999999999e-05 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336159+0000", 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2972000000000006e-05 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.336217+0000", 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8071e-05 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340860+0000", 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046431229999999999 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.359 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149612 5.3 5:c392dc74:::benchmark_data_smithi062_23645_object14503:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.337924+0000", 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035816369999999999, 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037387359999999999, 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:47.360 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149612 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337924+0000", 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337924+0000", 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337925+0000", 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.04e-06 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337929+0000", 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0380000000000001e-06 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337940+0000", 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.337955+0000", 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5128e-05 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338028+0000", 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3326999999999998e-05 2024-09-12T18:14:47.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338145+0000", 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116771 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338257+0000", 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112024 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.364 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149616 5.8 5:13780072:::benchmark_data_smithi062_23645_object14507:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.338015+0000", 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0034903730000000002, 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003680942, 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.365 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149616 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338015+0000", 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338015+0000", 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338015+0000", 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1399999999999997e-07 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338018+0000", 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2749999999999998e-06 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338026+0000", 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8599999999999999e-06 2024-09-12T18:14:47.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338031+0000", 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4209999999999997e-06 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338075+0000", 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4002999999999999e-05 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338189+0000", 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114542 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149617 5.5 5:a8073bb9:::benchmark_data_smithi062_23645_object14508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.338042+0000", 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0034630939999999999, 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036839659999999999, 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149617 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338042+0000", 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338042+0000", 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338043+0000", 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4999999999999998e-07 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338044+0000", 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7549999999999999e-06 2024-09-12T18:14:47.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338050+0000", 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2780000000000001e-06 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338054+0000", 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9509999999999999e-06 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338096+0000", 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2233e-05 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338198+0000", 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010182400000000001 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338294+0000", 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6494000000000001e-05 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340970+0000", 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026757030000000002 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:149614 5.7 e51/21 5:e7a86895:::benchmark_data_smithi062_23645_object14505:head v 51'9210, mlcod=51'9207)", 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.338243+0000", 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0032627160000000001, 2024-09-12T18:14:47.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035207939999999998, 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338243+0000", 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338243+0000", 2024-09-12T18:14:47.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338243+0000", 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338249+0000", 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6110000000000001e-06 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338259+0000", 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227999999999999e-05 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338270+0000", 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1209999999999999e-05 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338312+0000", 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1866999999999997e-05 2024-09-12T18:14:47.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.338328+0000", 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6225000000000001e-05 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149619 5.b 5:da4fd69c:::benchmark_data_smithi062_23645_object14510:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.340480+0000", 2024-09-12T18:14:47.378 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001024868, 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013103139999999999, 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149619 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340480+0000", 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340480+0000", 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340481+0000", 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:14:47.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340484+0000", 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.236e-06 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340494+0000", 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2199999999999998e-06 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340499+0000", 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9599999999999997e-06 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340546+0000", 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6214000000000002e-05 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340663+0000", 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117013 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.382 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149620 5.4 5:21442aa9:::benchmark_data_smithi062_23645_object14511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.340512+0000", 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00099361000000000002, 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001309199, 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.383 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149620 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340512+0000", 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340512+0000", 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340512+0000", 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.51e-07 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340514+0000", 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1169999999999998e-06 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340520+0000", 2024-09-12T18:14:47.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0050000000000001e-06 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340524+0000", 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.126e-06 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340565+0000", 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1071e-05 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340636+0000", 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1031999999999993e-05 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:149621 5.7 e51/21 5:edd7c9da:::benchmark_data_smithi062_23645_object14512:head v 51'9211, mlcod=51'9207)", 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.340773+0000", 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00073181600000000004, 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00107715, 2024-09-12T18:14:47.387 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340773+0000", 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340773+0000", 2024-09-12T18:14:47.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340774+0000", 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8100000000000003e-07 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340779+0000", 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0479999999999998e-06 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340793+0000", 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.416e-05 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340799+0000", 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2929999999999997e-06 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340847+0000", 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7542e-05 2024-09-12T18:14:47.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.340863+0000", 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6286e-05 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:149623 5.2 5:4f5e39e6:::benchmark_data_smithi062_23645_object14514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:47.341204+0000", 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000301055, 2024-09-12T18:14:47.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067463099999999997, 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 149623 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341204+0000", 2024-09-12T18:14:47.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341204+0000", 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341205+0000", 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4600000000000004e-07 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341208+0000", 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8059999999999999e-06 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341216+0000", 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3480000000000004e-06 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341221+0000", 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.464e-06 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341259+0000", 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8871000000000001e-05 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341331+0000", 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1109e-05 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:47.341386+0000", 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:14:47.395 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.396 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.396 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.396 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.396 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:47.396 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2024-09-12T18:14:47.396 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:47.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:47.442 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.438+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:47.518 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.514+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:47.551 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:47.551 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:47.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:47.653 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.650+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:47.720 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.714+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:47.765 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 84.358869893999994, 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 84.358683998999993, 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 84.358572246999998, 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 84.358408424999993, 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 84.358347659000003, 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:15918 5.b e25/21 5:ded0cd06:::benchmark_data_smithi062_23645_object15917:head v 25'984, mlcod=25'981)", 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.517620755999999, 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019854395, 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246636+0000", 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246721+0000", 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4930000000000002e-05 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246732+0000", 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1012999999999999e-05 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.246739+0000", 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1019999999999999e-06 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259060+0000", 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012320714 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.259080+0000", 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9431000000000001e-05 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266441+0000", 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073609069999999999 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.266490+0000", 2024-09-12T18:14:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9450000000000003e-05 2024-09-12T18:14:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:16955 5.5 5:ae32ce51:::benchmark_data_smithi062_23645_object16954:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.135139209000002, 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019326137, 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 16955 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629117+0000", 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629118+0000", 2024-09-12T18:14:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629182+0000", 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3860000000000002e-05 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629194+0000", 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1691999999999999e-05 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629199+0000", 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6509999999999998e-06 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629252+0000", 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2219999999999998e-05 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629348+0000", 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6620999999999995e-05 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.629431+0000", 2024-09-12T18:14:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2947000000000004e-05 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.631093+0000", 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001661764 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648256+0000", 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017163253 2024-09-12T18:14:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648309+0000", 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.253e-05 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:45.648443+0000", 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013456899999999999 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.248428155999999, 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.648046632, 2024-09-12T18:14:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109252 5.a 5:5f8d3e25:::benchmark_data_smithi062_23645_object109251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.526885528000001, 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019636572000000001, 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109252 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237371+0000", 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237372+0000", 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1230000000000001e-06 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237434+0000", 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1991999999999999e-05 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237444+0000", 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237449+0000", 2024-09-12T18:14:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237785+0000", 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033586800000000002 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237880+0000", 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5476999999999994e-05 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.237995+0000", 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114592 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.241563+0000", 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003567874 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256915+0000", 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015352648999999999 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.256968+0000", 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2095000000000002e-05 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257007+0000", 2024-09-12T18:14:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9836000000000003e-05 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.510921421999999, 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.509988910000001, 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.509888448000002, 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.499766388000001, 2024-09-12T18:14:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122316 5.5 5:ada84853:::benchmark_data_smithi062_23645_object122315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.337757766999999, 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020857733999999999, 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122316 2024-09-12T18:14:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1800000000000005e-07 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426617+0000", 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011740599999999999 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426633+0000", 2024-09-12T18:14:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426656+0000", 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3207e-05 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430618+0000", 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039619390000000003 2024-09-12T18:14:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430743+0000", 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124117 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430875+0000", 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013285900000000001 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.438203+0000", 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073278010000000001 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447266+0000", 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090626140000000001 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447316+0000", 2024-09-12T18:14:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9951000000000003e-05 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447356+0000", 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0528999999999998e-05 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131973 5.4 5:28405c94:::benchmark_data_smithi062_23645_object131972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.8066811309999995, 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021608138999999998, 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131973 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957576+0000", 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957615+0000", 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8659999999999999e-05 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957627+0000", 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.272e-05 2024-09-12T18:14:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957634+0000", 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0790000000000003e-06 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963227+0000", 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055927169999999997 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963339+0000", 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112178 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979102+0000", 2024-09-12T18:14:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015763202 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979141+0000", 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8195999999999998e-05 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979183+0000", 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2710000000000003e-05 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131974 5.4 5:2e0197ac:::benchmark_data_smithi062_23645_object131973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.8066116430000001, 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021614395000000002, 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131974 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6100000000000001e-07 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957683+0000", 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8182999999999997e-05 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957691+0000", 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.464e-06 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957697+0000", 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8900000000000004e-06 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967085+0000", 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093878329999999999 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967218+0000", 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133399 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979188+0000", 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011970003999999999 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979211+0000", 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3234000000000002e-05 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979259+0000", 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7926999999999997e-05 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139381 5.a 5:5feeed27:::benchmark_data_smithi062_23645_object4272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.6347338990000004, 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026944724999999999, 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139381 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129525+0000", 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3599999999999999e-06 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129535+0000", 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0137e-05 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129558+0000", 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3510999999999999e-05 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129575+0000", 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6711e-05 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143187+0000", 2024-09-12T18:14:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013611760000000001 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143429+0000", 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024201999999999999 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156164+0000", 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012735020999999999 2024-09-12T18:14:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156288+0000", 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012365799999999999 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156467+0000", 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017954700000000001 2024-09-12T18:14:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139389 5.c 5:3039b67b:::benchmark_data_smithi062_23645_object4280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.6306543319999998, 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02037106, 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139389 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133604+0000", 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029999999999999e-06 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133612+0000", 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0600000000000008e-06 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133633+0000", 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0803000000000001e-05 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133648+0000", 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5792999999999999e-05 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.142999+0000", 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093507350000000006 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143345+0000", 2024-09-12T18:14:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034556000000000002 2024-09-12T18:14:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143676+0000", 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033105400000000001 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.149483+0000", 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058074820000000001 2024-09-12T18:14:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153750+0000", 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042669250000000004 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153871+0000", 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012050899999999999 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153973+0000", 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102336 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139393 5.1 5:818bd9ed:::benchmark_data_smithi062_23645_object4284:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.139590+0000", 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.6246660420000003, 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019970254, 2024-09-12T18:14:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139393 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139590+0000", 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139590+0000", 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139592+0000", 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3459999999999999e-06 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139598+0000", 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.737e-06 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139620+0000", 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1430999999999999e-05 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139635+0000", 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5637e-05 2024-09-12T18:14:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139751+0000", 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115714 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.139970+0000", 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021837899999999999 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.140136+0000", 2024-09-12T18:14:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166384 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.149082+0000", 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0089462789999999997 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.159352+0000", 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010269868 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.159472+0000", 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119991 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.159561+0000", 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8487999999999997e-05 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:47.912 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:47.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:47.914 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:47.910+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:48.014 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:48.010+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151404 5.f 5:f4ea777a:::benchmark_data_smithi062_23645_object16295:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.060455+0000", 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0061754799999999997, 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0061934210000000002, 2024-09-12T18:14:48.066 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151404 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060455+0000", 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060455+0000", 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060456+0000", 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060460+0000", 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0960000000000003e-06 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060470+0000", 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.961e-06 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060475+0000", 2024-09-12T18:14:48.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3090000000000003e-06 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060532+0000", 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7512000000000001e-05 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060672+0000", 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000139302 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151406 5.f 5:f34f40a0:::benchmark_data_smithi062_23645_object16297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.060489+0000", 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0061406990000000003, 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0061991440000000002, 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151406 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060489+0000", 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060489+0000", 2024-09-12T18:14:48.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060490+0000", 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000002e-07 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060492+0000", 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8109999999999999e-06 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060497+0000", 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1510000000000003e-06 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060500+0000", 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.959e-06 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.062953+0000", 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024530820000000001 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063087+0000", 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013456699999999999 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151403 5.c e51/21 5:37b63b60:::benchmark_data_smithi062_23645_object16294:head v 51'9356, mlcod=51'9354)", 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.060663+0000", 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0059675329999999997, 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060587230000000002, 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060663+0000", 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060663+0000", 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060663+0000", 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3200000000000001e-07 2024-09-12T18:14:48.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060668+0000", 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5690000000000004e-06 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060675+0000", 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1580000000000002e-06 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060678+0000", 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8210000000000003e-06 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060723+0000", 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4138000000000003e-05 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060741+0000", 2024-09-12T18:14:48.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8173999999999999e-05 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151407 5.1 e51/49 5:8a576af9:::benchmark_data_smithi062_23645_object16298:head v 51'9445, mlcod=51'9443)", 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.060767+0000", 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0058630219999999999, 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0059824869999999999, 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.080 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060767+0000", 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060767+0000", 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060772+0000", 2024-09-12T18:14:48.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.809e-06 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060776+0000", 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.929e-06 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060781+0000", 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3519999999999997e-06 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060785+0000", 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8089999999999999e-06 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060820+0000", 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4638000000000003e-05 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060833+0000", 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.384e-05 2024-09-12T18:14:48.083 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151405 5.5 e51/21 5:acc53743:::benchmark_data_smithi062_23645_object16296:head v 51'9613, mlcod=51'9610)", 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.060804+0000", 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0058257919999999998, 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0059734480000000001, 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060804+0000", 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060804+0000", 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060805+0000", 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.96e-07 2024-09-12T18:14:48.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060812+0000", 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9750000000000001e-06 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060818+0000", 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8179999999999998e-06 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060822+0000", 2024-09-12T18:14:48.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0949999999999998e-06 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060859+0000", 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6192000000000002e-05 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.060875+0000", 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6243999999999999e-05 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.087 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151409 5.f 5:f90716ba:::benchmark_data_smithi062_23645_object16300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.061363+0000", 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0052668130000000004, 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0054424909999999998, 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.088 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151409 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061363+0000", 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061363+0000", 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061364+0000", 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1200000000000001e-07 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061370+0000", 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9569999999999999e-06 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061380+0000", 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0288e-05 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061386+0000", 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9200000000000001e-06 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065342+0000", 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0039558140000000002 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065488+0000", 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014536099999999999 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151412 5.9 5:94156628:::benchmark_data_smithi062_23645_object16303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.092 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.061396+0000", 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0052337420000000004, 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0054408429999999999, 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151412 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061396+0000", 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061396+0000", 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061397+0000", 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0200000000000002e-07 2024-09-12T18:14:48.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061399+0000", 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3860000000000001e-06 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061411+0000", 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1406000000000001e-05 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061420+0000", 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5719999999999992e-06 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061485+0000", 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5159000000000004e-05 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061566+0000", 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0354999999999999e-05 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.096 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151410 5.6 e51/21 5:6f0d41a0:::benchmark_data_smithi062_23645_object16301:head v 51'9443, mlcod=51'9441)", 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.061702+0000", 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049282680000000004, 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051672899999999997, 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061702+0000", 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061702+0000", 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061703+0000", 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061709+0000", 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0390000000000001e-06 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061718+0000", 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6679999999999996e-06 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061725+0000", 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4509999999999997e-06 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061778+0000", 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2998999999999999e-05 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.061795+0000", 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7416999999999999e-05 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151414 5.2 e51/49 5:465b7b72:::benchmark_data_smithi062_23645_object16305:head v 51'9473, mlcod=51'9471)", 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.063323+0000", 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0033071979999999999, 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035731859999999999, 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063323+0000", 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063323+0000", 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063324+0000", 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2300000000000001e-07 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063328+0000", 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7249999999999997e-06 2024-09-12T18:14:48.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063337+0000", 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1099999999999992e-06 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063342+0000", 2024-09-12T18:14:48.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9609999999999996e-06 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063394+0000", 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1481999999999999e-05 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063416+0000", 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2461000000000001e-05 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151415 5.1 e51/49 5:80a02d10:::benchmark_data_smithi062_23645_object16306:head v 51'9446, mlcod=51'9443)", 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.063467+0000", 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0031634290000000002, 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003456055, 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063467+0000", 2024-09-12T18:14:48.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063467+0000", 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063467+0000", 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0699999999999998e-07 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063470+0000", 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2990000000000001e-06 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063476+0000", 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.288e-06 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063479+0000", 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7019999999999999e-06 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063515+0000", 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5277999999999997e-05 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.063528+0000", 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2882e-05 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151416 5.6 e51/21 5:6f4cb1fe:::benchmark_data_smithi062_23645_object16307:head v 51'9444, mlcod=51'9441)", 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.064049+0000", 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0025808879999999999, 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029003219999999999, 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064049+0000", 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064049+0000", 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064050+0000", 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1500000000000004e-07 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064055+0000", 2024-09-12T18:14:48.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9420000000000003e-06 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064065+0000", 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0495e-05 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064071+0000", 2024-09-12T18:14:48.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0290000000000002e-06 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064132+0000", 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0520999999999999e-05 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.064150+0000", 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8360999999999999e-05 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151418 5.7 5:eea4ff97:::benchmark_data_smithi062_23645_object16309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.065498+0000", 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0011316220000000001, 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0014786059999999999, 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.113 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151418 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065498+0000", 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065498+0000", 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065500+0000", 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2920000000000001e-06 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065505+0000", 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2079999999999999e-06 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065515+0000", 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0125e-05 2024-09-12T18:14:48.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065523+0000", 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8539999999999997e-06 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065601+0000", 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7622999999999999e-05 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065700+0000", 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9512000000000005e-05 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065771+0000", 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1222000000000004e-05 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:151417 5.1 e51/49 5:8592929b:::benchmark_data_smithi062_23645_object16308:head v 51'9447, mlcod=51'9443)", 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:48.065803+0000", 2024-09-12T18:14:48.117 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00082715800000000004, 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0012067989999999999, 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065803+0000", 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065803+0000", 2024-09-12T18:14:48.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065803+0000", 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065808+0000", 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6870000000000002e-06 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065816+0000", 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2700000000000004e-06 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065822+0000", 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9089999999999997e-06 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065867+0000", 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4209000000000003e-05 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:48.065893+0000", 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6611e-05 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 13 2024-09-12T18:14:48.121 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:48.122 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:14:48.123 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.2 to 0.466933 (7788) 2024-09-12T18:14:48.124 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:48.124 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:48.121+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:48.224 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:48.222+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:48.282 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:48.283 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:48.283 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:48.283 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:48.283 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:48.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:48.342 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:48.341+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:48.424 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 96.127718212000005, 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:48.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:48.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:48.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 95.323389910000003, 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:48.432 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:48.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:48.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:48.438 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027794236999995, 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:48.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027700562000007, 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.444 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:48.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:48.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:48.449 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027631331999999, 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:48.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027540565999999, 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:48.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:48.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:48.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027479542999998, 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:48.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:48.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027420784, 2024-09-12T18:14:48.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:48.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.027357734000006, 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:48.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.026557359999998, 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:48.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:48.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:48.484 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.026419157999996, 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.026355907999999, 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.490 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:48.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.025955941000007, 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:48.496 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:48.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:48.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.025765446999998, 2024-09-12T18:14:48.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:48.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:48.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.025678549999995, 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:48.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:48.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.025554928000005, 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:48.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:48.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 85.025163328000005, 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:48.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:48.523 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.166600299999999, 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.524 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:48.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.158577922999999, 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.530 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:48.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:48.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.146992637, 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:48.536 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:48.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:48.540 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:48.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:48.542 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:48.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:48.544 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:48.542+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:48.644 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:48.638+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:48.669 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151590 5.3 5.e2f4cef3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.154633+0000", 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.51356852600000003, 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.513610342, 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151590 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154633+0000", 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154633+0000", 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154633+0000", 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7899999999999999e-07 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154636+0000", 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.83e-06 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154643+0000", 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3100000000000003e-06 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154650+0000", 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0740000000000004e-06 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154689+0000", 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9004999999999997e-05 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.154697+0000", 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7069999999999992e-06 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151536 5.6 5:65183903:::benchmark_data_smithi062_23645_object16427:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.107830+0000", 2024-09-12T18:14:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.56037089900000003, 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.56052559000000002, 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151536 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107830+0000", 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107830+0000", 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107831+0000", 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107834+0000", 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107842+0000", 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1540000000000002e-06 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107848+0000", 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1600000000000003e-06 2024-09-12T18:14:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.107895+0000", 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6900000000000002e-05 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.108003+0000", 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010746700000000001 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.108104+0000", 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010121899999999999 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.114520+0000", 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006416255 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122839+0000", 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083189500000000003 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122848+0000", 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9069999999999996e-06 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.53197315899999997, 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.53224910700000005, 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:14:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:14:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.53186124400000001, 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.53222569399999997, 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:14:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151542 5.3 5:c1d566a8:::benchmark_data_smithi062_23645_object16433:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.110889+0000", 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.55731166099999996, 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.55776878900000004, 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151542 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110889+0000", 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110889+0000", 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110890+0000", 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1800000000000005e-07 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110893+0000", 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8700000000000001e-06 2024-09-12T18:14:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110901+0000", 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4239999999999993e-06 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110907+0000", 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.276e-06 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110952+0000", 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5667000000000002e-05 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.111056+0000", 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010334 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.111159+0000", 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010323 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122760+0000", 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011600941 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122768+0000", 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1410000000000005e-06 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.50303499600000001, 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.503602149, 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:14:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.55194794800000002, 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.55260235300000005, 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151571 5.6 5.583c8d36 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.139867+0000", 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.528333885, 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.52907836200000002, 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151571 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139867+0000", 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139867+0000", 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139868+0000", 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0699999999999997e-07 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139871+0000", 2024-09-12T18:14:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0790000000000001e-06 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139879+0000", 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8739999999999995e-06 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139885+0000", 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.852e-06 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139937+0000", 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2567e-05 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.139945+0000", 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151604 5.c 5.aed97e8c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.173074+0000", 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.49512694600000001, 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.495957855, 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151604 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173074+0000", 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173074+0000", 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173075+0000", 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8999999999999997e-07 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173077+0000", 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5790000000000002e-06 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173085+0000", 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9910000000000002e-06 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173092+0000", 2024-09-12T18:14:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3049999999999998e-06 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173145+0000", 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3374000000000001e-05 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.173153+0000", 2024-09-12T18:14:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8849999999999999e-06 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.525972298, 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.52688895199999997, 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:14:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151575 5.c 5.4174100c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143465+0000", 2024-09-12T18:14:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.524736341, 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.52573897999999997, 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151575 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143465+0000", 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143465+0000", 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143465+0000", 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6400000000000002e-07 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143469+0000", 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6109999999999998e-06 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143478+0000", 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2380000000000003e-06 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143484+0000", 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0050000000000001e-06 2024-09-12T18:14:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143527+0000", 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3096000000000002e-05 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143532+0000", 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0780000000000003e-06 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.52436269700000004, 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.52545107800000002, 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:14:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.53854684100000005, 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.53972125299999996, 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151582 5.6 5.19c67016 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.147246+0000", 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.520954943, 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.52221513100000005, 2024-09-12T18:14:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151582 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147246+0000", 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147246+0000", 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147247+0000", 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8800000000000002e-07 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147251+0000", 2024-09-12T18:14:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7400000000000002e-06 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147267+0000", 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5826000000000001e-05 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147274+0000", 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.52e-06 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147320+0000", 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5503000000000001e-05 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.147328+0000", 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6649999999999992e-06 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151585 5.c 5.d022ce9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.149605+0000", 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.51859571100000001, 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.51994817699999996, 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151585 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149605+0000", 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149605+0000", 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149606+0000", 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5199999999999995e-07 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149610+0000", 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8e-06 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149621+0000", 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1141999999999999e-05 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149626+0000", 2024-09-12T18:14:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2580000000000003e-06 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149669+0000", 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2728000000000002e-05 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.149675+0000", 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2190000000000001e-06 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151560 5.6 5.5c7a5376 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.133740+0000", 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.53446149399999998, 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.53590049200000001, 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151560 2024-09-12T18:14:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133740+0000", 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133740+0000", 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133740+0000", 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133743+0000", 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.976e-06 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133763+0000", 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0234999999999999e-05 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133770+0000", 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.46e-06 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133819+0000", 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9085999999999997e-05 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.133828+0000", 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4769999999999992e-06 2024-09-12T18:14:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 16 2024-09-12T18:14:48.742 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:48.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:48.785 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:48.782+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:48.846 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:48.845+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:48.906 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:48.907 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:48.919 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:48.947 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:48.945+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:49.036 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 85.628493696999996, 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:34 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 85.628307801999995, 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022830383999999999, 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405572+0000", 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405574+0000", 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.46e-06 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405582+0000", 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8900000000000007e-06 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405600+0000", 2024-09-12T18:14:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7895999999999999e-05 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405613+0000", 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3344e-05 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410900+0000", 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052872520000000001 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411185+0000", 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028520500000000002 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411477+0000", 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029200800000000001 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422468+0000", 2024-09-12T18:14:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010990721 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428194+0000", 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057256729999999997 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428305+0000", 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111709 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.428403+0000", 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7225999999999994e-05 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 85.62819605, 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 85.628032227999995, 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 85.627971462000005, 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:105829 5.b e41/21 5:d2d4650a:::benchmark_data_smithi062_23645_object105828:head v 41'6481, mlcod=41'6477)", 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.518051959000001, 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020109558999999999, 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515828+0000", 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.515829+0000", 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516001+0000", 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172182 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516011+0000", 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5230000000000001e-06 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.516016+0000", 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7629999999999997e-06 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517372+0000", 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013553479999999999 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.517391+0000", 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9131999999999999e-05 2024-09-12T18:14:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535901+0000", 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018509833999999999 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:25.535938+0000", 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7147999999999997e-05 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:107031 5.5 5:a1737a1b:::benchmark_data_smithi062_23645_object107030:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.917670435000002, 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023040486999999998, 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 107031 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116210+0000", 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116211+0000", 2024-09-12T18:14:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2500000000000001e-06 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116290+0000", 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8731000000000002e-05 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116300+0000", 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.116307+0000", 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6270000000000002e-06 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.119904+0000", 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035973730000000001 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120026+0000", 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012207900000000001 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.120132+0000", 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010599699999999999 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.129480+0000", 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093481099999999998 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139200+0000", 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097194399999999993 2024-09-12T18:14:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139228+0000", 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8164999999999999e-05 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:26.139250+0000", 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175e-05 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.780545225000001, 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.779612712999999, 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.779512251, 2024-09-12T18:14:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.769390190999999, 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:122316 5.5 5:ada84853:::benchmark_data_smithi062_23645_object122315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.607381569999999, 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020857733999999999, 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 122316 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426499+0000", 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1800000000000005e-07 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426617+0000", 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011740599999999999 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426633+0000", 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6492999999999999e-05 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.426656+0000", 2024-09-12T18:14:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3207e-05 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430618+0000", 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039619390000000003 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430743+0000", 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124117 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.430875+0000", 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013285900000000001 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.438203+0000", 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073278010000000001 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447266+0000", 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090626140000000001 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447316+0000", 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9951000000000003e-05 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:34.447356+0000", 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0528999999999998e-05 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131973 5.4 5:28405c94:::benchmark_data_smithi062_23645_object131972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.076304933999999, 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021608138999999998, 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131973 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957575+0000", 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957576+0000", 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7700000000000004e-07 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957615+0000", 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8659999999999999e-05 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957627+0000", 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.272e-05 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957634+0000", 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0790000000000003e-06 2024-09-12T18:14:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963227+0000", 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055927169999999997 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.963339+0000", 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112178 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979102+0000", 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015763202 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979141+0000", 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8195999999999998e-05 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979183+0000", 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2710000000000003e-05 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:131974 5.4 5:2e0197ac:::benchmark_data_smithi062_23645_object131973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.076235446, 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021614395000000002, 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 131974 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957645+0000", 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6100000000000001e-07 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957683+0000", 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8182999999999997e-05 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957691+0000", 2024-09-12T18:14:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.464e-06 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.957697+0000", 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8900000000000004e-06 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967085+0000", 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093878329999999999 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.967218+0000", 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133399 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979188+0000", 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011970003999999999 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979211+0000", 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3234000000000002e-05 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:38.979259+0000", 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7926999999999997e-05 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139381 5.a 5:5feeed27:::benchmark_data_smithi062_23645_object4272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.9043577020000004, 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026944724999999999, 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139381 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129525+0000", 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3599999999999999e-06 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129535+0000", 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0137e-05 2024-09-12T18:14:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129558+0000", 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3510999999999999e-05 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129575+0000", 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6711e-05 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143187+0000", 2024-09-12T18:14:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013611760000000001 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143429+0000", 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024201999999999999 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156164+0000", 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012735020999999999 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156288+0000", 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012365799999999999 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156467+0000", 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017954700000000001 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139389 5.c 5:3039b67b:::benchmark_data_smithi062_23645_object4280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.9002781349999998, 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02037106, 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139389 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133602+0000", 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133604+0000", 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029999999999999e-06 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133612+0000", 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0600000000000008e-06 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133633+0000", 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0803000000000001e-05 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.133648+0000", 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5792999999999999e-05 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.142999+0000", 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093507350000000006 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143345+0000", 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034556000000000002 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143676+0000", 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033105400000000001 2024-09-12T18:14:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.149483+0000", 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058074820000000001 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153750+0000", 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042669250000000004 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153871+0000", 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012050899999999999 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.153973+0000", 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102336 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151532 5.2 5:411033fd:::benchmark_data_smithi062_23645_object16423:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.106642+0000", 2024-09-12T18:14:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.927237957, 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022524840000000001, 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151532 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106642+0000", 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106642+0000", 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106643+0000", 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4700000000000002e-07 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106645+0000", 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1730000000000002e-06 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106652+0000", 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2099999999999996e-06 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106658+0000", 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8370000000000002e-06 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106737+0000", 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9571000000000001e-05 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106843+0000", 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010581699999999999 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.106938+0000", 2024-09-12T18:14:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5101999999999998e-05 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116288+0000", 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093494349999999997 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129075+0000", 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012787178999999999 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129126+0000", 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1409000000000002e-05 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129167+0000", 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.066e-05 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151540 5.2 5:43abef27:::benchmark_data_smithi062_23645_object16431:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.110266+0000", 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.92361440900000003, 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020774079000000001, 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151540 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110266+0000", 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110266+0000", 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110267+0000", 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1699999999999997e-07 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110271+0000", 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9099999999999998e-06 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110281+0000", 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0617e-05 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110289+0000", 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5900000000000002e-06 2024-09-12T18:14:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110338+0000", 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8962999999999999e-05 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110456+0000", 2024-09-12T18:14:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118554 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.110549+0000", 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2383e-05 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129207+0000", 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018657950999999999 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.130966+0000", 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001759666 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.131014+0000", 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7531000000000003e-05 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.131040+0000", 2024-09-12T18:14:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5996999999999999e-05 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151543 5.2 5:49aa80a6:::benchmark_data_smithi062_23645_object16434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.921576387, 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023818700000000002, 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151543 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112305+0000", 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6300000000000004e-07 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112309+0000", 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1370000000000004e-06 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112319+0000", 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0128e-05 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112326+0000", 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1740000000000003e-06 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.117629+0000", 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053025889999999999 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.117739+0000", 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110183 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.118975+0000", 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012366020000000001 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.131047+0000", 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012071414000000001 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136016+0000", 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049688600000000003 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136084+0000", 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8147999999999999e-05 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136122+0000", 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8602000000000001e-05 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151544 5.2 5:4af2649e:::benchmark_data_smithi062_23645_object16435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.92154354999999999, 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023899725, 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151544 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0699999999999998e-07 2024-09-12T18:14:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112338+0000", 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.562e-06 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112342+0000", 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9509999999999999e-06 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112347+0000", 2024-09-12T18:14:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6229999999999996e-06 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.121877+0000", 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095294690000000005 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122010+0000", 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013326000000000001 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122637+0000", 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00062677100000000003 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.132506+0000", 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098691019999999994 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136160+0000", 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036541680000000002 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136203+0000", 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3251999999999999e-05 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136236+0000", 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3259999999999997e-05 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:49.154 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:49.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:49.156 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:49.153+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:49.257 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:49.254+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:49.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:49.287 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:49.287 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:49.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.147917+0000", 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.13983715099999999, 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.13988336700000001, 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.288 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151538 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147917+0000", 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147917+0000", 2024-09-12T18:14:49.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147920+0000", 2024-09-12T18:14:49.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4279999999999999e-06 2024-09-12T18:14:49.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147927+0000", 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7829999999999999e-06 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147945+0000", 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7876999999999998e-05 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147960+0000", 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.436e-05 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148069+0000", 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108931 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148095+0000", 2024-09-12T18:14:49.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6420000000000001e-05 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.147986+0000", 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.13976860599999999, 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.13993623399999999, 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.294 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151554 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147986+0000", 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147986+0000", 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147986+0000", 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147990+0000", 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.546e-06 2024-09-12T18:14:49.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.147999+0000", 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4800000000000007e-06 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148006+0000", 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148127+0000", 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012129399999999999 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148139+0000", 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1846e-05 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.148022+0000", 2024-09-12T18:14:49.298 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.13973271200000001, 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.139990266, 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151562 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148022+0000", 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148022+0000", 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148023+0000", 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7400000000000002e-07 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148028+0000", 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.366e-06 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148042+0000", 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4516e-05 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148049+0000", 2024-09-12T18:14:49.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3319999999999997e-06 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148199+0000", 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014975500000000001 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148219+0000", 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0897e-05 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.148113+0000", 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.139641188, 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.139990481, 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151564 2024-09-12T18:14:49.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148113+0000", 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148113+0000", 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148114+0000", 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148119+0000", 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6720000000000003e-06 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148134+0000", 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5217e-05 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148144+0000", 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0171e-05 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148227+0000", 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2270999999999999e-05 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148243+0000", 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6816999999999998e-05 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.148167+0000", 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.13958725699999999, 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.14002344899999999, 2024-09-12T18:14:49.307 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151574 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148167+0000", 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148167+0000", 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148168+0000", 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6899999999999996e-07 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148173+0000", 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5310000000000003e-06 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148188+0000", 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5045000000000001e-05 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148200+0000", 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2731999999999999e-05 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148272+0000", 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1773000000000006e-05 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148282+0000", 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7599999999999997e-06 2024-09-12T18:14:49.311 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.148221+0000", 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.13953391500000001, 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.140055609, 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.312 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151577 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148221+0000", 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148221+0000", 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148221+0000", 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6300000000000004e-07 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148226+0000", 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3939999999999998e-06 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148240+0000", 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4477e-05 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148252+0000", 2024-09-12T18:14:49.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1674e-05 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148337+0000", 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5007999999999997e-05 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148351+0000", 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4477e-05 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.316 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:49.148274+0000", 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.13948087000000001, 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.140088299, 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for peered", 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:49.317 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 151599 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148274+0000", 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148274+0000", 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148274+0000", 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1200000000000001e-07 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148280+0000", 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1340000000000003e-06 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148294+0000", 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4608e-05 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148307+0000", 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2292e-05 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148370+0000", 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3483000000000002e-05 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:49.148379+0000", 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4290000000000007e-06 2024-09-12T18:14:49.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.321 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:49.321 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.321 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:49.321 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:49.321 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:14:49.321 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:49.322 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:49.366 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:49.365+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:49.404 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:49.423 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:49.423 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:49.440 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:49.440 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:49.440 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:49.440 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:49.440 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:49.443 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:49.443 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:49.447 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:49.447 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:49.454 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:49.499 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:49.497+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:49.561 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:49.557+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:49.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:49.681 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:49.678+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:49.763 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:49.758+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:49.767 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:49.767 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:49.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:49.864 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:49.865+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:49.946 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:49.946 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:49.959 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:49.964 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:49.965+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:50.066 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:50.061+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:50.082 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:50.082 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:50.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:50.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:14:50.166 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:50.162+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:50.242 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:50.242 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:50.257 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:50.302 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:50.301+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:50.368 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:50.362+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:50.413 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:50.413 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:50.433 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:50.474 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:50.473+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:50.570 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:50.566+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:50.628 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:50.628 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:50.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:50.693 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:50.690+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:50.731 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:14:50.771 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:50.766+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:50.820 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:50.821 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:50.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:50.872 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:50.869+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:50.973 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:50.969+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:51.061 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:51.061 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:51.074 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.070+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:51.174 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:51.173+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:51.275 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.270+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.280 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:51.280 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:51.301 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:51.376 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.370+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:51.457 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:51.457 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:51.477 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:51.478 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.474+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.578 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.574+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.591 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:51.610 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:51.610 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:51.627 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:51.627 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:51.630 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:51.630 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:51.630 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:51.630 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:51.630 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:51.631 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:51.631 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:51.653 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:51.679 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.674+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.780 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.774+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.805 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:51.805 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 99.510582830000004, 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.806 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:51.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:51.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:51.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.706254528000002, 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.813 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:51.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410658854999994, 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:51.819 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:51.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410565180000006, 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:51.825 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:51.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410495949999998, 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.831 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:51.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:51.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:51.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.838 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410405183999998, 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:51.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410344160999998, 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:51.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:51.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410285402, 2024-09-12T18:14:51.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:51.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.856 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.410222352000005, 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:51.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:51.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.409421977999997, 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:51.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:51.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.409283775999995, 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:51.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:51.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:51.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.409220525999999, 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:51.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.408820559000006, 2024-09-12T18:14:51.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:51.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:51.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.408630064999997, 2024-09-12T18:14:51.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:51.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:51.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.408543167999994, 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:51.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:51.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:51.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:51.902 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.408419546000005, 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:51.903 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 88.408027946000004, 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.909 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:51.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.913 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 24.549464917999998, 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.914 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:51.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.920 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 24.541442540999999, 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:51.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:51.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:51.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:51.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 24.529857255, 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:51.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:51.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:51.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:51.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:51.935 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:51.937 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:51.930+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:51.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:52.038 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:52.034+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "pg_backfill(progress 5.9 e 56/56 lb 5:90a37125:::benchmark_data_smithi062_23645_object42885:head)", 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.089038+0000", 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0081017859999999997, 2024-09-12T18:14:52.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081200149999999995, 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089038+0000", 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089038+0000", 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089038+0000", 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8599999999999999e-07 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089045+0000", 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.289e-06 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089053+0000", 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2949999999999996e-06 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089058+0000", 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.558e-06 2024-09-12T18:14:52.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155972 5.1 5:8cb2aa2d:::benchmark_data_smithi062_23645_object20863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.089122+0000", 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0080171219999999998, 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080882509999999994, 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155972 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089122+0000", 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089122+0000", 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089123+0000", 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.133e-06 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089131+0000", 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.306e-06 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089143+0000", 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2575000000000001e-05 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.089151+0000", 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0949999999999996e-06 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092096+0000", 2024-09-12T18:14:52.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029445399999999998 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092224+0000", 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127658 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092331+0000", 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010729 2024-09-12T18:14:52.107 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:155974 5.9 e56/53 5:96cef1db:::benchmark_data_smithi062_23645_object20865:head v 56'9731, mlcod=56'9728)", 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.092378+0000", 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047616689999999996, 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049034949999999999, 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.108 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092378+0000", 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092378+0000", 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092378+0000", 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092382+0000", 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4479999999999999e-06 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092391+0000", 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0070000000000003e-06 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092396+0000", 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0529999999999997e-06 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.095451+0000", 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030548210000000001 2024-09-12T18:14:52.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.095468+0000", 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7618e-05 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155976 5.3 5:cb4c8bd5:::benchmark_data_smithi062_23645_object20867:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.112 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.092662+0000", 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0044778429999999996, 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046763589999999997, 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155976 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092662+0000", 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092662+0000", 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092662+0000", 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092666+0000", 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1949999999999999e-06 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092672+0000", 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5599999999999999e-06 2024-09-12T18:14:52.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092676+0000", 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1400000000000002e-06 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092716+0000", 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9842999999999998e-05 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092830+0000", 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114129 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092945+0000", 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114578 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.095569+0000", 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026244179999999999 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155958 5.1 5:848c96ef:::benchmark_data_smithi062_23645_object20849:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.085404+0000", 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.011735171000000001, 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012008674, 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.118 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155958 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.085404+0000", 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.085404+0000", 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.085405+0000", 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3600000000000003e-07 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.085408+0000", 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9399999999999998e-06 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.085414+0000", 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1149999999999999e-06 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.085418+0000", 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9949999999999999e-06 2024-09-12T18:14:52.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.086919+0000", 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015007950000000001 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.087008+0000", 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8929000000000002e-05 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.087065+0000", 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7559000000000002e-05 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.091762+0000", 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046962710000000001 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097387+0000", 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005625957 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155980 5.c 5:3cf4ec99:::benchmark_data_smithi062_23645_object20871:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.092742+0000", 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0043970770000000001, 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047520189999999997, 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155980 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092742+0000", 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092742+0000", 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092743+0000", 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9500000000000003e-07 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092746+0000", 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.757e-06 2024-09-12T18:14:52.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092753+0000", 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.956e-06 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092758+0000", 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1749999999999996e-06 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092835+0000", 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7016999999999998e-05 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.092950+0000", 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011517 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093060+0000", 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010956299999999999 2024-09-12T18:14:52.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.095742+0000", 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026826710000000002 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155982 5.1 5.735a5e41 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.093049+0000", 2024-09-12T18:14:52.129 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.004090303, 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045100670000000004, 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155982 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093049+0000", 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093049+0000", 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093050+0000", 2024-09-12T18:14:52.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.54e-07 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093053+0000", 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5370000000000002e-06 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093062+0000", 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1620000000000008e-06 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.093069+0000", 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2309999999999999e-06 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:155979 5.9 e56/53 5:99cbc6db:::benchmark_data_smithi062_23645_object20870:head v 56'9732, mlcod=56'9729)", 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.094724+0000", 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024155959999999999, 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00288083, 2024-09-12T18:14:52.133 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.094724+0000", 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.094724+0000", 2024-09-12T18:14:52.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.094724+0000", 2024-09-12T18:14:52.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8500000000000001e-07 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.094729+0000", 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2130000000000002e-06 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.094737+0000", 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1079999999999993e-06 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.094742+0000", 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000003e-06 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096491+0000", 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001748601 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096510+0000", 2024-09-12T18:14:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8672e-05 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:155984 5.f e56/53 5:f1f65ca1:::benchmark_data_smithi062_23645_object20875:head v 56'9824, mlcod=56'9820)", 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.096110+0000", 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00102987, 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001542159, 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096110+0000", 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096110+0000", 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096110+0000", 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096115+0000", 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5430000000000004e-06 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096124+0000", 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8370000000000003e-06 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096130+0000", 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.913e-06 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096172+0000", 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2478000000000002e-05 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.096183+0000", 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0668e-05 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155990 5.3 5:c7091630:::benchmark_data_smithi062_23645_object20881:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.097015+0000", 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00012462399999999999, 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068293900000000003, 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.142 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155990 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097015+0000", 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097015+0000", 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097016+0000", 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3340000000000001e-06 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097021+0000", 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3029999999999999e-06 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097040+0000", 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8233e-05 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097047+0000", 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.25e-06 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097113+0000", 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5998000000000001e-05 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097237+0000", 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012433400000000001 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097406+0000", 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016845599999999999 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.147 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:155989 5.9 e56/53 5:97b4265b:::benchmark_data_smithi062_23645_object20880:head v 56'9733, mlcod=56'9729)", 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.097200+0000", 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999394, 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055313699999999999, 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:52.148 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097200+0000", 2024-09-12T18:14:52.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097200+0000", 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097201+0000", 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6899999999999997e-07 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097206+0000", 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8890000000000001e-06 2024-09-12T18:14:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097225+0000", 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8938999999999999e-05 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097231+0000", 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9429999999999997e-06 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097406+0000", 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017544300000000001 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097427+0000", 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1250000000000002e-05 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:155992 5.e 5.f1659eae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.097739+0000", 2024-09-12T18:14:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9994006, 2024-09-12T18:14:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9203999999999998e-05, 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 155992 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097739+0000", 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097739+0000", 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097740+0000", 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097743+0000", 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0070000000000002e-06 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097751+0000", 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2460000000000003e-06 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097755+0000", 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4510000000000002e-06 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.097795+0000", 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9271999999999999e-05 2024-09-12T18:14:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 12 2024-09-12T18:14:52.160 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:52.163 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:52.163 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:52.158+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:52.264 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:52.261+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:52.321 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:52.321 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:52.321 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:52.321 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:52.321 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:52.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:52.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-09-12T18:14:52.387 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:52.382+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:52.465 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:52.461+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:52.509 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:52.509 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:52.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:52.509 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:52.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.509 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 89.102291020999999, 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:52.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:52.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:52.515 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 89.101993374000003, 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 89.101829551999998, 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 89.101768785999994, 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.254342549, 2024-09-12T18:14:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.253410036999998, 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.253309574999999, 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 25.243187514999999, 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139381 5.a 5:5feeed27:::benchmark_data_smithi062_23645_object4272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.3781550259999999, 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026944724999999999, 2024-09-12T18:14:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139381 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129525+0000", 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3599999999999999e-06 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129535+0000", 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0137e-05 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129558+0000", 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3510999999999999e-05 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129575+0000", 2024-09-12T18:14:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6711e-05 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143187+0000", 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013611760000000001 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143429+0000", 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024201999999999999 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156164+0000", 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012735020999999999 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156288+0000", 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012365799999999999 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156467+0000", 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017954700000000001 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151543 5.2 5:49aa80a6:::benchmark_data_smithi062_23645_object16434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3953737110000004, 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023818700000000002, 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151543 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112305+0000", 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6300000000000004e-07 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112309+0000", 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1370000000000004e-06 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112319+0000", 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0128e-05 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112326+0000", 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1740000000000003e-06 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.117629+0000", 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053025889999999999 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.117739+0000", 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110183 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.118975+0000", 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012366020000000001 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.131047+0000", 2024-09-12T18:14:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012071414000000001 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136016+0000", 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049688600000000003 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136084+0000", 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8147999999999999e-05 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136122+0000", 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8602000000000001e-05 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151544 5.2 5:4af2649e:::benchmark_data_smithi062_23645_object16435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3953408740000004, 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023899725, 2024-09-12T18:14:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151544 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0699999999999998e-07 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112338+0000", 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.562e-06 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112342+0000", 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9509999999999999e-06 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112347+0000", 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6229999999999996e-06 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.121877+0000", 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095294690000000005 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122010+0000", 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013326000000000001 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122637+0000", 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00062677100000000003 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.132506+0000", 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098691019999999994 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136160+0000", 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036541680000000002 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136203+0000", 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3251999999999999e-05 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136236+0000", 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3259999999999997e-05 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.391424303, 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:14:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.378023196, 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:14:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.371449514, 2024-09-12T18:14:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:14:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3713375990000003, 2024-09-12T18:14:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3654486529999996, 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:14:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:14:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3638390520000003, 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:14:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:14:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:14:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3425113509999997, 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:14:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:14:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:156823 5.c 5:3032dbef:::benchmark_data_smithi062_23645_object21714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.466037+0000", 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.041640414000000001, 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024797509999999998, 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 156823 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466037+0000", 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466037+0000", 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466038+0000", 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0100000000000001e-06 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466042+0000", 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4220000000000002e-06 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466054+0000", 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1058e-05 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466061+0000", 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7910000000000005e-06 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.467376+0000", 2024-09-12T18:14:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001314766 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.467494+0000", 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117819 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.467604+0000", 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109733 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470583+0000", 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029790060000000002 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.490762+0000", 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020179415999999999 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.490791+0000", 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8656000000000001e-05 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.490835+0000", 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3832999999999999e-05 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:156837 5.c 5:3a29327a:::benchmark_data_smithi062_23645_object21728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.036780835999999997, 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026256763999999998, 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 156837 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470902+0000", 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.262e-06 2024-09-12T18:14:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470930+0000", 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8079e-05 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470941+0000", 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1212e-05 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.489581+0000", 2024-09-12T18:14:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018639610000000001 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.489724+0000", 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014342599999999999 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.489813+0000", 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9464999999999998e-05 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.492456+0000", 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002642298 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.497032+0000", 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045763059999999996 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.497080+0000", 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7855999999999997e-05 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.497153+0000", 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3460000000000005e-05 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:52.620 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:52.621 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:52.617+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:52.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:52.722 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:52.721+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:52.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:14:52.773 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:157546 5.1 e56/49 5:88b71c01:::benchmark_data_smithi062_23645_object22437:head v 56'9778, mlcod=56'9775)", 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.771655+0000", 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0025640329999999999, 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025824870000000001, 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.771655+0000", 2024-09-12T18:14:52.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.771655+0000", 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.771655+0000", 2024-09-12T18:14:52.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999995e-07 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.771659+0000", 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7960000000000002e-06 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.771667+0000", 2024-09-12T18:14:52.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6090000000000003e-06 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.771672+0000", 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.096e-06 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772564+0000", 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00089173200000000001 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772574+0000", 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0732e-05 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:157549 5.f 5:f2fa8232:::benchmark_data_smithi062_23645_object22440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.772477+0000", 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0017420739999999999, 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00179699, 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.779 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 157549 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772477+0000", 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772477+0000", 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772478+0000", 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.235e-06 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772482+0000", 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0369999999999996e-06 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772499+0000", 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6841999999999999e-05 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772505+0000", 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5910000000000001e-06 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772557+0000", 2024-09-12T18:14:52.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1956999999999997e-05 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772684+0000", 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126384 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772822+0000", 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013800300000000001 2024-09-12T18:14:52.783 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:157536 5.9 e56/53)", 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.772844+0000", 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001374693, 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001464267, 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:52.784 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772844+0000", 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772844+0000", 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772845+0000", 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4099999999999998e-07 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772848+0000", 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.614e-06 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772859+0000", 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0271999999999999e-05 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772865+0000", 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5810000000000002e-06 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:157544 5.9 e56/53)", 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.773184+0000", 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001034851, 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001145018, 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.787 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.773184+0000", 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.773184+0000", 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.773184+0000", 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2800000000000002e-07 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.773186+0000", 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1770000000000001e-06 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.773194+0000", 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6879999999999999e-06 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.773198+0000", 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0149999999999997e-06 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:157531 5.9 5:93ecf56d:::benchmark_data_smithi062_23645_object22422:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.766574+0000", 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0076447950000000002, 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007781077, 2024-09-12T18:14:52.790 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 157531 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766574+0000", 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766574+0000", 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766575+0000", 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7999999999999993e-07 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766578+0000", 2024-09-12T18:14:52.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1530000000000001e-06 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766584+0000", 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4010000000000002e-06 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766589+0000", 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766777+0000", 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000188035 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766906+0000", 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012986200000000001 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767026+0000", 2024-09-12T18:14:52.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011908099999999999 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770700+0000", 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0036742210000000001 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:157536 5.9 5:91e206cb:::benchmark_data_smithi062_23645_object22427:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.766808+0000", 2024-09-12T18:14:52.795 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0074108400000000001, 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075909810000000001, 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 157536 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766808+0000", 2024-09-12T18:14:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766808+0000", 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766808+0000", 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5300000000000004e-07 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766811+0000", 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2910000000000002e-06 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766817+0000", 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8409999999999996e-06 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.766822+0000", 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1769999999999997e-06 2024-09-12T18:14:52.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768437+0000", 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016157330000000001 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768579+0000", 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000141478 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768689+0000", 2024-09-12T18:14:52.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000110469 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:157532 5.1 e56/49 5:8cd7b992:::benchmark_data_smithi062_23645_object22423:head v 56'9777, mlcod=56'9775)", 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.767204+0000", 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0070146499999999999, 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0072297569999999999, 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.800 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767204+0000", 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767204+0000", 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767204+0000", 2024-09-12T18:14:52.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4900000000000001e-07 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767207+0000", 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0529999999999998e-06 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767214+0000", 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1909999999999997e-06 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.767218+0000", 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4440000000000001e-06 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768419+0000", 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0012004819999999999 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768430+0000", 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0964e-05 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.803 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:157533 5.6 e56/53 5:6450e6d0:::benchmark_data_smithi062_23645_object22424:head v 56'9812, mlcod=56'9808)", 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.768156+0000", 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0060627900000000002, 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0063078730000000003, 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.804 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768156+0000", 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768156+0000", 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768156+0000", 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9999999999999997e-07 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768163+0000", 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2049999999999999e-06 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768173+0000", 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0322e-05 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.806 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768179+0000", 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9390000000000002e-06 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768227+0000", 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8467999999999997e-05 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768246+0000", 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8714000000000001e-05 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.807 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:157539 5.d 5:bd881f7a:::benchmark_data_smithi062_23645_object22430:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.768746+0000", 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0054727530000000003, 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0057506160000000001, 2024-09-12T18:14:52.808 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 157539 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.810 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768746+0000", 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768746+0000", 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768747+0000", 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7899999999999997e-07 2024-09-12T18:14:52.812 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768750+0000", 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5769999999999998e-06 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768759+0000", 2024-09-12T18:14:52.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0909999999999999e-06 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768766+0000", 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1850000000000001e-06 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768818+0000", 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2306999999999999e-05 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768940+0000", 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000121818 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:157540 5.7 5:e7ce417d:::benchmark_data_smithi062_23645_object22431:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.815 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.768780+0000", 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0054385099999999997, 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0057473300000000001, 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 157540 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.816 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768780+0000", 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768780+0000", 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768781+0000", 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1699999999999999e-07 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768783+0000", 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1119999999999999e-06 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768790+0000", 2024-09-12T18:14:52.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768795+0000", 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4920000000000004e-06 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768839+0000", 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4110999999999998e-05 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768951+0000", 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000112361 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769057+0000", 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000106165 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.772433+0000", 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033759110000000001 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:157544 5.9 5:9ced078c:::benchmark_data_smithi062_23645_object22435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.768807+0000", 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0054115350000000003, 2024-09-12T18:14:52.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0057572739999999997, 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 157544 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768807+0000", 2024-09-12T18:14:52.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768807+0000", 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768808+0000", 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6300000000000001e-07 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768810+0000", 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1289999999999999e-06 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768815+0000", 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8239999999999996e-06 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768821+0000", 2024-09-12T18:14:52.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0980000000000001e-06 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770745+0000", 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019244170000000001 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770873+0000", 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000128014 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770992+0000", 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119344 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:157537 5.5 e56/21 5:a58be14c:::benchmark_data_smithi062_23645_object22428:head v 56'10007, mlcod=56'10004)", 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.768839+0000", 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0053792709999999997, 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0057587660000000002, 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.826 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768839+0000", 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768839+0000", 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768840+0000", 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9999999999999998e-07 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768843+0000", 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.579e-06 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768850+0000", 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3879999999999997e-06 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.768854+0000", 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4120000000000003e-06 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770831+0000", 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019765630000000002 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770849+0000", 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8411999999999999e-05 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.830 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:157543 5.6 e56/53 5:60d03e57:::benchmark_data_smithi062_23645_object22434:head v 56'9813, mlcod=56'9809)", 2024-09-12T18:14:52.831 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.769889+0000", 2024-09-12T18:14:52.831 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0043292549999999997, 2024-09-12T18:14:52.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0047371710000000001, 2024-09-12T18:14:52.831 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.831 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.831 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769889+0000", 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769889+0000", 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769890+0000", 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769894+0000", 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1350000000000002e-06 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769903+0000", 2024-09-12T18:14:52.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0119999999999994e-06 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769908+0000", 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8199999999999996e-06 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769955+0000", 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6524999999999999e-05 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.769973+0000", 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8649999999999999e-05 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:157545 5.2 e56/49 5:4744e7ee:::benchmark_data_smithi062_23645_object22436:head v 56'9883, mlcod=56'9881)", 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:52.770117+0000", 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0041013320000000001, 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045376069999999999, 2024-09-12T18:14:52.835 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770117+0000", 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770117+0000", 2024-09-12T18:14:52.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770118+0000", 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.06e-07 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770121+0000", 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3400000000000002e-06 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.837 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770127+0000", 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2190000000000001e-06 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770131+0000", 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5420000000000001e-06 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770174+0000", 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3445000000000002e-05 2024-09-12T18:14:52.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:52.770193+0000", 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8389e-05 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 14 2024-09-12T18:14:52.839 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:52.841 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:52.841 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:52.837+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:52.944 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:52.938+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:53.041 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:53.041 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:53.041 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:53.041 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:53.041 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:53.044 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:53.041+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:53.063 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:53.137 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:14:53.137 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:53.137 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T18:14:53.138 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:14:53.138 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:14:53.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T18:14:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:14:53.182 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:53.178+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:53.247 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:53.242+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:53.256 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:53.256 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:53.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 100.96113847700001, 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:53.257 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:53.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:53.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:53.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 100.156810175, 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:53.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:53.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:53.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.861214501999996, 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:53.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:53.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:53.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.275 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.861120826999993, 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:53.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:53.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.861051596999999, 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.281 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:53.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:53.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.286 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.860960831, 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:53.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:53.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:53.292 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.860899807999999, 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:53.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:53.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.860841049000001, 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.298 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:53.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:53.303 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.860777999000007, 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:53.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.309 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.859977624999999, 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:53.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.859839422999997, 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.315 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:53.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.859776173, 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:53.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:53.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.326 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.859376205999993, 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:53.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.859185711999999, 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:53.333 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:53.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:53.338 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.859098814999996, 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:53.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:53.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.344 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.858975193000006, 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:53.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:53.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 89.858583593000006, 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:53.350 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:53.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:53.354 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 26.000020565, 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:53.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:53.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:53.360 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.991998188, 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:53.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:53.366 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.980412902000001, 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:53.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:53.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:53.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:53.372 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:53.374 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:53.374 INFO:teuthology.orchestra.run.smithi151.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:14:53.374 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:53.375 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:53.370+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:53.375 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:53.475 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:53.470+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:53.571 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:53.571 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:53.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:159448 5.9 e57/53 5:9d6a1f45:::benchmark_data_smithi062_23645_object24339:head v 57'9958, mlcod=57'9954)", 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.567340+0000", 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0038685299999999998, 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003884139, 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567340+0000", 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567340+0000", 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567340+0000", 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3099999999999998e-07 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567344+0000", 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.749e-06 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567353+0000", 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1640000000000007e-06 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567358+0000", 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.147e-06 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567394+0000", 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5849999999999997e-05 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.567407+0000", 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3355e-05 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.575 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159454 5.3 5:c2975146:::benchmark_data_smithi062_23645_object24345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.568322+0000", 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028864379999999999, 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002939924, 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159454 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568322+0000", 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568322+0000", 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568322+0000", 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2099999999999996e-07 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568325+0000", 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1049999999999999e-06 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568334+0000", 2024-09-12T18:14:53.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3070000000000003e-06 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568338+0000", 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5979999999999999e-06 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568393+0000", 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5043999999999997e-05 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568520+0000", 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012692199999999999 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568640+0000", 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011971199999999999 2024-09-12T18:14:53.580 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159455 5.8 5:1ddd0d8a:::benchmark_data_smithi062_23645_object24346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.568351+0000", 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002857049, 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029479839999999998, 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159455 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568351+0000", 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568351+0000", 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568352+0000", 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6400000000000003e-07 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568354+0000", 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1289999999999999e-06 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568368+0000", 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3872e-05 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568372+0000", 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0180000000000003e-06 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568418+0000", 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6845999999999998e-05 2024-09-12T18:14:53.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568540+0000", 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121611 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159456 5.1 5:8d08714d:::benchmark_data_smithi062_23645_object24347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.568385+0000", 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028232280000000001, 2024-09-12T18:14:53.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029466269999999998, 2024-09-12T18:14:53.587 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.587 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.587 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:53.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.588 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159456 2024-09-12T18:14:53.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.588 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568385+0000", 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568385+0000", 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568385+0000", 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3000000000000001e-07 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568388+0000", 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3429999999999998e-06 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568392+0000", 2024-09-12T18:14:53.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6469999999999997e-06 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568396+0000", 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5190000000000001e-06 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568424+0000", 2024-09-12T18:14:53.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7702999999999999e-05 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568537+0000", 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113408 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568651+0000", 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113615 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159458 5.b 5:d6c72227:::benchmark_data_smithi062_23645_object24349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.568405+0000", 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028034940000000001, 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029638479999999998, 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.593 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159458 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568405+0000", 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568405+0000", 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568405+0000", 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1500000000000005e-07 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568407+0000", 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.03e-06 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568413+0000", 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9229999999999999e-06 2024-09-12T18:14:53.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568418+0000", 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6029999999999998e-06 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568455+0000", 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7707000000000003e-05 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568559+0000", 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103936 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159459 5.4 5:241d999c:::benchmark_data_smithi062_23645_object24350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.568426+0000", 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002781754, 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029743679999999998, 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.597 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159459 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568426+0000", 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568426+0000", 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568427+0000", 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7399999999999999e-07 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568429+0000", 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1119999999999999e-06 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568434+0000", 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6119999999999998e-06 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568439+0000", 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8879999999999996e-06 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568487+0000", 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7604e-05 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568607+0000", 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120344 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:159453 5.9 e57/53 5:987f4dc7:::benchmark_data_smithi062_23645_object24344:head v 57'9959, mlcod=57'9954)", 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.568470+0000", 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027380479999999999, 2024-09-12T18:14:53.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002960861, 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568470+0000", 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568470+0000", 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568470+0000", 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1399999999999997e-07 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568475+0000", 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1799999999999998e-06 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568483+0000", 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9470000000000003e-06 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568490+0000", 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7179999999999996e-06 2024-09-12T18:14:53.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568550+0000", 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9267e-05 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.568577+0000", 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7304000000000002e-05 2024-09-12T18:14:53.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159461 5.5 5:a173dc58:::benchmark_data_smithi062_23645_object24352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.569646+0000", 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001562187, 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018171820000000001, 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159461 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569646+0000", 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569646+0000", 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569647+0000", 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0189999999999999e-06 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569651+0000", 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0559999999999998e-06 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569662+0000", 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1283e-05 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569669+0000", 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7150000000000001e-06 2024-09-12T18:14:53.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569742+0000", 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3434000000000002e-05 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569839+0000", 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6409000000000005e-05 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.569928+0000", 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9580999999999995e-05 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159462 5.3 5:c0a425ab:::benchmark_data_smithi062_23645_object24353:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.570709+0000", 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00049901199999999996, 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078731500000000002, 2024-09-12T18:14:53.612 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159462 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570709+0000", 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570709+0000", 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570710+0000", 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4799999999999997e-07 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570714+0000", 2024-09-12T18:14:53.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9299999999999996e-06 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570723+0000", 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6580000000000008e-06 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570729+0000", 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6810000000000001e-06 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570774+0000", 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4401999999999999e-05 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570878+0000", 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010412399999999999 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570937+0000", 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8810000000000001e-05 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.616 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159463 5.8 5:1316efdf:::benchmark_data_smithi062_23645_object24354:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.570998+0000", 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000209858, 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053130099999999997, 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159463 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570998+0000", 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570998+0000", 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.570999+0000", 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8800000000000001e-07 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571003+0000", 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1520000000000002e-06 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571012+0000", 2024-09-12T18:14:53.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6470000000000004e-06 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571018+0000", 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5239999999999997e-06 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571064+0000", 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5837000000000002e-05 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571175+0000", 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110773 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159464 5.e 5:7c4d80e4:::benchmark_data_smithi062_23645_object24355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.571033+0000", 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000175174, 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052604699999999997, 2024-09-12T18:14:53.621 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159464 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571033+0000", 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571033+0000", 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571033+0000", 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3499999999999996e-07 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571036+0000", 2024-09-12T18:14:53.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.694e-06 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571043+0000", 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4169999999999997e-06 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571048+0000", 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1019999999999996e-06 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571097+0000", 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9323999999999997e-05 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571210+0000", 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113328 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.625 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159465 5.8 5.335f0ea8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.571058+0000", 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00015014999999999999, 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052932499999999998, 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159465 2024-09-12T18:14:53.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571058+0000", 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571058+0000", 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571058+0000", 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7899999999999999e-07 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571060+0000", 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8819999999999999e-06 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571065+0000", 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.198e-06 2024-09-12T18:14:53.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571070+0000", 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2810000000000002e-06 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:159466 5.a 5:53ad5eec:::benchmark_data_smithi062_23645_object24357:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:53.571086+0000", 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00012184900000000001, 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052643899999999997, 2024-09-12T18:14:53.629 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 159466 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571086+0000", 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571086+0000", 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571087+0000", 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6100000000000001e-07 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571089+0000", 2024-09-12T18:14:53.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571098+0000", 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1440000000000003e-06 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571102+0000", 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9010000000000002e-06 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:53.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571143+0000", 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0633999999999998e-05 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:53.571249+0000", 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105985 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 13 2024-09-12T18:14:53.633 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:53.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:53.635 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:53.633+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:53.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:53.735 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:53.733+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:53.777 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:53.798 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:53.799 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:53.816 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:53.817 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:53.819 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:53.820 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:53.831 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:53.831 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:53.836 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:53.830+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:53.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:53.937 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:53.934+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:54.038 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:54.034+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:54.048 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:54.048 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:54.068 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:54.139 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:54.137+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:54.225 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:54.225 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:54.240 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:54.237+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:54.246 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:54.342 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:54.338+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:54.443 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:54.441+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:54.446 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:54.446 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:54.466 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:54.544 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:54.538+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:54.645 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:54.641+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:54.661 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:54.661 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:54.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:54.747 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:54.745+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:54.838 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:54.838 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:54.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:54.879 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:54.842+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:54.949 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:54.946+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.036 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:55.036 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:55.050 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.046+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.058 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:55.151 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:55.149+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:55.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:14:55.252 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.246+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.256 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:55.257 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:55.277 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:55.352 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:55.349+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:55.427 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:55.427 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:55.447 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:55.452 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.446+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.553 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.550+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.640 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:55.640 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:55.655 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.650+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:55.755 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.750+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.814 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:55.814 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:55.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:14:55.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:55.881 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:55.878+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:55.961 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:55.953+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:55.964 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:55.985 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:55.986 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:55.991 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:55.991 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:55.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.991 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165130 5.8 5:19773aff:::benchmark_data_smithi062_23645_object30021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:55.991 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.988512+0000", 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002624501, 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026467740000000002, 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165130 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:55.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988512+0000", 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988512+0000", 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988513+0000", 2024-09-12T18:14:55.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988517+0000", 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7859999999999998e-06 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988524+0000", 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7260000000000002e-06 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988531+0000", 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9099999999999999e-06 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988586+0000", 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4280000000000002e-05 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:55.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988658+0000", 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2741e-05 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:165131 5.7 e57/21 5:ea482a3b:::benchmark_data_smithi062_23645_object30022:head v 57'10205, mlcod=57'10202)", 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.988857+0000", 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0022796359999999998, 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023705340000000001, 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:55.996 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988857+0000", 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988857+0000", 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988857+0000", 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988861+0000", 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6799999999999999e-06 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988871+0000", 2024-09-12T18:14:55.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0212e-05 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988877+0000", 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9340000000000003e-06 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988925+0000", 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7490000000000001e-05 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:55.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988943+0000", 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8374000000000001e-05 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165132 5.e 5:7bd6be7f:::benchmark_data_smithi062_23645_object30023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.990815+0000", 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00032186500000000001, 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046879000000000002, 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.000 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165132 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990815+0000", 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990815+0000", 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990815+0000", 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8299999999999995e-07 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990819+0000", 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0459999999999999e-06 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990828+0000", 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5620000000000004e-06 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990835+0000", 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8709999999999999e-06 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991004+0000", 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169199 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991125+0000", 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121227 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.004 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165133 5.6 5:66f5c71b:::benchmark_data_smithi062_23645_object30024:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.990859+0000", 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00027763199999999999, 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00048658099999999998, 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165133 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990859+0000", 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990859+0000", 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990860+0000", 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1399999999999996e-07 2024-09-12T18:14:56.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990862+0000", 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8159999999999998e-06 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990869+0000", 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1600000000000001e-06 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990875+0000", 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4269999999999999e-06 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991031+0000", 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156057 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991138+0000", 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107009 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991252+0000", 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113529 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165135 5.e 5.1434de8e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.990928+0000", 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00020874500000000001, 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047871200000000001, 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.009 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165135 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990928+0000", 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990928+0000", 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990928+0000", 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990932+0000", 2024-09-12T18:14:56.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2890000000000002e-06 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990938+0000", 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7070000000000003e-06 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.990943+0000", 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4689999999999999e-06 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165125 5.4 5:21f49e6e:::benchmark_data_smithi062_23645_object30016:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.986169+0000", 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049670119999999998, 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052842669999999996, 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.013 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165125 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986169+0000", 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986169+0000", 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986170+0000", 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3900000000000004e-07 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986174+0000", 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.563e-06 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986182+0000", 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3520000000000007e-06 2024-09-12T18:14:56.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986189+0000", 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8349999999999998e-06 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986278+0000", 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9221000000000005e-05 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986410+0000", 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013214699999999999 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991415+0000", 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050050800000000003 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991442+0000", 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6553000000000001e-05 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165126 5.c 5:3cb4b8b9:::benchmark_data_smithi062_23645_object30017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.986204+0000", 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049323500000000003, 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053129060000000001, 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165126 2024-09-12T18:14:56.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986204+0000", 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986204+0000", 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986205+0000", 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0900000000000001e-07 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986207+0000", 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9920000000000002e-06 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986213+0000", 2024-09-12T18:14:56.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6290000000000004e-06 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986218+0000", 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0499999999999999e-06 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.987323+0000", 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011046280000000001 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.987390+0000", 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7021999999999996e-05 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.987450+0000", 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9648000000000002e-05 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.989922+0000", 2024-09-12T18:14:56.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024723509999999998 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.991513+0000", 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001591065 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:165128 5.6 5:640226ab:::benchmark_data_smithi062_23645_object30019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:55.986586+0000", 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0045501309999999998, 2024-09-12T18:14:56.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050029380000000002, 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 165128 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986586+0000", 2024-09-12T18:14:56.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986586+0000", 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986587+0000", 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1399999999999996e-07 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986591+0000", 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6179999999999999e-06 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986598+0000", 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8399999999999995e-06 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.986604+0000", 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9970000000000004e-06 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988486+0000", 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001881691 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988589+0000", 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102385 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:55.988648+0000", 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9317999999999997e-05 2024-09-12T18:14:56.027 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.028 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:56.028 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 8 2024-09-12T18:14:56.028 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:56.029 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:56.031 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:56.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:56.031 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:56.032 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:56.058 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:56.053+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:56.159 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:56.157+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:56.170 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:14:56.228 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:56.228 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:56.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:56.293 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:56.290+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:56.361 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:56.358+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 93.000668891999993, 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026231854999999998, 2024-09-12T18:14:56.408 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405386+0000", 2024-09-12T18:14:56.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405394+0000", 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7489999999999998e-06 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405409+0000", 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4707e-05 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405436+0000", 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6970000000000001e-05 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405474+0000", 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7629999999999997e-05 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408396+0000", 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002922867 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408634+0000", 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023785899999999999 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.408953+0000", 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000319 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422318+0000", 2024-09-12T18:14:56.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013364344 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431395+0000", 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090778219999999993 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431524+0000", 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012857 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431618+0000", 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4337000000000002e-05 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:19 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:56.414 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 93.000371244999997, 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027622331999999999, 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405684+0000", 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405686+0000", 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.477e-06 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405694+0000", 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:14:56.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405713+0000", 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8482999999999999e-05 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405728+0000", 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5610000000000001e-05 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.409651+0000", 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039230070000000001 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.410802+0000", 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001150924 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.411186+0000", 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000383917 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.422475+0000", 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011288869999999999 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433175+0000", 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699969 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433250+0000", 2024-09-12T18:14:56.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4715999999999994e-05 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433306+0000", 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6888999999999997e-05 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 93.000207423000006, 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025702902, 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405848+0000", 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405849+0000", 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405855+0000", 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5459999999999999e-06 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405872+0000", 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7367000000000002e-05 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405887+0000", 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5046e-05 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407290+0000", 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014032129999999999 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.407903+0000", 2024-09-12T18:14:56.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00061280199999999996 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.431551+0000", 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023647534000000001 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(mds.0.3:32 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:56.425 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 93.000146657000002, 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027632810000000001, 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405909+0000", 2024-09-12T18:14:56.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405910+0000", 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405915+0000", 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4330000000000003e-06 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405933+0000", 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7943000000000001e-05 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.405987+0000", 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3977000000000002e-05 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413481+0000", 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074939560000000004 2024-09-12T18:14:56.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.413778+0000", 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029634699999999997 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:13:23.433541+0000", 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019763797 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.152720420000001, 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.430 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:56.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.151787907999999, 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:56.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:56.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:56.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:56.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.151687446, 2024-09-12T18:14:56.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.444 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:56.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109299 5.a 5:5e61e2c8:::benchmark_data_smithi062_23645_object109298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.141565386, 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.045811353999999999, 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109299 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264490+0000", 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264491+0000", 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3099999999999997e-07 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264551+0000", 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9948000000000003e-05 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264558+0000", 2024-09-12T18:14:56.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1790000000000002e-06 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264562+0000", 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8720000000000004e-06 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264615+0000", 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3773999999999997e-05 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264765+0000", 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014946499999999999 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.264991+0000", 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022620499999999999 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.271862+0000", 2024-09-12T18:14:56.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068709069999999999 2024-09-12T18:14:56.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310073+0000", 2024-09-12T18:14:56.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038210905000000003 2024-09-12T18:14:56.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310227+0000", 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000154346 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.310301+0000", 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4122000000000006e-05 2024-09-12T18:14:56.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:139381 5.a 5:5feeed27:::benchmark_data_smithi062_23645_object4272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.276532896999999, 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026944724999999999, 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 139381 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129522+0000", 2024-09-12T18:14:56.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129525+0000", 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3599999999999999e-06 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129535+0000", 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0137e-05 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129558+0000", 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3510999999999999e-05 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.129575+0000", 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6711e-05 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143187+0000", 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013611760000000001 2024-09-12T18:14:56.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.143429+0000", 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024201999999999999 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156164+0000", 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012735020999999999 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156288+0000", 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012365799999999999 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:43.156467+0000", 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017954700000000001 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151543 5.2 5:49aa80a6:::benchmark_data_smithi062_23645_object16434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:56.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2937515820000005, 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023818700000000002, 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151543 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112304+0000", 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112305+0000", 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6300000000000004e-07 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112309+0000", 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1370000000000004e-06 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112319+0000", 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0128e-05 2024-09-12T18:14:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112326+0000", 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1740000000000003e-06 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.117629+0000", 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053025889999999999 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.117739+0000", 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110183 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.118975+0000", 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012366020000000001 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.131047+0000", 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012071414000000001 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136016+0000", 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049688600000000003 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136084+0000", 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8147999999999999e-05 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136122+0000", 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8602000000000001e-05 2024-09-12T18:14:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151544 5.2 5:4af2649e:::benchmark_data_smithi062_23645_object16435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2937187449999996, 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023899725, 2024-09-12T18:14:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151544 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112337+0000", 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0699999999999998e-07 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112338+0000", 2024-09-12T18:14:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.562e-06 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112342+0000", 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9509999999999999e-06 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.112347+0000", 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6229999999999996e-06 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.121877+0000", 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095294690000000005 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122010+0000", 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013326000000000001 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.122637+0000", 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00062677100000000003 2024-09-12T18:14:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.132506+0000", 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098691019999999994 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136160+0000", 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036541680000000002 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136203+0000", 2024-09-12T18:14:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3251999999999999e-05 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136236+0000", 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3259999999999997e-05 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2898021740000001, 2024-09-12T18:14:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:14:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:14:56.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2764010670000001, 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:14:56.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:14:56.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2698273849999993, 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.486 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:14:56.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:14:56.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.491 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2697154699999995, 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:56.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2638265240000006, 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:14:56.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.501 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2622169230000004, 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:14:56.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.2408892219999998, 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:14:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:156823 5.c 5:3032dbef:::benchmark_data_smithi062_23645_object21714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.466037+0000", 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.9400182849999998, 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024797509999999998, 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 156823 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.512 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466037+0000", 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466037+0000", 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466038+0000", 2024-09-12T18:14:56.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0100000000000001e-06 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466042+0000", 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4220000000000002e-06 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466054+0000", 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1058e-05 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.466061+0000", 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7910000000000005e-06 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.467376+0000", 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001314766 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.467494+0000", 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117819 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.467604+0000", 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109733 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470583+0000", 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029790060000000002 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.490762+0000", 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020179415999999999 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.490791+0000", 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8656000000000001e-05 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.490835+0000", 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3832999999999999e-05 2024-09-12T18:14:56.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:156837 5.c 5:3a29327a:::benchmark_data_smithi062_23645_object21728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.9351587070000003, 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026256763999999998, 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:56.518 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 156837 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:56.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470897+0000", 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470902+0000", 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.262e-06 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:56.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470930+0000", 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8079e-05 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.470941+0000", 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1212e-05 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.489581+0000", 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018639610000000001 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.489724+0000", 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014342599999999999 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.489813+0000", 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9464999999999998e-05 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.492456+0000", 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002642298 2024-09-12T18:14:56.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.497032+0000", 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045763059999999996 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.497080+0000", 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7855999999999997e-05 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:56.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:52.497153+0000", 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3460000000000005e-05 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:56.524 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:56.525 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:56.526 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:56.521+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:56.626 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:56.622+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:56.680 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:56.680 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:56.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.680 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:166819 5.f 5:f46f3c2e:::benchmark_data_smithi062_23645_object31710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:56.680 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.674270+0000", 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0064902120000000004, 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0065073079999999998, 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 166819 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674270+0000", 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674270+0000", 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674271+0000", 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0100000000000004e-07 2024-09-12T18:14:56.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674277+0000", 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674287+0000", 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674293+0000", 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4420000000000003e-06 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674803+0000", 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00051020000000000004 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674884+0000", 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0253999999999994e-05 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.674961+0000", 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7552000000000006e-05 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679191+0000", 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042302570000000003 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:166821 5.7 5:e87b72ae:::benchmark_data_smithi062_23645_object31712:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.677132+0000", 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0036279440000000001, 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0036896339999999998, 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.686 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 166821 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677132+0000", 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677132+0000", 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677133+0000", 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1289999999999999e-06 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677137+0000", 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8449999999999996e-06 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677146+0000", 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5930000000000006e-06 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677151+0000", 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.361e-06 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677188+0000", 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6992000000000001e-05 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677265+0000", 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6604e-05 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677334+0000", 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9504000000000004e-05 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680739+0000", 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0034049499999999999 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.691 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:166827 5.9 5:90a11609:::benchmark_data_smithi062_23645_object31718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.677195+0000", 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0035652549999999998, 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0036648200000000001, 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:56.692 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 166827 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677195+0000", 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677195+0000", 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677196+0000", 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1800000000000005e-07 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677198+0000", 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677204+0000", 2024-09-12T18:14:56.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5720000000000002e-06 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677208+0000", 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8029999999999998e-06 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677262+0000", 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.414e-05 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677350+0000", 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8331999999999994e-05 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677422+0000", 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1678000000000001e-05 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:166828 5.f 5:f58f7cd6:::benchmark_data_smithi062_23645_object31719:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.677218+0000", 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0035425249999999999, 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003676871, 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 166828 2024-09-12T18:14:56.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677218+0000", 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677218+0000", 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677218+0000", 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.15e-07 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677220+0000", 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.029e-06 2024-09-12T18:14:56.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677224+0000", 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.636e-06 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677227+0000", 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8449999999999999e-06 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677258+0000", 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1588000000000003e-05 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677345+0000", 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6785000000000003e-05 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:56.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.677433+0000", 2024-09-12T18:14:56.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7701999999999995e-05 2024-09-12T18:14:56.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680706+0000", 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003273808 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:166822 5.c e58/53 5:3987d2b8:::benchmark_data_smithi062_23645_object31713:head v 58'10293, mlcod=58'10290)", 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.679256+0000", 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0015038079999999999, 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001674093, 2024-09-12T18:14:56.705 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679256+0000", 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679256+0000", 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679257+0000", 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9700000000000002e-07 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679270+0000", 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3256e-05 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679275+0000", 2024-09-12T18:14:56.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0370000000000002e-06 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679278+0000", 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.275e-06 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679323+0000", 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4824000000000003e-05 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679356+0000", 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2327999999999999e-05 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:166829 5.6 e58/53 5:64cd7c64:::benchmark_data_smithi062_23645_object31720:head v 58'10411, mlcod=58'10408)", 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.679289+0000", 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001471443, 2024-09-12T18:14:56.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001669373, 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679289+0000", 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679289+0000", 2024-09-12T18:14:56.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679289+0000", 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.48e-07 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679291+0000", 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3479999999999998e-06 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.711 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679295+0000", 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679299+0000", 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7419999999999999e-06 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679347+0000", 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8557999999999998e-05 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679368+0000", 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0985e-05 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:166826 5.c e58/53 5:33d947f1:::benchmark_data_smithi062_23645_object31717:head v 58'10294, mlcod=58'10290)", 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.679350+0000", 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0014101540000000001, 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001636017, 2024-09-12T18:14:56.713 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679350+0000", 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679350+0000", 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679350+0000", 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9499999999999998e-07 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679354+0000", 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5470000000000001e-06 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679361+0000", 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5050000000000004e-06 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679366+0000", 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0980000000000001e-06 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680554+0000", 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001188415 2024-09-12T18:14:56.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680572+0000", 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8258e-05 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:166831 5.9 5:92a593ef:::benchmark_data_smithi062_23645_object31722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.679553+0000", 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0012068350000000001, 2024-09-12T18:14:56.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001464726, 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 166831 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679553+0000", 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679553+0000", 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679554+0000", 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:14:56.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679558+0000", 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0010000000000003e-06 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679570+0000", 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1297e-05 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679576+0000", 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4250000000000003e-06 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679617+0000", 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0663e-05 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679697+0000", 2024-09-12T18:14:56.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0047000000000001e-05 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.679766+0000", 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9558e-05 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:166830 5.c e58/53)", 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:56.680535+0000", 2024-09-12T18:14:56.722 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00022545, 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00054454899999999997, 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680535+0000", 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:56.723 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680535+0000", 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680535+0000", 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.44e-07 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680540+0000", 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1620000000000001e-06 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680548+0000", 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8019999999999998e-06 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:56.680554+0000", 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7139999999999998e-06 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 9 2024-09-12T18:14:56.725 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:56.727 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:56.727 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:56.722+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:56.827 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:56.825+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:56.887 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:56.887 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:14:56.887 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:14:56.887 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:14:56.888 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:56.906 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:56.928 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:56.922+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:57.029 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:57.025+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:57.111 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:57.111 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:14:57.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:14:57.111 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:57.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 104.816149282, 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.112 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:14:57.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:14:57.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:14:57.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 104.01182098, 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024137783999999999, 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 52 2024-09-12T18:14:57.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098489+0000", 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098490+0000", 2024-09-12T18:14:57.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:14:57.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098495+0000", 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8669999999999999e-06 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098505+0000", 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1800000000000002e-06 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.098512+0000", 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5730000000000002e-06 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117239+0000", 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018727012000000001 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117473+0000", 2024-09-12T18:14:57.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023333499999999999 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.117781+0000", 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000308048 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.118933+0000", 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011521509999999999 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122475+0000", 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035424520000000002 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122566+0000", 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0779999999999995e-05 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:13.122627+0000", 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0715999999999999e-05 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.125 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.716225307000002, 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024100423999999999, 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394085+0000", 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394088+0000", 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.01e-06 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394100+0000", 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.275e-05 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394120+0000", 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.912e-05 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394135+0000", 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5729000000000001e-05 2024-09-12T18:14:57.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394272+0000", 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000136539 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395312+0000", 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010402720000000001 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395597+0000", 2024-09-12T18:14:57.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028447800000000001 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407803+0000", 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012206869 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417959+0000", 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010156075000000001 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418076+0000", 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116796 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418185+0000", 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108786 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:57.131 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.716131632, 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025293365000000002, 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394178+0000", 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394180+0000", 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4169999999999999e-06 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394190+0000", 2024-09-12T18:14:57.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0530000000000001e-05 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394210+0000", 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394225+0000", 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5133999999999999e-05 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396379+0000", 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002154319 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396583+0000", 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020345199999999999 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397052+0000", 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046935299999999999 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407820+0000", 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010768091 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419228+0000", 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011407155 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419373+0000", 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014562900000000001 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419472+0000", 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8542000000000006e-05 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.138 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.716062402000006, 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:14:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.715971636000006, 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:14:57.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:14:57.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.715910613000005, 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.150 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:14:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.155 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.715851853999993, 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:14:57.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:14:57.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.162 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.715788803999999, 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:14:57.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:14:57.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:15 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.714988430000005, 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023627254, 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.168 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395322+0000", 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395323+0000", 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.209e-06 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395330+0000", 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395347+0000", 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7547e-05 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395359+0000", 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1143e-05 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395476+0000", 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117959 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395778+0000", 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000301155 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396134+0000", 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035656400000000002 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406855+0000", 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010721044000000001 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418721+0000", 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011865641999999999 2024-09-12T18:14:57.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418850+0000", 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012936499999999999 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.418949+0000", 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8505999999999995e-05 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.714850228000003, 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:14:57.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.179 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:29 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.714786978000006, 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023761662999999999, 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395523+0000", 2024-09-12T18:14:57.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395524+0000", 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395560+0000", 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5363e-05 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395577+0000", 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7796e-05 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395600+0000", 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2566e-05 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396928+0000", 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00132811 2024-09-12T18:14:57.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397109+0000", 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018117200000000001 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397425+0000", 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031585100000000002 2024-09-12T18:14:57.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.406884+0000", 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0094591799999999993 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419064+0000", 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.012179963 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419190+0000", 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000126246 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419285+0000", 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4235999999999997e-05 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.189 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.714387010999999, 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.023737452999999999, 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395923+0000", 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395925+0000", 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4329999999999998e-06 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395938+0000", 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2636000000000001e-05 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395965+0000", 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6886999999999999e-05 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395988+0000", 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3509000000000001e-05 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398861+0000", 2024-09-12T18:14:57.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028729250000000001 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399112+0000", 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025063100000000002 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399431+0000", 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031941400000000002 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.409114+0000", 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096829559999999995 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419402+0000", 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010287200999999999 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419563+0000", 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000161385 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419660+0000", 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7476e-05 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.714196517000005, 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:14:57.195 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.714109620000002, 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:14:57.201 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:14:57.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:14:57.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.713985997999998, 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.207 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 93.713594397999998, 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.213 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:14:57.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:57.217 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.855031369999999, 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:14:57.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:14:57.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.223 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.847008992999999, 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.224 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:14:57.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.229 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.835423707, 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.230 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:14:57.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.235 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.236 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.236 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:57.236 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:57.236 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:57.238 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:57.233+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:57.238 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:57.338 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:57.334+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168558 5.1 5.36b821a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403132+0000", 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00057783800000000001, 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00059628899999999996, 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.405 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168558 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403132+0000", 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403132+0000", 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403133+0000", 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6700000000000002e-07 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403137+0000", 2024-09-12T18:14:57.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0470000000000004e-06 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403147+0000", 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0061000000000001e-05 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403154+0000", 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4500000000000001e-06 2024-09-12T18:14:57.408 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168559 5.a 5:509c8270:::benchmark_data_smithi062_23645_object33450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403451+0000", 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00025883600000000003, 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033980300000000001, 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.409 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.410 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168559 2024-09-12T18:14:57.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.411 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403451+0000", 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403451+0000", 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403452+0000", 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:14:57.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403456+0000", 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6899999999999998e-06 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403465+0000", 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5510000000000005e-06 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403472+0000", 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2299999999999996e-06 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403513+0000", 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1187999999999999e-05 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "MOSDPGPush(5.9 58/53 [PushOp(5:925c38ad:::benchmark_data_smithi062_23645_object54845:head, version: 32'3413, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:925c38ad:::benchmark_data_smithi062_23645_object54845:head@32'3413, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T18:14:57.414 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403558+0000", 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00015250800000000001, 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031313400000000001, 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403558+0000", 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403558+0000", 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403558+0000", 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403598+0000", 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9876000000000002e-05 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403618+0000", 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403636+0000", 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7207999999999999e-05 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "pg_backfill(progress 5.9 e 58/58 lb 5:925b9606:::benchmark_data_smithi062_23645_object110008:head)", 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403656+0000", 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.4432000000000003e-05, 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025707699999999998, 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403656+0000", 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403656+0000", 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403656+0000", 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3999999999999997e-07 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403663+0000", 2024-09-12T18:14:57.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8059999999999997e-06 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403675+0000", 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2329e-05 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403682+0000", 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9580000000000001e-06 2024-09-12T18:14:57.420 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.421 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.421 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.421 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:168542 5.1 e58/49)", 2024-09-12T18:14:57.421 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403692+0000", 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.8726999999999999e-05, 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025954100000000001, 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403692+0000", 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403692+0000", 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403692+0000", 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.29e-07 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403694+0000", 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.232e-06 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403700+0000", 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7289999999999997e-06 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403704+0000", 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2660000000000003e-06 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:168543 5.c e58/53)", 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403711+0000", 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999995, 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000277416, 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403711+0000", 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403711+0000", 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403711+0000", 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.11e-07 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403713+0000", 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5600000000000001e-06 2024-09-12T18:14:57.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403718+0000", 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6359999999999999e-06 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403722+0000", 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9400000000000004e-06 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:168557 5.9 e58/53)", 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.403728+0000", 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999824, 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000297874, 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403728+0000", 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403728+0000", 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403728+0000", 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5899999999999998e-07 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403731+0000", 2024-09-12T18:14:57.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-06 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403737+0000", 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.502e-06 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403741+0000", 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9570000000000004e-06 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.430 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168542 5.1 5:8a20a05b:::benchmark_data_smithi062_23645_object33433:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.397407+0000", 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0063029610000000002, 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066598760000000003, 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168542 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397407+0000", 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397407+0000", 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397408+0000", 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.043e-06 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397413+0000", 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5059999999999997e-06 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397421+0000", 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1009999999999992e-06 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397427+0000", 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9030000000000001e-06 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397474+0000", 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6786000000000002e-05 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397578+0000", 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010456 2024-09-12T18:14:57.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397680+0000", 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010172599999999999 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168543 5.c 5:34f8252f:::benchmark_data_smithi062_23645_object33434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.397489+0000", 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0062210290000000003, 2024-09-12T18:14:57.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066374729999999996, 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168543 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397489+0000", 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397489+0000", 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397490+0000", 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397493+0000", 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.942e-06 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397501+0000", 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6990000000000003e-06 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.397506+0000", 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1569999999999999e-06 2024-09-12T18:14:57.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.400898+0000", 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003392118 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401043+0000", 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014495799999999999 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401159+0000", 2024-09-12T18:14:57.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116094 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:168545 5.9 e58/53 5:95531606:::benchmark_data_smithi062_23645_object33436:head v 58'10501, mlcod=58'10499)", 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.399177+0000", 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0045328269999999997, 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050087309999999998, 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.440 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399177+0000", 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399177+0000", 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399178+0000", 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4999999999999998e-07 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399182+0000", 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5379999999999996e-06 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399189+0000", 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.55e-06 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399193+0000", 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.437e-06 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399224+0000", 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0181000000000001e-05 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399239+0000", 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5007999999999999e-05 2024-09-12T18:14:57.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168548 5.4 5:2ee98ae6:::benchmark_data_smithi062_23645_object33439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.399456+0000", 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0042547419999999997, 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047780610000000001, 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168548 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399456+0000", 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399456+0000", 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399456+0000", 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5700000000000001e-07 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399460+0000", 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0620000000000002e-06 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399469+0000", 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0930000000000003e-06 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.399477+0000", 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4479999999999994e-06 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402605+0000", 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003127983 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402726+0000", 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121014 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168552 5.e 5:75200abc:::benchmark_data_smithi062_23645_object33443:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.448 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.401763+0000", 2024-09-12T18:14:57.449 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001947502, 2024-09-12T18:14:57.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00252557, 2024-09-12T18:14:57.449 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.449 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.449 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168552 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401763+0000", 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401763+0000", 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401764+0000", 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401767+0000", 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.658e-06 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401775+0000", 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1519999999999992e-06 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401780+0000", 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7840000000000003e-06 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401829+0000", 2024-09-12T18:14:57.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9181999999999998e-05 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401935+0000", 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105115 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:168551 5.7 e58/21 5:e763febb:::benchmark_data_smithi062_23645_object33442:head v 58'10418, mlcod=58'10416)", 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.401800+0000", 2024-09-12T18:14:57.453 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0019107410000000001, 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025396809999999998, 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401800+0000", 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401800+0000", 2024-09-12T18:14:57.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401800+0000", 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1800000000000005e-07 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401807+0000", 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401819+0000", 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1558e-05 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401826+0000", 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.939e-06 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401880+0000", 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4512999999999998e-05 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401892+0000", 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1355999999999999e-05 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168553 5.1 5:82aab84d:::benchmark_data_smithi062_23645_object33444:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.401843+0000", 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001867039, 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025431009999999999, 2024-09-12T18:14:57.457 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168553 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401843+0000", 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401843+0000", 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401844+0000", 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1600000000000001e-07 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401846+0000", 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-09-12T18:14:57.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401851+0000", 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2859999999999999e-06 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401856+0000", 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6269999999999999e-06 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403466+0000", 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016104839999999999 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403588+0000", 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121422 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.403706+0000", 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118208 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.461 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168554 5.4 5:2c922cd0:::benchmark_data_smithi062_23645_object33445:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.401982+0000", 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001727992, 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024614319999999999, 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.462 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168554 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401982+0000", 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401982+0000", 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401983+0000", 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8299999999999997e-07 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401986+0000", 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8990000000000001e-06 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401994+0000", 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8800000000000008e-06 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.401999+0000", 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5960000000000003e-06 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.404404+0000", 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024051670000000002 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.465 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168555 5.0 5:04d1cdf0:::benchmark_data_smithi062_23645_object33446:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.402062+0000", 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0016481239999999999, 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024295100000000002, 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168555 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402062+0000", 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402062+0000", 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402063+0000", 2024-09-12T18:14:57.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7899999999999998e-07 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402065+0000", 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402073+0000", 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7659999999999998e-06 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402078+0000", 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2839999999999997e-06 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402608+0000", 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052963900000000004 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402729+0000", 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012043499999999999 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.469 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168534 5.c 5:39df758b:::benchmark_data_smithi062_23645_object33425:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.394398+0000", 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0093122350000000003, 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01015054, 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168534 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394398+0000", 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394398+0000", 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394399+0000", 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0020000000000001e-06 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394403+0000", 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7759999999999999e-06 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394411+0000", 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4530000000000002e-06 2024-09-12T18:14:57.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394418+0000", 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7170000000000002e-06 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394470+0000", 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2351000000000001e-05 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394601+0000", 2024-09-12T18:14:57.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013113900000000001 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.394712+0000", 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110679 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402581+0000", 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.007869203 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.474 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168556 5.c 5:3d90da56:::benchmark_data_smithi062_23645_object33447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.402258+0000", 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001452577, 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023524819999999999, 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168556 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402258+0000", 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402258+0000", 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402258+0000", 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8400000000000004e-07 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402261+0000", 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.65e-06 2024-09-12T18:14:57.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402270+0000", 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2289999999999992e-06 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.402275+0000", 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2900000000000002e-06 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.404431+0000", 2024-09-12T18:14:57.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021559159999999999 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.404553+0000", 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012144199999999999 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 18 2024-09-12T18:14:57.479 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:57.481 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:57.477+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:57.481 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:57.581 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:57.577+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:57.682 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:57.682 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:14:57.682 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:14:57.682 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:14:57.682 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:57.683 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:57.677+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:57.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:57.783 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:57.778+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:57.860 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:14:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:14:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:14:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:14:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.604660903999999, 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:14:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:14:57.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:14:57.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.603728392000001, 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.870 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:14:57.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:14:57.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.603627930000002, 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:14:57.877 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:14:57.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:14:57.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:14:57.883 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7417426579999997, 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:57.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:14:57.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7283415509999998, 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.890 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:14:57.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:57.895 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7217678690000007, 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:14:57.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.900 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7216559539999992, 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:14:57.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:14:57.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.905 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7157670080000003, 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.906 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:14:57.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.910 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7141574070000001, 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.911 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:14:57.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:14:57.915 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6928297059999995, 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.916 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:14:57.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168096 5.3 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.166965+0000", 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69103054500000005, 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.059680915000000001, 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168096 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166965+0000", 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166965+0000", 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166966+0000", 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1800000000000005e-07 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166968+0000", 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4619999999999999e-06 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166978+0000", 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6949999999999995e-06 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166983+0000", 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0509999999999996e-06 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168768+0000", 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001784454 2024-09-12T18:14:57.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168845+0000", 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7136000000000001e-05 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168910+0000", 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4763000000000003e-05 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171369+0000", 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024596179999999998 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226475+0000", 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055105358 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226519+0000", 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4829000000000001e-05 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226646+0000", 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012683099999999999 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168099 5.2 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.168633+0000", 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.68936308099999999, 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.058126749999999998, 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.927 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168099 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168633+0000", 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168633+0000", 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168634+0000", 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.049e-06 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168638+0000", 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2640000000000002e-06 2024-09-12T18:14:57.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168649+0000", 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0611999999999999e-05 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168655+0000", 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7719999999999997e-06 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169747+0000", 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001091091 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169811+0000", 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4468999999999995e-05 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169868+0000", 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7352999999999998e-05 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173287+0000", 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034181599999999999 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226604+0000", 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053317788999999997 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226694+0000", 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9248999999999999e-05 2024-09-12T18:14:57.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226759+0000", 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5942e-05 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168101 5.3 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.169660+0000", 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.688336218, 2024-09-12T18:14:57.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.059397410999999997, 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168101 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169660+0000", 2024-09-12T18:14:57.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169660+0000", 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169661+0000", 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4499999999999995e-07 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169665+0000", 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0130000000000004e-06 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169675+0000", 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0329000000000001e-05 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169682+0000", 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.691e-06 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170052+0000", 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0003701 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170159+0000", 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010710299999999999 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170284+0000", 2024-09-12T18:14:57.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125167 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173158+0000", 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002873881 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.228884+0000", 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055726502999999997 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.228961+0000", 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6922999999999995e-05 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229057+0000", 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5755999999999996e-05 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168102 5.1 5:80e4cf92:::benchmark_data_smithi062_23645_object32993:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.68819509599999995, 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.058117533999999998, 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168102 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:14:57.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169805+0000", 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7179999999999998e-06 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169814+0000", 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7409999999999998e-06 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169820+0000", 2024-09-12T18:14:57.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9699999999999996e-06 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.172640+0000", 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028201680000000001 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.172918+0000", 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027845700000000002 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173035+0000", 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116613 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.176709+0000", 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036744439999999998 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227815+0000", 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051105659999999997 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227869+0000", 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.435e-05 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227918+0000", 2024-09-12T18:14:57.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8801000000000003e-05 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168104 5.2 5:4dec6130:::benchmark_data_smithi062_23645_object32995:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.68775623699999999, 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.059033397000000001, 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.946 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168104 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.947 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4600000000000003e-07 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170244+0000", 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3950000000000001e-06 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170252+0000", 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5450000000000003e-06 2024-09-12T18:14:57.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170258+0000", 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2700000000000004e-06 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171128+0000", 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087003799999999995 2024-09-12T18:14:57.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171228+0000", 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100494 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171289+0000", 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0585999999999999e-05 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173525+0000", 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002236535 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229158+0000", 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055632216999999998 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229222+0000", 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4144000000000001e-05 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229273+0000", 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1326999999999998e-05 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168107 5.c 5:3fc50a68:::benchmark_data_smithi062_23645_object32998:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.686483713, 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.056405869999999997, 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.953 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168107 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7599999999999998e-07 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171514+0000", 2024-09-12T18:14:57.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8759999999999999e-06 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171524+0000", 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6090000000000007e-06 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171527+0000", 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3900000000000002e-06 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171564+0000", 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6819000000000001e-05 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171666+0000", 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101671 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171770+0000", 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104308 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174344+0000", 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002573728 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227798+0000", 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053454462000000001 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227846+0000", 2024-09-12T18:14:57.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7271999999999997e-05 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227918+0000", 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2459000000000005e-05 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168109 5.3 5:c1cd4c10:::benchmark_data_smithi062_23645_object33000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.68641598999999998, 2024-09-12T18:14:57.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.057955781999999997, 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168109 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.37e-07 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171583+0000", 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.83e-06 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171592+0000", 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5320000000000006e-06 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171597+0000", 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.887e-06 2024-09-12T18:14:57.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171639+0000", 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2221000000000001e-05 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171743+0000", 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010401 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171853+0000", 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109687 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174322+0000", 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002469794 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229137+0000", 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054814401999999998 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229406+0000", 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000268681 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229536+0000", 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013010100000000001 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.965 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168112 5.3 5:ced8fad0:::benchmark_data_smithi062_23645_object33003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.174728+0000", 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.68326735999999999, 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.056536131000000003, 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168112 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174728+0000", 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174728+0000", 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174729+0000", 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3699999999999999e-07 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174734+0000", 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5109999999999997e-06 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174747+0000", 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174755+0000", 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4089999999999997e-06 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174793+0000", 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174862+0000", 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9220999999999993e-05 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174927+0000", 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4605999999999998e-05 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177046+0000", 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021195720000000001 2024-09-12T18:14:57.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.231092+0000", 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054045779000000002 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.231170+0000", 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8228999999999999e-05 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.231265+0000", 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4215000000000005e-05 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168113 5.5 5:a9b73708:::benchmark_data_smithi062_23645_object33004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.174770+0000", 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.68322558799999999, 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054411152999999997, 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168113 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174770+0000", 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174770+0000", 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174771+0000", 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.06e-07 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174773+0000", 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5110000000000002e-06 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174780+0000", 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7599999999999997e-06 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174786+0000", 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0759999999999999e-06 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174839+0000", 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2580000000000001e-05 2024-09-12T18:14:57.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174996+0000", 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000157381 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.175160+0000", 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016406 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177320+0000", 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002160389 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229074+0000", 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051753929999999997 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229128+0000", 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229181+0000", 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3078000000000002e-05 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168116 5.5 5:a12d9f14:::benchmark_data_smithi062_23645_object33007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:57.978 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.680332245, 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051700232999999998, 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168116 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8100000000000003e-07 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177667+0000", 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2449999999999998e-06 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177676+0000", 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1550000000000007e-06 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177681+0000", 2024-09-12T18:14:57.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7570000000000001e-06 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177717+0000", 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.523e-05 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177790+0000", 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2966000000000006e-05 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:14:57.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177848+0000", 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8307999999999998e-05 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.179863+0000", 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020150530000000002 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229234+0000", 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.049371203000000002 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229308+0000", 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3918999999999995e-05 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229364+0000", 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5816000000000002e-05 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:14:57.984 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:14:57.986 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:57.986 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:57.982+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:58.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:14:58.086 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.085+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:58.143 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:14:58.143 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:14:58.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.144 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170455 5.9 5:9aeaaac1:::benchmark_data_smithi062_23645_object35346:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.144 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.141876+0000", 2024-09-12T18:14:58.144 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001557122, 2024-09-12T18:14:58.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001582218, 2024-09-12T18:14:58.144 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.145 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.145 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:58.145 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.145 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.145 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.145 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170455 2024-09-12T18:14:58.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.146 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141876+0000", 2024-09-12T18:14:58.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141876+0000", 2024-09-12T18:14:58.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141877+0000", 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.252e-06 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141882+0000", 2024-09-12T18:14:58.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6249999999999998e-06 2024-09-12T18:14:58.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141893+0000", 2024-09-12T18:14:58.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1123e-05 2024-09-12T18:14:58.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141900+0000", 2024-09-12T18:14:58.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0929999999999997e-06 2024-09-12T18:14:58.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142900+0000", 2024-09-12T18:14:58.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00100051 2024-09-12T18:14:58.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143013+0000", 2024-09-12T18:14:58.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011299899999999999 2024-09-12T18:14:58.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:58.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143082+0000", 2024-09-12T18:14:58.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9034000000000003e-05 2024-09-12T18:14:58.155 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.155 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.155 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.156 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170458 5.9 5.9ade0a29 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.156 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.141913+0000", 2024-09-12T18:14:58.157 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0015200540000000001, 2024-09-12T18:14:58.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016117530000000001, 2024-09-12T18:14:58.157 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.157 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.157 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:14:58.158 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.158 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.158 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.159 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170458 2024-09-12T18:14:58.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.159 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141913+0000", 2024-09-12T18:14:58.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141913+0000", 2024-09-12T18:14:58.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141913+0000", 2024-09-12T18:14:58.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9399999999999995e-07 2024-09-12T18:14:58.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141916+0000", 2024-09-12T18:14:58.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5780000000000001e-06 2024-09-12T18:14:58.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141930+0000", 2024-09-12T18:14:58.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4472e-05 2024-09-12T18:14:58.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141937+0000", 2024-09-12T18:14:58.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3770000000000001e-06 2024-09-12T18:14:58.166 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.166 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.166 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.167 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:170454 5.1 e58/49 5:82624678:::benchmark_data_smithi062_23645_object35345:head v 58'10625, mlcod=58'10623)", 2024-09-12T18:14:58.167 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.142222+0000", 2024-09-12T18:14:58.167 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0012113409999999999, 2024-09-12T18:14:58.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001352544, 2024-09-12T18:14:58.168 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.168 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.168 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:58.169 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142222+0000", 2024-09-12T18:14:58.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142222+0000", 2024-09-12T18:14:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142222+0000", 2024-09-12T18:14:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9799999999999999e-07 2024-09-12T18:14:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142235+0000", 2024-09-12T18:14:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3274e-05 2024-09-12T18:14:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142243+0000", 2024-09-12T18:14:58.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6229999999999997e-06 2024-09-12T18:14:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142248+0000", 2024-09-12T18:14:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0560000000000004e-06 2024-09-12T18:14:58.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142738+0000", 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00049000499999999995 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142757+0000", 2024-09-12T18:14:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8841000000000001e-05 2024-09-12T18:14:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:170456 5.5 e58/21 5:a1a4b7d4:::benchmark_data_smithi062_23645_object35347:head v 58'10841, mlcod=58'10839)", 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.142257+0000", 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001176159, 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001366499, 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.177 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142257+0000", 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142257+0000", 2024-09-12T18:14:58.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142257+0000", 2024-09-12T18:14:58.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5400000000000002e-07 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142259+0000", 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9460000000000001e-06 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142262+0000", 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2499999999999998e-06 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142265+0000", 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5809999999999999e-06 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142308+0000", 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3069999999999999e-05 2024-09-12T18:14:58.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142319+0000", 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1542000000000001e-05 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:170460 5.6 e58/53 5:6c8ac51f:::benchmark_data_smithi062_23645_object35351:head v 58'10635, mlcod=58'10633)", 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.143504+0000", 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.999929, 2024-09-12T18:14:58.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017730900000000001, 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143504+0000", 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143504+0000", 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143505+0000", 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1600000000000001e-07 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143510+0000", 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0660000000000003e-06 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143521+0000", 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1041e-05 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143527+0000", 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3409999999999999e-06 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143601+0000", 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3978000000000002e-05 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143626+0000", 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5361999999999999e-05 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170443 5.d 5:b2c8dea4:::benchmark_data_smithi062_23645_object35334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.138138+0000", 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0052951780000000002, 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0055993090000000002, 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.186 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170443 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138138+0000", 2024-09-12T18:14:58.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138138+0000", 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138139+0000", 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1149999999999999e-06 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138143+0000", 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8979999999999998e-06 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138152+0000", 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5650000000000007e-06 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138159+0000", 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2369999999999997e-06 2024-09-12T18:14:58.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138197+0000", 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8078999999999999e-05 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138282+0000", 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5595999999999998e-05 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143681+0000", 2024-09-12T18:14:58.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053988380000000004 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.143744+0000", 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2429999999999997e-05 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170444 5.7 5:e6171586:::benchmark_data_smithi062_23645_object35335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.138175+0000", 2024-09-12T18:14:58.191 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0052580439999999999, 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0056335020000000003, 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170444 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138175+0000", 2024-09-12T18:14:58.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138175+0000", 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138175+0000", 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2899999999999999e-07 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138178+0000", 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2620000000000001e-06 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138184+0000", 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3369999999999996e-06 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138189+0000", 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138317+0000", 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012825 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138423+0000", 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000106366 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138546+0000", 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000122397 2024-09-12T18:14:58.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142012+0000", 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0034659669999999999 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170447 5.d 5:bd114d3c:::benchmark_data_smithi062_23645_object35338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.138362+0000", 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0050713679999999997, 2024-09-12T18:14:58.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0055277360000000001, 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170447 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138362+0000", 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138362+0000", 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138362+0000", 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0500000000000002e-07 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138367+0000", 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0450000000000002e-06 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138373+0000", 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8789999999999997e-06 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138378+0000", 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4769999999999997e-06 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141708+0000", 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033303289999999999 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.141850+0000", 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014173000000000001 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170449 5.9 5:954be97d:::benchmark_data_smithi062_23645_object35340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.138475+0000", 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004957665, 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005456359, 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170449 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.201 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138475+0000", 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138475+0000", 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138476+0000", 2024-09-12T18:14:58.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3e-07 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138478+0000", 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.334e-06 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138484+0000", 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3689999999999998e-06 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138487+0000", 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.478e-06 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138536+0000", 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9344000000000001e-05 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138667+0000", 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013034 2024-09-12T18:14:58.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138747+0000", 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0688999999999999e-05 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170450 5.7 5:ea2893e4:::benchmark_data_smithi062_23645_object35341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.138498+0000", 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049354170000000001, 2024-09-12T18:14:58.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0054773840000000001, 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170450 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138498+0000", 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138498+0000", 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138498+0000", 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9799999999999999e-07 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138500+0000", 2024-09-12T18:14:58.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138506+0000", 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2249999999999997e-06 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138511+0000", 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8720000000000001e-06 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.140454+0000", 2024-09-12T18:14:58.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019429989999999999 2024-09-12T18:14:58.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.140545+0000", 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0875e-05 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.140611+0000", 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5931000000000003e-05 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:14:58.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.142283+0000", 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016724439999999999 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:170451 5.9 5:9d73a0fb:::benchmark_data_smithi062_23645_object35342:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:58.138520+0000", 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049130909999999996, 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005525655, 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:14:58.214 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 170451 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138520+0000", 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138520+0000", 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138520+0000", 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.06e-07 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138523+0000", 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0530000000000001e-06 2024-09-12T18:14:58.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138529+0000", 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0229999999999998e-06 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.138533+0000", 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5889999999999996e-06 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.140458+0000", 2024-09-12T18:14:58.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019244729999999999 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.140612+0000", 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015459299999999999 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:58.140755+0000", 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000142361 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:14:58.218 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.219 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:14:58.219 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:14:58.219 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 11 2024-09-12T18:14:58.219 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:14:58.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:14:58.220 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:14:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:14:58.221 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:14:58.222 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:14:58.222 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:58.222 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.217+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:58.223 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:14:58.223 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:14:58.223 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:14:58.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-09-12T18:14:58.321 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:58.314+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:58.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:14:58.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:14:58.376 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:14:58.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:14:58.421 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:58.422 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:58.422 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.417+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:58.442 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:58.534 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.533+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:58.626 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:58.618+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:58.643 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:58.643 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:58.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:58.696 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 58, 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-09-12T18:13:00.942825+0000", 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-09-12T18:14:56.163185+0000", 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-09-12T18:14:27.958747+0000", 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-09-12T18:13:01.815814+0000", 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5804032, 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-09-12T18:14:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: "nodeep-scrub", 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-09-12T18:14:58.698 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 5, 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:10.380891+0000", 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:58.699 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:58.700 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:58.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:58.702 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:58.703 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:58.704 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-09-12T18:14:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 3.0299999713897705, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 3.0299999713897705, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.8268280029296875, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.82999998331069946, 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-12T18:14:58.706 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:16.182185+0000", 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 8193, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:58.707 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:58.708 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:58.709 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 2, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 15, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:58.710 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:58.711 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.4900000095367432, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.4900000095367432, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.8268280029296875, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.82999998331069946, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:20.398999+0000", 2024-09-12T18:14:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-09-12T18:14:58.714 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "18", 2024-09-12T18:14:58.715 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:58.716 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.717 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:58.718 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:58.718 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:58.718 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:58.718 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:58.718 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:14:58.721 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.2400000095367432, 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.2400000095367432, 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-09-12T18:14:58.722 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.8268280029296875, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.82999998331069946, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:21.732662+0000", 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:58.723 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-09-12T18:14:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:58.725 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:58.726 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:58.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:14:58.728 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.4300000667572021, 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.4300000667572021, 2024-09-12T18:14:58.729 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.8268280029296875, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.82999998331069946, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 5, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:38.126670+0000", 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:14:58.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 16, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 16, 2024-09-12T18:14:58.731 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 16, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 16, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 16, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "23", 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:14:58.732 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:14:58.733 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.734 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:14:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: "rados": {} 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.2400000095367432, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.6099998950958252, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.75, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.8268280029296875, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.82999998331069946, 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.82999998331069946 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "d5348027-f4dc-457f-8b4e-a4341015d874", 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 0, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:58.737 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 26, 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 43, 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6800", 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6801", 2024-09-12T18:14:58.738 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6802", 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6803", 2024-09-12T18:14:58.739 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6806", 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6807", 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6804", 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.741 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6805", 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.129:6801/1368744816", 2024-09-12T18:14:58.742 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.129:6803/1368744816", 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.129:6807/1368744816", 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.129:6805/1368744816", 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "exists" 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "939481c0-5bf6-4136-b772-e0ba4c215bf1", 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 55, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.744 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6800", 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6801", 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6802", 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6803", 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6806", 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6807", 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6804", 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6805", 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.151:6801/1445669154", 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.151:6803/1445669154", 2024-09-12T18:14:58.748 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.151:6807/1445669154", 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.151:6805/1445669154", 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "66fc0ac1-f14f-48bf-a557-110b23bff1d2", 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 0.4669189453125, 2024-09-12T18:14:58.749 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 0.4804840087890625, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 54, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6800", 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6801", 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.751 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6802", 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6803", 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.752 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6806", 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6807", 2024-09-12T18:14:58.753 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6804", 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6805", 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.176:6801/752868242", 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.176:6803/752868242", 2024-09-12T18:14:58.755 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.176:6807/752868242", 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.176:6805/752868242", 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:58.756 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.730957+0000", 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 42 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:58.757 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.793073+0000", 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.762001+0000", 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:14:58.758 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [ 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "1.0", 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.759 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.0", 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1", 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.760 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.6", 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.b", 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.d", 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.e", 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.11", 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.16", 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.17", 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.19", 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.764 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1b", 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1c", 2024-09-12T18:14:58.765 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1f", 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.0", 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1", 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.2", 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.3", 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.768 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.a", 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.b", 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.769 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.c", 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.d", 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.e", 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.13", 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.771 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1a", 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1b", 2024-09-12T18:14:58.772 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1d", 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1e", 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.25", 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.27", 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.29", 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.775 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.2b", 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.31", 2024-09-12T18:14:58.776 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.38", 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.777 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.3", 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.6", 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.778 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.9", 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.c", 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.f", 2024-09-12T18:14:58.779 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-09-12T18:14:58.780 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:14:58.781 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-09-12T18:14:58.782 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:14:58.782 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:14:58.784 INFO:tasks.thrashosds.thrasher:j is {'epoch': 58, 'fsid': '5c1106a1-8b30-400f-94eb-0bea28eb5927', 'created': '2024-09-12T18:13:00.942825+0000', 'modified': '2024-09-12T18:14:56.163185+0000', 'last_up_change': '2024-09-12T18:14:27.958747+0000', 'last_in_change': '2024-09-12T18:13:01.815814+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:13:10.380891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8268280029296875, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:13:16.182185+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8268280029296875, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:13:20.398999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8268280029296875, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:13:21.732662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.430000066757202, 'score_stable': 2.430000066757202, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 0.8268280029296875, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.8299999833106995}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:13:38.126670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.609999895095825, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8268280029296875, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.8299999833106995}}], 'osds': [{'osd': 0, 'uuid': 'd5348027-f4dc-457f-8b4e-a4341015d874', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 43, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 1368744816}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 1368744816}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 1368744816}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 1368744816}]}, 'public_addr': '172.21.15.129:6801/1368744816', 'cluster_addr': '172.21.15.129:6803/1368744816', 'heartbeat_back_addr': '172.21.15.129:6807/1368744816', 'heartbeat_front_addr': '172.21.15.129:6805/1368744816', 'state': ['exists']}, {'osd': 1, 'uuid': '939481c0-5bf6-4136-b772-e0ba4c215bf1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 55, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 1445669154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 1445669154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 1445669154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 1445669154}]}, 'public_addr': '172.21.15.151:6801/1445669154', 'cluster_addr': '172.21.15.151:6803/1445669154', 'heartbeat_back_addr': '172.21.15.151:6807/1445669154', 'heartbeat_front_addr': '172.21.15.151:6805/1445669154', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '66fc0ac1-f14f-48bf-a557-110b23bff1d2', 'up': 1, 'in': 1, 'weight': 0.4669189453125, 'primary_affinity': 0.4804840087890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 54, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6800', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6801', 'nonce': 752868242}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6802', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6803', 'nonce': 752868242}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6806', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6807', 'nonce': 752868242}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6804', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6805', 'nonce': 752868242}]}, 'public_addr': '172.21.15.176:6801/752868242', 'cluster_addr': '172.21.15.176:6803/752868242', 'heartbeat_back_addr': '172.21.15.176:6807/752868242', 'heartbeat_front_addr': '172.21.15.176:6805/752868242', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.730957+0000', 'dead_epoch': 42}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.793073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.762001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '1.0', 'osds': [1, 2]}, {'pgid': '3.0', 'osds': [1, 2]}, {'pgid': '3.1', 'osds': [1, 2]}, {'pgid': '3.6', 'osds': [1, 2]}, {'pgid': '3.b', 'osds': [1, 2]}, {'pgid': '3.d', 'osds': [1, 2]}, {'pgid': '3.e', 'osds': [1, 2]}, {'pgid': '3.11', 'osds': [1, 2]}, {'pgid': '3.16', 'osds': [1, 2]}, {'pgid': '3.17', 'osds': [1, 2]}, {'pgid': '3.19', 'osds': [1, 2]}, {'pgid': '3.1b', 'osds': [1, 2]}, {'pgid': '3.1c', 'osds': [1, 2]}, {'pgid': '3.1f', 'osds': [1, 2]}, {'pgid': '4.0', 'osds': [1, 2]}, {'pgid': '4.1', 'osds': [1, 2]}, {'pgid': '4.2', 'osds': [1, 2]}, {'pgid': '4.3', 'osds': [1, 2]}, {'pgid': '4.a', 'osds': [1, 2]}, {'pgid': '4.b', 'osds': [1, 2]}, {'pgid': '4.c', 'osds': [1, 2]}, {'pgid': '4.d', 'osds': [1, 2]}, {'pgid': '4.e', 'osds': [1, 2]}, {'pgid': '4.13', 'osds': [1, 2]}, {'pgid': '4.1a', 'osds': [1, 2]}, {'pgid': '4.1b', 'osds': [1, 2]}, {'pgid': '4.1d', 'osds': [1, 2]}, {'pgid': '4.1e', 'osds': [1, 2]}, {'pgid': '4.25', 'osds': [1, 2]}, {'pgid': '4.27', 'osds': [1, 2]}, {'pgid': '4.29', 'osds': [1, 2]}, {'pgid': '4.2b', 'osds': [1, 2]}, {'pgid': '4.31', 'osds': [1, 2]}, {'pgid': '4.38', 'osds': [1, 2]}, {'pgid': '5.3', 'osds': [1, 2]}, {'pgid': '5.6', 'osds': [1, 2]}, {'pgid': '5.9', 'osds': [2]}, {'pgid': '5.c', 'osds': [1, 2]}, {'pgid': '5.f', 'osds': [2]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:14:58.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:14:58.785 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.781+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:58.825 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:58.825 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:58.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:58.883 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.881+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:58.984 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:58.981+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.002 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:59.002 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:59.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:14:59.085 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:59.081+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:14:59.108 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:14:59.121 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-12T18:14:58.368527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6966152117,"num_objects":106313,"num_object_clones":0,"num_object_copies":212626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59241,"num_objects_misplaced":33193,"num_objects_unfound":0,"num_objects_dirty":106313,"num_whiteouts":0,"num_read":87,"num_read_kb":74,"num_write":164119,"num_write_kb":8649473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":774,"num_bytes_recovered":50791014,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50627,"ondisk_log_size":50627,"up":145,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1369952,"kb_used_data":857124,"kb_used_omap":4,"kb_used_meta":512763,"kb_avail":281745568,"statfs":{"total":289910292480,"available":288507461632,"internally_reserved":0,"allocated":877694976,"data_stored":14014806741,"data_compressed":12047444,"data_compressed_allocated":875884544,"data_compressed_original":14014119936,"omap_allocated":4785,"internal_metadata":525069647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,5,2,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-772931584,"num_objects":-11794,"num_object_clones":0,"num_object_copies":-23588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-7279,"num_objects_misplaced":-3724,"num_objects_unfound":0,"num_objects_dirty":-11794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11794,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":735,"num_bytes_recovered":48168960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.639007"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163792+0000","last_change":"2024-09-12T18:14:28.991575+0000","last_active":"2024-09-12T18:14:53.163792+0000","last_peered":"2024-09-12T18:14:53.163792+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.991575+0000","last_became_peered":"2024-09-12T18:14:28.991575+0000","last_unstale":"2024-09-12T18:14:53.163792+0000","last_undegraded":"2024-09-12T18:14:53.163792+0000","last_fullsized":"2024-09-12T18:14:28.986867+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:11.318507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.167270+0000","last_change":"2024-09-12T18:14:28.985875+0000","last_active":"2024-09-12T18:14:53.167270+0000","last_peered":"2024-09-12T18:14:53.167270+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.985875+0000","last_became_peered":"2024-09-12T18:14:28.985875+0000","last_unstale":"2024-09-12T18:14:53.167270+0000","last_undegraded":"2024-09-12T18:14:53.167270+0000","last_fullsized":"2024-09-12T18:14:28.983086+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:32.772807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162456+0000","last_change":"2024-09-12T18:14:29.006849+0000","last_active":"2024-09-12T18:14:53.162456+0000","last_peered":"2024-09-12T18:14:53.162456+0000","last_clean":"2024-09-12T18:14:26.967529+0000","last_became_active":"2024-09-12T18:14:29.006849+0000","last_became_peered":"2024-09-12T18:14:29.006849+0000","last_unstale":"2024-09-12T18:14:53.162456+0000","last_undegraded":"2024-09-12T18:14:53.162456+0000","last_fullsized":"2024-09-12T18:14:28.985692+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.068034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.161922+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:14:53.161922+0000","last_peered":"2024-09-12T18:14:53.161922+0000","last_clean":"2024-09-12T18:14:53.161922+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:14:53.161922+0000","last_undegraded":"2024-09-12T18:14:53.161922+0000","last_fullsized":"2024-09-12T18:14:53.161922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.170689+0000","last_change":"2024-09-12T18:14:28.999716+0000","last_active":"2024-09-12T18:14:53.170689+0000","last_peered":"2024-09-12T18:14:53.170689+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.999716+0000","last_became_peered":"2024-09-12T18:14:28.999716+0000","last_unstale":"2024-09-12T18:14:53.170689+0000","last_undegraded":"2024-09-12T18:14:53.170689+0000","last_fullsized":"2024-09-12T18:14:28.985087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.637057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.166505+0000","last_change":"2024-09-12T18:14:43.091871+0000","last_active":"2024-09-12T18:14:53.166505+0000","last_peered":"2024-09-12T18:14:53.166505+0000","last_clean":"2024-09-12T18:14:53.166505+0000","last_became_active":"2024-09-12T18:14:43.088851+0000","last_became_peered":"2024-09-12T18:14:43.088851+0000","last_unstale":"2024-09-12T18:14:53.166505+0000","last_undegraded":"2024-09-12T18:14:53.166505+0000","last_fullsized":"2024-09-12T18:14:53.166505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.534130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.163697+0000","last_change":"2024-09-12T18:14:43.092087+0000","last_active":"2024-09-12T18:14:53.163697+0000","last_peered":"2024-09-12T18:14:53.163697+0000","last_clean":"2024-09-12T18:14:53.163697+0000","last_became_active":"2024-09-12T18:14:43.089409+0000","last_became_peered":"2024-09-12T18:14:43.089409+0000","last_unstale":"2024-09-12T18:14:53.163697+0000","last_undegraded":"2024-09-12T18:14:53.163697+0000","last_fullsized":"2024-09-12T18:14:53.163697+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.981162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163009+0000","last_change":"2024-09-12T18:14:50.153022+0000","last_active":"2024-09-12T18:14:53.163009+0000","last_peered":"2024-09-12T18:14:53.163009+0000","last_clean":"2024-09-12T18:14:53.163009+0000","last_became_active":"2024-09-12T18:14:50.148389+0000","last_became_peered":"2024-09-12T18:14:50.148389+0000","last_unstale":"2024-09-12T18:14:53.163009+0000","last_undegraded":"2024-09-12T18:14:53.163009+0000","last_fullsized":"2024-09-12T18:14:53.163009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:33.427407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163006+0000","last_change":"2024-09-12T18:14:28.988500+0000","last_active":"2024-09-12T18:14:53.163006+0000","last_peered":"2024-09-12T18:14:53.163006+0000","last_clean":"2024-09-12T18:14:26.965869+0000","last_became_active":"2024-09-12T18:14:28.988500+0000","last_became_peered":"2024-09-12T18:14:28.988500+0000","last_unstale":"2024-09-12T18:14:53.163006+0000","last_undegraded":"2024-09-12T18:14:53.163006+0000","last_fullsized":"2024-09-12T18:14:28.983895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:29.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.165832+0000","last_change":"2024-09-12T18:14:29.001601+0000","last_active":"2024-09-12T18:14:53.165832+0000","last_peered":"2024-09-12T18:14:53.165832+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:29.001601+0000","last_became_peered":"2024-09-12T18:14:29.001601+0000","last_unstale":"2024-09-12T18:14:53.165832+0000","last_undegraded":"2024-09-12T18:14:53.165832+0000","last_fullsized":"2024-09-12T18:14:28.983569+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:43.515638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.163010+0000","last_change":"2024-09-12T18:14:43.089717+0000","last_active":"2024-09-12T18:14:53.163010+0000","last_peered":"2024-09-12T18:14:53.163010+0000","last_clean":"2024-09-12T18:14:53.163010+0000","last_became_active":"2024-09-12T18:14:43.088841+0000","last_became_peered":"2024-09-12T18:14:43.088841+0000","last_unstale":"2024-09-12T18:14:53.163010+0000","last_undegraded":"2024-09-12T18:14:53.163010+0000","last_fullsized":"2024-09-12T18:14:53.163010+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.068034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.161684+0000","last_change":"2024-09-12T18:14:28.990013+0000","last_active":"2024-09-12T18:14:53.161684+0000","last_peered":"2024-09-12T18:14:53.161684+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.990013+0000","last_became_peered":"2024-09-12T18:14:28.990013+0000","last_unstale":"2024-09-12T18:14:53.161684+0000","last_undegraded":"2024-09-12T18:14:53.161684+0000","last_fullsized":"2024-09-12T18:14:28.983502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:25.262310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.170670+0000","last_change":"2024-09-12T18:14:28.990334+0000","last_active":"2024-09-12T18:14:53.170670+0000","last_peered":"2024-09-12T18:14:53.170670+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.990334+0000","last_became_peered":"2024-09-12T18:14:28.990334+0000","last_unstale":"2024-09-12T18:14:53.170670+0000","last_undegraded":"2024-09-12T18:14:53.170670+0000","last_fullsized":"2024-09-12T18:14:28.985267+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:47.949899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162187+0000","last_change":"2024-09-12T18:14:28.990979+0000","last_active":"2024-09-12T18:14:53.162187+0000","last_peered":"2024-09-12T18:14:53.162187+0000","last_clean":"2024-09-12T18:14:26.966724+0000","last_became_active":"2024-09-12T18:14:28.990979+0000","last_became_peered":"2024-09-12T18:14:28.990979+0000","last_unstale":"2024-09-12T18:14:53.162187+0000","last_undegraded":"2024-09-12T18:14:53.162187+0000","last_fullsized":"2024-09-12T18:14:28.983213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:41.590912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162263+0000","last_change":"2024-09-12T18:14:50.169405+0000","last_active":"2024-09-12T18:14:53.162263+0000","last_peered":"2024-09-12T18:14:53.162263+0000","last_clean":"2024-09-12T18:14:53.162263+0000","last_became_active":"2024-09-12T18:14:50.168728+0000","last_became_peered":"2024-09-12T18:14:50.168728+0000","last_unstale":"2024-09-12T18:14:53.162263+0000","last_undegraded":"2024-09-12T18:14:53.162263+0000","last_fullsized":"2024-09-12T18:14:53.162263+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:01.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.162918+0000","last_change":"2024-09-12T18:14:43.089479+0000","last_active":"2024-09-12T18:14:53.162918+0000","last_peered":"2024-09-12T18:14:53.162918+0000","last_clean":"2024-09-12T18:14:53.162918+0000","last_became_active":"2024-09-12T18:14:43.088622+0000","last_became_peered":"2024-09-12T18:14:43.088622+0000","last_unstale":"2024-09-12T18:14:53.162918+0000","last_undegraded":"2024-09-12T18:14:53.162918+0000","last_fullsized":"2024-09-12T18:14:53.162918+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:59.550636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.164189+0000","last_change":"2024-09-12T18:14:28.991226+0000","last_active":"2024-09-12T18:14:53.164189+0000","last_peered":"2024-09-12T18:14:53.164189+0000","last_clean":"2024-09-12T18:14:26.966274+0000","last_became_active":"2024-09-12T18:14:28.991226+0000","last_became_peered":"2024-09-12T18:14:28.991226+0000","last_unstale":"2024-09-12T18:14:53.164189+0000","last_undegraded":"2024-09-12T18:14:53.164189+0000","last_fullsized":"2024-09-12T18:14:28.987101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.165246+0000","last_change":"2024-09-12T18:14:29.001937+0000","last_active":"2024-09-12T18:14:53.165246+0000","last_peered":"2024-09-12T18:14:53.165246+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:29.001937+0000","last_became_peered":"2024-09-12T18:14:29.001937+0000","last_unstale":"2024-09-12T18:14:53.165246+0000","last_undegraded":"2024-09-12T18:14:53.165246+0000","last_fullsized":"2024-09-12T18:14:28.984391+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:43.301906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163195+0000","last_change":"2024-09-12T18:14:28.988751+0000","last_active":"2024-09-12T18:14:53.163195+0000","last_peered":"2024-09-12T18:14:53.163195+0000","last_clean":"2024-09-12T18:14:26.964977+0000","last_became_active":"2024-09-12T18:14:28.988751+0000","last_became_peered":"2024-09-12T18:14:28.988751+0000","last_unstale":"2024-09-12T18:14:53.163195+0000","last_undegraded":"2024-09-12T18:14:53.163195+0000","last_fullsized":"2024-09-12T18:14:28.984192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:33.074692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.169660+0000","last_change":"2024-09-12T18:14:43.097711+0000","last_active":"2024-09-12T18:14:53.169660+0000","last_peered":"2024-09-12T18:14:53.169660+0000","last_clean":"2024-09-12T18:14:53.169660+0000","last_became_active":"2024-09-12T18:14:43.095429+0000","last_became_peered":"2024-09-12T18:14:43.095429+0000","last_unstale":"2024-09-12T18:14:53.169660+0000","last_undegraded":"2024-09-12T18:14:53.169660+0000","last_fullsized":"2024-09-12T18:14:53.169660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:55.449555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.167868+0000","last_change":"2024-09-12T18:14:50.158644+0000","last_active":"2024-09-12T18:14:53.167868+0000","last_peered":"2024-09-12T18:14:53.167868+0000","last_clean":"2024-09-12T18:14:53.167868+0000","last_became_active":"2024-09-12T18:14:50.155884+0000","last_became_peered":"2024-09-12T18:14:50.155884+0000","last_unstale":"2024-09-12T18:14:53.167868+0000","last_undegraded":"2024-09-12T18:14:53.167868+0000","last_fullsized":"2024-09-12T18:14:53.167868+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:21.618515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.161573+0000","last_change":"2024-09-12T18:14:28.986176+0000","last_active":"2024-09-12T18:14:53.161573+0000","last_peered":"2024-09-12T18:14:53.161573+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986176+0000","last_became_peered":"2024-09-12T18:14:28.986176+0000","last_unstale":"2024-09-12T18:14:53.161573+0000","last_undegraded":"2024-09-12T18:14:53.161573+0000","last_fullsized":"2024-09-12T18:14:28.982633+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:43.709402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163402+0000","last_change":"2024-09-12T18:14:50.171203+0000","last_active":"2024-09-12T18:14:53.163402+0000","last_peered":"2024-09-12T18:14:53.163402+0000","last_clean":"2024-09-12T18:14:53.163402+0000","last_became_active":"2024-09-12T18:14:50.170030+0000","last_became_peered":"2024-09-12T18:14:50.170030+0000","last_unstale":"2024-09-12T18:14:53.163402+0000","last_undegraded":"2024-09-12T18:14:53.163402+0000","last_fullsized":"2024-09-12T18:14:53.163402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:07.199861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162491+0000","last_change":"2024-09-12T18:14:28.984971+0000","last_active":"2024-09-12T18:14:53.162491+0000","last_peered":"2024-09-12T18:14:53.162491+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.984971+0000","last_became_peered":"2024-09-12T18:14:28.984971+0000","last_unstale":"2024-09-12T18:14:53.162491+0000","last_undegraded":"2024-09-12T18:14:53.162491+0000","last_fullsized":"2024-09-12T18:14:28.981823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:14.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162831+0000","last_change":"2024-09-12T18:14:50.183037+0000","last_active":"2024-09-12T18:14:53.162831+0000","last_peered":"2024-09-12T18:14:53.162831+0000","last_clean":"2024-09-12T18:14:53.162831+0000","last_became_active":"2024-09-12T18:14:50.181893+0000","last_became_peered":"2024-09-12T18:14:50.181893+0000","last_unstale":"2024-09-12T18:14:53.162831+0000","last_undegraded":"2024-09-12T18:14:53.162831+0000","last_fullsized":"2024-09-12T18:14:53.162831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.033823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.165566+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:14:53.165566+0000","last_peered":"2024-09-12T18:14:53.165566+0000","last_clean":"2024-09-12T18:14:53.165566+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:14:53.165566+0000","last_undegraded":"2024-09-12T18:14:53.165566+0000","last_fullsized":"2024-09-12T18:14:53.165566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163343+0000","last_change":"2024-09-12T18:14:50.154905+0000","last_active":"2024-09-12T18:14:53.163343+0000","last_peered":"2024-09-12T18:14:53.163343+0000","last_clean":"2024-09-12T18:14:53.163343+0000","last_became_active":"2024-09-12T18:14:50.152280+0000","last_became_peered":"2024-09-12T18:14:50.152280+0000","last_unstale":"2024-09-12T18:14:53.163343+0000","last_undegraded":"2024-09-12T18:14:53.163343+0000","last_fullsized":"2024-09-12T18:14:53.163343+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.746595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.161705+0000","last_change":"2024-09-12T18:14:28.990141+0000","last_active":"2024-09-12T18:14:53.161705+0000","last_peered":"2024-09-12T18:14:53.161705+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.990141+0000","last_became_peered":"2024-09-12T18:14:28.990141+0000","last_unstale":"2024-09-12T18:14:53.161705+0000","last_undegraded":"2024-09-12T18:14:53.161705+0000","last_fullsized":"2024-09-12T18:14:28.983927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:35.607790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.168151+0000","last_change":"2024-09-12T18:14:28.991634+0000","last_active":"2024-09-12T18:14:53.168151+0000","last_peered":"2024-09-12T18:14:53.168151+0000","last_clean":"2024-09-12T18:14:26.964656+0000","last_became_active":"2024-09-12T18:14:28.991634+0000","last_became_peered":"2024-09-12T18:14:28.991634+0000","last_unstale":"2024-09-12T18:14:53.168151+0000","last_undegraded":"2024-09-12T18:14:53.168151+0000","last_fullsized":"2024-09-12T18:14:28.986517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:25.262310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162059+0000","last_change":"2024-09-12T18:14:28.988633+0000","last_active":"2024-09-12T18:14:53.162059+0000","last_peered":"2024-09-12T18:14:53.162059+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.988633+0000","last_became_peered":"2024-09-12T18:14:28.988633+0000","last_unstale":"2024-09-12T18:14:53.162059+0000","last_undegraded":"2024-09-12T18:14:53.162059+0000","last_fullsized":"2024-09-12T18:14:28.982701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:51.891520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163248+0000","last_change":"2024-09-12T18:14:28.984685+0000","last_active":"2024-09-12T18:14:53.163248+0000","last_peered":"2024-09-12T18:14:53.163248+0000","last_clean":"2024-09-12T18:14:26.964387+0000","last_became_active":"2024-09-12T18:14:28.984685+0000","last_became_peered":"2024-09-12T18:14:28.984685+0000","last_unstale":"2024-09-12T18:14:53.163248+0000","last_undegraded":"2024-09-12T18:14:53.163248+0000","last_fullsized":"2024-09-12T18:14:28.981979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.968501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.161559+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:14:53.161559+0000","last_peered":"2024-09-12T18:14:53.161559+0000","last_clean":"2024-09-12T18:14:53.161559+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:14:53.161559+0000","last_undegraded":"2024-09-12T18:14:53.161559+0000","last_fullsized":"2024-09-12T18:14:53.161559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.166450+0000","last_change":"2024-09-12T18:14:28.986692+0000","last_active":"2024-09-12T18:14:53.166450+0000","last_peered":"2024-09-12T18:14:53.166450+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986692+0000","last_became_peered":"2024-09-12T18:14:28.986692+0000","last_unstale":"2024-09-12T18:14:53.166450+0000","last_undegraded":"2024-09-12T18:14:53.166450+0000","last_fullsized":"2024-09-12T18:14:28.983093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.161963+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:14:53.161963+0000","last_peered":"2024-09-12T18:14:53.161963+0000","last_clean":"2024-09-12T18:14:53.161963+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:14:53.161963+0000","last_undegraded":"2024-09-12T18:14:53.161963+0000","last_fullsized":"2024-09-12T18:14:53.161963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162830+0000","last_change":"2024-09-12T18:14:28.988479+0000","last_active":"2024-09-12T18:14:53.162830+0000","last_peered":"2024-09-12T18:14:53.162830+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.988479+0000","last_became_peered":"2024-09-12T18:14:28.988479+0000","last_unstale":"2024-09-12T18:14:53.162830+0000","last_undegraded":"2024-09-12T18:14:53.162830+0000","last_fullsized":"2024-09-12T18:14:28.983564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:42.780406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.166798+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:14:53.166798+0000","last_peered":"2024-09-12T18:14:53.166798+0000","last_clean":"2024-09-12T18:14:53.166798+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:14:53.166798+0000","last_undegraded":"2024-09-12T18:14:53.166798+0000","last_fullsized":"2024-09-12T18:14:53.166798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.165115+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:14:53.165115+0000","last_peered":"2024-09-12T18:14:53.165115+0000","last_clean":"2024-09-12T18:14:53.165115+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:14:53.165115+0000","last_undegraded":"2024-09-12T18:14:53.165115+0000","last_fullsized":"2024-09-12T18:14:53.165115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163991+0000","last_change":"2024-09-12T18:14:50.183970+0000","last_active":"2024-09-12T18:14:53.163991+0000","last_peered":"2024-09-12T18:14:53.163991+0000","last_clean":"2024-09-12T18:14:53.163991+0000","last_became_active":"2024-09-12T18:14:50.181892+0000","last_became_peered":"2024-09-12T18:14:50.181892+0000","last_unstale":"2024-09-12T18:14:53.163991+0000","last_undegraded":"2024-09-12T18:14:53.163991+0000","last_fullsized":"2024-09-12T18:14:53.163991+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:36.372798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.163193+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:14:53.163193+0000","last_peered":"2024-09-12T18:14:53.163193+0000","last_clean":"2024-09-12T18:14:53.163193+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:14:53.163193+0000","last_undegraded":"2024-09-12T18:14:53.163193+0000","last_fullsized":"2024-09-12T18:14:53.163193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":102,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:53.161578+0000","last_change":"2024-09-12T18:14:28.990705+0000","last_active":"2024-09-12T18:14:53.161578+0000","last_peered":"2024-09-12T18:14:53.161578+0000","last_clean":"2024-09-12T18:14:26.966580+0000","last_became_active":"2024-09-12T18:14:28.990705+0000","last_became_peered":"2024-09-12T18:14:28.990705+0000","last_unstale":"2024-09-12T18:14:53.161578+0000","last_undegraded":"2024-09-12T18:14:28.982812+0000","last_fullsized":"2024-09-12T18:14:28.982612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.599315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"57'10207","reported_seq":11824,"reported_epoch":57,"state":"active+undersized+degraded+remapped+backfilling","last_fresh":"2024-09-12T18:14:55.485743+0000","last_change":"2024-09-12T18:14:50.275038+0000","last_active":"2024-09-12T18:14:55.485743+0000","last_peered":"2024-09-12T18:14:55.485743+0000","last_clean":"2024-09-12T18:14:27.974509+0000","last_became_active":"2024-09-12T18:14:50.260894+0000","last_became_peered":"2024-09-12T18:14:50.260894+0000","last_unstale":"2024-09-12T18:14:55.485743+0000","last_undegraded":"2024-09-12T18:14:50.151797+0000","last_fullsized":"2024-09-12T18:14:50.130906+0000","mapping_epoch":53,"log_start":"41'6500","ondisk_log_start":"41'6500","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3707,"log_dups_size":0,"ondisk_log_size":3707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433913856,"num_objects":6621,"num_object_clones":0,"num_object_copies":13242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5891,"num_objects_misplaced":6621,"num_objects_unfound":0,"num_objects_dirty":6621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10207,"num_write_kb":538496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":766,"num_bytes_recovered":50200576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6621}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":95,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:53.163314+0000","last_change":"2024-09-12T18:14:28.996036+0000","last_active":"2024-09-12T18:14:53.163314+0000","last_peered":"2024-09-12T18:14:53.163314+0000","last_clean":"2024-09-12T18:14:26.967637+0000","last_became_active":"2024-09-12T18:14:28.996036+0000","last_became_peered":"2024-09-12T18:14:28.996036+0000","last_unstale":"2024-09-12T18:14:53.163314+0000","last_undegraded":"2024-09-12T18:14:28.988347+0000","last_fullsized":"2024-09-12T18:14:28.988302+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:09.439841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.161334+0000","last_change":"2024-09-12T18:14:28.983580+0000","last_active":"2024-09-12T18:14:53.161334+0000","last_peered":"2024-09-12T18:14:53.161334+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.983580+0000","last_became_peered":"2024-09-12T18:14:28.983580+0000","last_unstale":"2024-09-12T18:14:53.161334+0000","last_undegraded":"2024-09-12T18:14:53.161334+0000","last_fullsized":"2024-09-12T18:14:28.982025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"57'10286","reported_seq":10370,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.482127+0000","last_change":"2024-09-12T18:14:28.991545+0000","last_active":"2024-09-12T18:14:55.482127+0000","last_peered":"2024-09-12T18:14:55.482127+0000","last_clean":"2024-09-12T18:14:27.943375+0000","last_became_active":"2024-09-12T18:14:28.991545+0000","last_became_peered":"2024-09-12T18:14:28.991545+0000","last_unstale":"2024-09-12T18:14:55.482127+0000","last_undegraded":"2024-09-12T18:14:28.983008+0000","last_fullsized":"2024-09-12T18:14:28.982804+0000","mapping_epoch":43,"log_start":"45'7308","ondisk_log_start":"45'7308","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2978,"log_dups_size":696,"ondisk_log_size":2978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:08.785401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435421184,"num_objects":6644,"num_object_clones":0,"num_object_copies":13288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6644,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10286,"num_write_kb":541760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6644}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":22,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.165206+0000","last_change":"2024-09-12T18:14:50.219915+0000","last_active":"2024-09-12T18:14:53.165206+0000","last_peered":"2024-09-12T18:14:53.165206+0000","last_clean":"2024-09-12T18:14:53.165206+0000","last_became_active":"2024-09-12T18:14:50.154668+0000","last_became_peered":"2024-09-12T18:14:50.154668+0000","last_unstale":"2024-09-12T18:14:53.165206+0000","last_undegraded":"2024-09-12T18:14:53.165206+0000","last_fullsized":"2024-09-12T18:14:53.165206+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:17.043905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162988+0000","last_change":"2024-09-12T18:14:28.986017+0000","last_active":"2024-09-12T18:14:53.162988+0000","last_peered":"2024-09-12T18:14:53.162988+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986017+0000","last_became_peered":"2024-09-12T18:14:28.986017+0000","last_unstale":"2024-09-12T18:14:53.162988+0000","last_undegraded":"2024-09-12T18:14:53.162988+0000","last_fullsized":"2024-09-12T18:14:28.982203+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:50.876261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"57'10086","reported_seq":10170,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.493984+0000","last_change":"2024-09-12T18:14:28.994795+0000","last_active":"2024-09-12T18:14:55.493984+0000","last_peered":"2024-09-12T18:14:55.493984+0000","last_clean":"2024-09-12T18:14:27.957179+0000","last_became_active":"2024-09-12T18:14:28.994795+0000","last_became_peered":"2024-09-12T18:14:28.994795+0000","last_unstale":"2024-09-12T18:14:55.493984+0000","last_undegraded":"2024-09-12T18:14:28.988893+0000","last_fullsized":"2024-09-12T18:14:28.988790+0000","mapping_epoch":43,"log_start":"45'7081","ondisk_log_start":"45'7081","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":696,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:46.707507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422969344,"num_objects":6454,"num_object_clones":0,"num_object_copies":12908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6454,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10086,"num_write_kb":529280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6454}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":22,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162512+0000","last_change":"2024-09-12T18:14:50.225115+0000","last_active":"2024-09-12T18:14:53.162512+0000","last_peered":"2024-09-12T18:14:53.162512+0000","last_clean":"2024-09-12T18:14:53.162512+0000","last_became_active":"2024-09-12T18:14:50.152871+0000","last_became_peered":"2024-09-12T18:14:50.152871+0000","last_unstale":"2024-09-12T18:14:53.162512+0000","last_undegraded":"2024-09-12T18:14:53.162512+0000","last_fullsized":"2024-09-12T18:14:53.162512+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:54.959622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.166866+0000","last_change":"2024-09-12T18:14:50.153445+0000","last_active":"2024-09-12T18:14:53.166866+0000","last_peered":"2024-09-12T18:14:53.166866+0000","last_clean":"2024-09-12T18:14:53.166866+0000","last_became_active":"2024-09-12T18:14:50.150125+0000","last_became_peered":"2024-09-12T18:14:50.150125+0000","last_unstale":"2024-09-12T18:14:53.166866+0000","last_undegraded":"2024-09-12T18:14:53.166866+0000","last_fullsized":"2024-09-12T18:14:53.166866+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.154003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"57'10145","reported_seq":10229,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.487315+0000","last_change":"2024-09-12T18:14:28.990209+0000","last_active":"2024-09-12T18:14:55.487315+0000","last_peered":"2024-09-12T18:14:55.487315+0000","last_clean":"2024-09-12T18:14:27.963737+0000","last_became_active":"2024-09-12T18:14:28.990209+0000","last_became_peered":"2024-09-12T18:14:28.990209+0000","last_unstale":"2024-09-12T18:14:55.487315+0000","last_undegraded":"2024-09-12T18:14:28.982157+0000","last_fullsized":"2024-09-12T18:14:28.981997+0000","mapping_epoch":43,"log_start":"45'7203","ondisk_log_start":"45'7203","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2942,"log_dups_size":696,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:12.511476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438239232,"num_objects":6687,"num_object_clones":0,"num_object_copies":13374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6687,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10145,"num_write_kb":538624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6687}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.169744+0000","last_change":"2024-09-12T18:14:43.096073+0000","last_active":"2024-09-12T18:14:53.169744+0000","last_peered":"2024-09-12T18:14:53.169744+0000","last_clean":"2024-09-12T18:14:53.169744+0000","last_became_active":"2024-09-12T18:14:43.092815+0000","last_became_peered":"2024-09-12T18:14:43.092815+0000","last_unstale":"2024-09-12T18:14:53.169744+0000","last_undegraded":"2024-09-12T18:14:53.169744+0000","last_fullsized":"2024-09-12T18:14:53.169744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.757546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.168014+0000","last_change":"2024-09-12T18:14:50.156851+0000","last_active":"2024-09-12T18:14:53.168014+0000","last_peered":"2024-09-12T18:14:53.168014+0000","last_clean":"2024-09-12T18:14:53.168014+0000","last_became_active":"2024-09-12T18:14:50.154011+0000","last_became_peered":"2024-09-12T18:14:50.154011+0000","last_unstale":"2024-09-12T18:14:53.168014+0000","last_undegraded":"2024-09-12T18:14:53.168014+0000","last_fullsized":"2024-09-12T18:14:53.168014+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:47.047802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"57'10264","reported_seq":10349,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.455560+0000","last_change":"2024-09-12T18:14:28.990067+0000","last_active":"2024-09-12T18:14:55.455560+0000","last_peered":"2024-09-12T18:14:55.455560+0000","last_clean":"2024-09-12T18:14:27.953436+0000","last_became_active":"2024-09-12T18:14:28.990067+0000","last_became_peered":"2024-09-12T18:14:28.990067+0000","last_unstale":"2024-09-12T18:14:55.455560+0000","last_undegraded":"2024-09-12T18:14:28.983735+0000","last_fullsized":"2024-09-12T18:14:28.983614+0000","mapping_epoch":43,"log_start":"41'6545","ondisk_log_start":"41'6545","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:33.488431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437977112,"num_objects":6684,"num_object_clones":0,"num_object_copies":13368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6684,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10264,"num_write_kb":542273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6684}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":98,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.167507+0000","last_change":"2024-09-12T18:14:50.157932+0000","last_active":"2024-09-12T18:14:53.167507+0000","last_peered":"2024-09-12T18:14:53.167507+0000","last_clean":"2024-09-12T18:14:53.167507+0000","last_became_active":"2024-09-12T18:14:50.155849+0000","last_became_peered":"2024-09-12T18:14:50.155849+0000","last_unstale":"2024-09-12T18:14:53.167507+0000","last_undegraded":"2024-09-12T18:14:53.167507+0000","last_fullsized":"2024-09-12T18:14:53.167507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:59.541267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":31,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.169209+0000","last_change":"2024-09-12T18:14:50.149296+0000","last_active":"2024-09-12T18:14:53.169209+0000","last_peered":"2024-09-12T18:14:53.169209+0000","last_clean":"2024-09-12T18:14:53.169209+0000","last_became_active":"2024-09-12T18:14:50.148183+0000","last_became_peered":"2024-09-12T18:14:50.148183+0000","last_unstale":"2024-09-12T18:14:53.169209+0000","last_undegraded":"2024-09-12T18:14:53.169209+0000","last_fullsized":"2024-09-12T18:14:53.169209+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.934775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"57'10122","reported_seq":10208,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:55.485374+0000","last_change":"2024-09-12T18:14:50.187560+0000","last_active":"2024-09-12T18:14:55.485374+0000","last_peered":"2024-09-12T18:14:55.485374+0000","last_clean":"2024-09-12T18:14:55.485374+0000","last_became_active":"2024-09-12T18:14:50.146949+0000","last_became_peered":"2024-09-12T18:14:50.146949+0000","last_unstale":"2024-09-12T18:14:55.485374+0000","last_undegraded":"2024-09-12T18:14:55.485374+0000","last_fullsized":"2024-09-12T18:14:55.485374+0000","mapping_epoch":53,"log_start":"45'7147","ondisk_log_start":"45'7147","created":21,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2975,"log_dups_size":696,"ondisk_log_size":2975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:46.634231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431095808,"num_objects":6578,"num_object_clones":0,"num_object_copies":13156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6578,"num_objects_unfound":0,"num_objects_dirty":6578,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10122,"num_write_kb":534400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":6578}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.166637+0000","last_change":"2024-09-12T18:14:43.095580+0000","last_active":"2024-09-12T18:14:53.166637+0000","last_peered":"2024-09-12T18:14:53.166637+0000","last_clean":"2024-09-12T18:14:53.166637+0000","last_became_active":"2024-09-12T18:14:43.092061+0000","last_became_peered":"2024-09-12T18:14:43.092061+0000","last_unstale":"2024-09-12T18:14:53.166637+0000","last_undegraded":"2024-09-12T18:14:53.166637+0000","last_fullsized":"2024-09-12T18:14:53.166637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:03.825242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162512+0000","last_change":"2024-09-12T18:14:50.156024+0000","last_active":"2024-09-12T18:14:53.162512+0000","last_peered":"2024-09-12T18:14:53.162512+0000","last_clean":"2024-09-12T18:14:53.162512+0000","last_became_active":"2024-09-12T18:14:50.150316+0000","last_became_peered":"2024-09-12T18:14:50.150316+0000","last_unstale":"2024-09-12T18:14:53.162512+0000","last_undegraded":"2024-09-12T18:14:53.162512+0000","last_fullsized":"2024-09-12T18:14:53.162512+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:23.273569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"57'10342","reported_seq":10424,"reported_epoch":57,"state":"active+undersized+degraded+remapped+backfill_wait","last_fresh":"2024-09-12T18:14:55.475430+0000","last_change":"2024-09-12T18:14:50.279784+0000","last_active":"2024-09-12T18:14:55.475430+0000","last_peered":"2024-09-12T18:14:55.475430+0000","last_clean":"2024-09-12T18:14:27.963889+0000","last_became_active":"2024-09-12T18:14:50.267757+0000","last_became_peered":"2024-09-12T18:14:50.267757+0000","last_unstale":"2024-09-12T18:14:55.475430+0000","last_undegraded":"2024-09-12T18:14:50.153375+0000","last_fullsized":"2024-09-12T18:14:50.133093+0000","mapping_epoch":53,"log_start":"41'6600","ondisk_log_start":"41'6600","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438829056,"num_objects":6696,"num_object_clones":0,"num_object_copies":13392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6696,"num_objects_misplaced":6696,"num_objects_unfound":0,"num_objects_dirty":6696,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10342,"num_write_kb":545216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6696}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162734+0000","last_change":"2024-09-12T18:14:28.993136+0000","last_active":"2024-09-12T18:14:53.162734+0000","last_peered":"2024-09-12T18:14:53.162734+0000","last_clean":"2024-09-12T18:13:21.360759+0000","last_became_active":"2024-09-12T18:14:28.993136+0000","last_became_peered":"2024-09-12T18:14:28.993136+0000","last_unstale":"2024-09-12T18:14:53.162734+0000","last_undegraded":"2024-09-12T18:14:53.162734+0000","last_fullsized":"2024-09-12T18:14:28.982738+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:36.374765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.164138+0000","last_change":"2024-09-12T18:14:50.155019+0000","last_active":"2024-09-12T18:14:53.164138+0000","last_peered":"2024-09-12T18:14:53.164138+0000","last_clean":"2024-09-12T18:14:53.164138+0000","last_became_active":"2024-09-12T18:14:50.153137+0000","last_became_peered":"2024-09-12T18:14:50.153137+0000","last_unstale":"2024-09-12T18:14:53.164138+0000","last_undegraded":"2024-09-12T18:14:53.164138+0000","last_fullsized":"2024-09-12T18:14:53.164138+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:59.015252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"57'10218","reported_seq":10301,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.483870+0000","last_change":"2024-09-12T18:14:28.985893+0000","last_active":"2024-09-12T18:14:55.483870+0000","last_peered":"2024-09-12T18:14:55.483870+0000","last_clean":"2024-09-12T18:14:27.960780+0000","last_became_active":"2024-09-12T18:14:28.985893+0000","last_became_peered":"2024-09-12T18:14:28.985893+0000","last_unstale":"2024-09-12T18:14:55.483870+0000","last_undegraded":"2024-09-12T18:14:28.983300+0000","last_fullsized":"2024-09-12T18:14:28.983198+0000","mapping_epoch":43,"log_start":"45'7301","ondisk_log_start":"45'7301","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":754,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:06.548143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432930816,"num_objects":6606,"num_object_clones":0,"num_object_copies":13212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6606,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10218,"num_write_kb":538368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6606}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163171+0000","last_change":"2024-09-12T18:14:29.000093+0000","last_active":"2024-09-12T18:14:53.163171+0000","last_peered":"2024-09-12T18:14:53.163171+0000","last_clean":"2024-09-12T18:13:21.360759+0000","last_became_active":"2024-09-12T18:14:29.000093+0000","last_became_peered":"2024-09-12T18:14:29.000093+0000","last_unstale":"2024-09-12T18:14:53.163171+0000","last_undegraded":"2024-09-12T18:14:53.163171+0000","last_fullsized":"2024-09-12T18:14:28.983532+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:41.816820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163278+0000","last_change":"2024-09-12T18:14:28.989349+0000","last_active":"2024-09-12T18:14:53.163278+0000","last_peered":"2024-09-12T18:14:53.163278+0000","last_clean":"2024-09-12T18:14:26.965985+0000","last_became_active":"2024-09-12T18:14:28.989349+0000","last_became_peered":"2024-09-12T18:14:28.989349+0000","last_unstale":"2024-09-12T18:14:53.163278+0000","last_undegraded":"2024-09-12T18:14:53.163278+0000","last_fullsized":"2024-09-12T18:14:28.985176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:26.084753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"57'10372","reported_seq":10454,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.489956+0000","last_change":"2024-09-12T18:14:28.990052+0000","last_active":"2024-09-12T18:14:55.489956+0000","last_peered":"2024-09-12T18:14:55.489956+0000","last_clean":"2024-09-12T18:14:27.964926+0000","last_became_active":"2024-09-12T18:14:28.990052+0000","last_became_peered":"2024-09-12T18:14:28.990052+0000","last_unstale":"2024-09-12T18:14:55.489956+0000","last_undegraded":"2024-09-12T18:14:28.983843+0000","last_fullsized":"2024-09-12T18:14:28.983744+0000","mapping_epoch":43,"log_start":"45'7426","ondisk_log_start":"45'7426","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":696,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:18.318566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447348736,"num_objects":6826,"num_object_clones":0,"num_object_copies":13652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6826,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10372,"num_write_kb":550336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6826}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":248,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163667+0000","last_change":"2024-09-12T18:14:51.740775+0000","last_active":"2024-09-12T18:14:53.163667+0000","last_peered":"2024-09-12T18:14:53.163667+0000","last_clean":"2024-09-12T18:14:53.163667+0000","last_became_active":"2024-09-12T18:14:51.740386+0000","last_became_peered":"2024-09-12T18:14:51.740386+0000","last_unstale":"2024-09-12T18:14:53.163667+0000","last_undegraded":"2024-09-12T18:14:53.163667+0000","last_fullsized":"2024-09-12T18:14:53.163667+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:48.598883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":105,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.162162+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:14:53.162162+0000","last_peered":"2024-09-12T18:14:53.162162+0000","last_clean":"2024-09-12T18:14:53.162162+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:14:53.162162+0000","last_undegraded":"2024-09-12T18:14:53.162162+0000","last_fullsized":"2024-09-12T18:14:53.162162+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.166975+0000","last_change":"2024-09-12T18:14:28.996605+0000","last_active":"2024-09-12T18:14:53.166975+0000","last_peered":"2024-09-12T18:14:53.166975+0000","last_clean":"2024-09-12T18:14:26.966733+0000","last_became_active":"2024-09-12T18:14:28.996605+0000","last_became_peered":"2024-09-12T18:14:28.996605+0000","last_unstale":"2024-09-12T18:14:53.166975+0000","last_undegraded":"2024-09-12T18:14:53.166975+0000","last_fullsized":"2024-09-12T18:14:28.986752+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:48.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163000+0000","last_change":"2024-09-12T18:14:29.007445+0000","last_active":"2024-09-12T18:14:53.163000+0000","last_peered":"2024-09-12T18:14:53.163000+0000","last_clean":"2024-09-12T18:14:26.967919+0000","last_became_active":"2024-09-12T18:14:29.007445+0000","last_became_peered":"2024-09-12T18:14:29.007445+0000","last_unstale":"2024-09-12T18:14:53.163000+0000","last_undegraded":"2024-09-12T18:14:53.163000+0000","last_fullsized":"2024-09-12T18:14:28.987718+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.981162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"57'10124","reported_seq":10205,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.481628+0000","last_change":"2024-09-12T18:13:39.304779+0000","last_active":"2024-09-12T18:14:55.481628+0000","last_peered":"2024-09-12T18:14:55.481628+0000","last_clean":"2024-09-12T18:14:55.481628+0000","last_became_active":"2024-09-12T18:13:39.304291+0000","last_became_peered":"2024-09-12T18:13:39.304291+0000","last_unstale":"2024-09-12T18:14:55.481628+0000","last_undegraded":"2024-09-12T18:14:55.481628+0000","last_fullsized":"2024-09-12T18:14:55.481628+0000","mapping_epoch":21,"log_start":"41'6400","ondisk_log_start":"41'6400","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:56.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429391872,"num_objects":6552,"num_object_clones":0,"num_object_copies":13104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6552,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10124,"num_write_kb":533632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.161775+0000","last_change":"2024-09-12T18:14:28.990119+0000","last_active":"2024-09-12T18:14:53.161775+0000","last_peered":"2024-09-12T18:14:53.161775+0000","last_clean":"2024-09-12T18:14:26.966684+0000","last_became_active":"2024-09-12T18:14:28.990119+0000","last_became_peered":"2024-09-12T18:14:28.990119+0000","last_unstale":"2024-09-12T18:14:53.161775+0000","last_undegraded":"2024-09-12T18:14:53.161775+0000","last_fullsized":"2024-09-12T18:14:28.982822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:36.432922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":96,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162607+0000","last_change":"2024-09-12T18:14:50.170827+0000","last_active":"2024-09-12T18:14:53.162607+0000","last_peered":"2024-09-12T18:14:53.162607+0000","last_clean":"2024-09-12T18:14:53.162607+0000","last_became_active":"2024-09-12T18:14:50.169096+0000","last_became_peered":"2024-09-12T18:14:50.169096+0000","last_unstale":"2024-09-12T18:14:53.162607+0000","last_undegraded":"2024-09-12T18:14:53.162607+0000","last_fullsized":"2024-09-12T18:14:53.162607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:44.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.165656+0000","last_change":"2024-09-12T18:14:29.001622+0000","last_active":"2024-09-12T18:14:53.165656+0000","last_peered":"2024-09-12T18:14:53.165656+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:29.001622+0000","last_became_peered":"2024-09-12T18:14:29.001622+0000","last_unstale":"2024-09-12T18:14:53.165656+0000","last_undegraded":"2024-09-12T18:14:53.165656+0000","last_fullsized":"2024-09-12T18:14:28.983595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:10.448683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"57'10222","reported_seq":10312,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:55.478857+0000","last_change":"2024-09-12T18:14:50.226763+0000","last_active":"2024-09-12T18:14:55.478857+0000","last_peered":"2024-09-12T18:14:55.478857+0000","last_clean":"2024-09-12T18:14:55.478857+0000","last_became_active":"2024-09-12T18:14:50.183118+0000","last_became_peered":"2024-09-12T18:14:50.183118+0000","last_unstale":"2024-09-12T18:14:55.478857+0000","last_undegraded":"2024-09-12T18:14:55.478857+0000","last_fullsized":"2024-09-12T18:14:55.478857+0000","mapping_epoch":53,"log_start":"45'7242","ondisk_log_start":"45'7242","created":21,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":696,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:24.263006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":430702592,"num_objects":6572,"num_object_clones":0,"num_object_copies":13144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6572,"num_objects_unfound":0,"num_objects_dirty":6572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10222,"num_write_kb":537408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":6572}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163557+0000","last_change":"2024-09-12T18:14:28.987263+0000","last_active":"2024-09-12T18:14:53.163557+0000","last_peered":"2024-09-12T18:14:53.163557+0000","last_clean":"2024-09-12T18:14:26.964774+0000","last_became_active":"2024-09-12T18:14:28.987263+0000","last_became_peered":"2024-09-12T18:14:28.987263+0000","last_unstale":"2024-09-12T18:14:53.163557+0000","last_undegraded":"2024-09-12T18:14:53.163557+0000","last_fullsized":"2024-09-12T18:14:28.982703+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:34.334370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162142+0000","last_change":"2024-09-12T18:14:50.149691+0000","last_active":"2024-09-12T18:14:53.162142+0000","last_peered":"2024-09-12T18:14:53.162142+0000","last_clean":"2024-09-12T18:14:53.162142+0000","last_became_active":"2024-09-12T18:14:50.146843+0000","last_became_peered":"2024-09-12T18:14:50.146843+0000","last_unstale":"2024-09-12T18:14:53.162142+0000","last_undegraded":"2024-09-12T18:14:53.162142+0000","last_fullsized":"2024-09-12T18:14:53.162142+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:23.075521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163416+0000","last_change":"2024-09-12T18:14:28.989372+0000","last_active":"2024-09-12T18:14:53.163416+0000","last_peered":"2024-09-12T18:14:53.163416+0000","last_clean":"2024-09-12T18:14:26.966105+0000","last_became_active":"2024-09-12T18:14:28.989372+0000","last_became_peered":"2024-09-12T18:14:28.989372+0000","last_unstale":"2024-09-12T18:14:53.163416+0000","last_undegraded":"2024-09-12T18:14:53.163416+0000","last_fullsized":"2024-09-12T18:14:28.985512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:32.414142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"57'10410","reported_seq":10491,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.492510+0000","last_change":"2024-09-12T18:13:39.303887+0000","last_active":"2024-09-12T18:14:55.492510+0000","last_peered":"2024-09-12T18:14:55.492510+0000","last_clean":"2024-09-12T18:14:55.492510+0000","last_became_active":"2024-09-12T18:13:39.303308+0000","last_became_peered":"2024-09-12T18:13:39.303308+0000","last_unstale":"2024-09-12T18:14:55.492510+0000","last_undegraded":"2024-09-12T18:14:55.492510+0000","last_fullsized":"2024-09-12T18:14:55.492510+0000","mapping_epoch":21,"log_start":"45'7411","ondisk_log_start":"45'7411","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2999,"log_dups_size":696,"ondisk_log_size":2999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:51.598853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440139776,"num_objects":6716,"num_object_clones":0,"num_object_copies":13432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10410,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":106,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.162538+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:14:53.162538+0000","last_peered":"2024-09-12T18:14:53.162538+0000","last_clean":"2024-09-12T18:14:53.162538+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:14:53.162538+0000","last_undegraded":"2024-09-12T18:14:53.162538+0000","last_fullsized":"2024-09-12T18:14:53.162538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":91,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.162005+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:14:53.162005+0000","last_peered":"2024-09-12T18:14:53.162005+0000","last_clean":"2024-09-12T18:14:53.162005+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:14:53.162005+0000","last_undegraded":"2024-09-12T18:14:53.162005+0000","last_fullsized":"2024-09-12T18:14:53.162005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.170036+0000","last_change":"2024-09-12T18:14:28.995181+0000","last_active":"2024-09-12T18:14:53.170036+0000","last_peered":"2024-09-12T18:14:53.170036+0000","last_clean":"2024-09-12T18:14:26.966888+0000","last_became_active":"2024-09-12T18:14:28.995181+0000","last_became_peered":"2024-09-12T18:14:28.995181+0000","last_unstale":"2024-09-12T18:14:53.170036+0000","last_undegraded":"2024-09-12T18:14:53.170036+0000","last_fullsized":"2024-09-12T18:14:28.984245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:41.590912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"57'10401","reported_seq":10491,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:55.484670+0000","last_change":"2024-09-12T18:14:50.227630+0000","last_active":"2024-09-12T18:14:55.484670+0000","last_peered":"2024-09-12T18:14:55.484670+0000","last_clean":"2024-09-12T18:14:55.484670+0000","last_became_active":"2024-09-12T18:14:50.183818+0000","last_became_peered":"2024-09-12T18:14:50.183818+0000","last_unstale":"2024-09-12T18:14:55.484670+0000","last_undegraded":"2024-09-12T18:14:55.484670+0000","last_fullsized":"2024-09-12T18:14:55.484670+0000","mapping_epoch":53,"log_start":"45'7480","ondisk_log_start":"45'7480","created":21,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2921,"log_dups_size":783,"ondisk_log_size":2921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:35.553466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440205312,"num_objects":6717,"num_object_clones":0,"num_object_copies":13434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6717,"num_objects_unfound":0,"num_objects_dirty":6717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10401,"num_write_kb":547776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":6717}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.163095+0000","last_change":"2024-09-12T18:14:43.094420+0000","last_active":"2024-09-12T18:14:53.163095+0000","last_peered":"2024-09-12T18:14:53.163095+0000","last_clean":"2024-09-12T18:14:53.163095+0000","last_became_active":"2024-09-12T18:14:43.092106+0000","last_became_peered":"2024-09-12T18:14:43.092106+0000","last_unstale":"2024-09-12T18:14:53.163095+0000","last_undegraded":"2024-09-12T18:14:53.163095+0000","last_fullsized":"2024-09-12T18:14:53.163095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.122610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.170332+0000","last_change":"2024-09-12T18:14:28.996017+0000","last_active":"2024-09-12T18:14:53.170332+0000","last_peered":"2024-09-12T18:14:53.170332+0000","last_clean":"2024-09-12T18:14:26.967087+0000","last_became_active":"2024-09-12T18:14:28.996017+0000","last_became_peered":"2024-09-12T18:14:28.996017+0000","last_unstale":"2024-09-12T18:14:53.170332+0000","last_undegraded":"2024-09-12T18:14:53.170332+0000","last_fullsized":"2024-09-12T18:14:28.984627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.436294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163998+0000","last_change":"2024-09-12T18:14:50.153928+0000","last_active":"2024-09-12T18:14:53.163998+0000","last_peered":"2024-09-12T18:14:53.163998+0000","last_clean":"2024-09-12T18:14:53.163998+0000","last_became_active":"2024-09-12T18:14:50.148471+0000","last_became_peered":"2024-09-12T18:14:50.148471+0000","last_unstale":"2024-09-12T18:14:53.163998+0000","last_undegraded":"2024-09-12T18:14:53.163998+0000","last_fullsized":"2024-09-12T18:14:53.163998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:58.933592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"57'10274","reported_seq":10365,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.487228+0000","last_change":"2024-09-12T18:14:43.153281+0000","last_active":"2024-09-12T18:14:55.487228+0000","last_peered":"2024-09-12T18:14:55.487228+0000","last_clean":"2024-09-12T18:14:55.487228+0000","last_became_active":"2024-09-12T18:14:43.095320+0000","last_became_peered":"2024-09-12T18:14:43.095320+0000","last_unstale":"2024-09-12T18:14:55.487228+0000","last_undegraded":"2024-09-12T18:14:55.487228+0000","last_fullsized":"2024-09-12T18:14:55.487228+0000","mapping_epoch":49,"log_start":"45'7313","ondisk_log_start":"45'7313","created":21,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2961,"log_dups_size":725,"ondisk_log_size":2961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:55.103505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433455104,"num_objects":6614,"num_object_clones":0,"num_object_copies":13228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10274,"num_write_kb":540416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.170188+0000","last_change":"2024-09-12T18:14:28.995478+0000","last_active":"2024-09-12T18:14:53.170188+0000","last_peered":"2024-09-12T18:14:53.170188+0000","last_clean":"2024-09-12T18:14:26.966971+0000","last_became_active":"2024-09-12T18:14:28.995478+0000","last_became_peered":"2024-09-12T18:14:28.995478+0000","last_unstale":"2024-09-12T18:14:53.170188+0000","last_undegraded":"2024-09-12T18:14:53.170188+0000","last_fullsized":"2024-09-12T18:14:28.984421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:41.482471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163490+0000","last_change":"2024-09-12T18:14:28.989022+0000","last_active":"2024-09-12T18:14:53.163490+0000","last_peered":"2024-09-12T18:14:53.163490+0000","last_clean":"2024-09-12T18:13:16.311210+0000","last_became_active":"2024-09-12T18:14:28.989022+0000","last_became_peered":"2024-09-12T18:14:28.989022+0000","last_unstale":"2024-09-12T18:14:53.163490+0000","last_undegraded":"2024-09-12T18:14:53.163490+0000","last_fullsized":"2024-09-12T18:14:28.984576+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:45.833129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.164881+0000","last_change":"2024-09-12T18:14:50.156323+0000","last_active":"2024-09-12T18:14:53.164881+0000","last_peered":"2024-09-12T18:14:53.164881+0000","last_clean":"2024-09-12T18:14:53.164881+0000","last_became_active":"2024-09-12T18:14:50.150056+0000","last_became_peered":"2024-09-12T18:14:50.150056+0000","last_unstale":"2024-09-12T18:14:53.164881+0000","last_undegraded":"2024-09-12T18:14:53.164881+0000","last_fullsized":"2024-09-12T18:14:53.164881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:38.764067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"57'10210","reported_seq":10298,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:55.492838+0000","last_change":"2024-09-12T18:14:43.129916+0000","last_active":"2024-09-12T18:14:55.492838+0000","last_peered":"2024-09-12T18:14:55.492838+0000","last_clean":"2024-09-12T18:14:55.492838+0000","last_became_active":"2024-09-12T18:14:43.089403+0000","last_became_peered":"2024-09-12T18:14:43.089403+0000","last_unstale":"2024-09-12T18:14:55.492838+0000","last_undegraded":"2024-09-12T18:14:55.492838+0000","last_fullsized":"2024-09-12T18:14:55.492838+0000","mapping_epoch":49,"log_start":"45'7213","ondisk_log_start":"45'7213","created":21,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2997,"log_dups_size":667,"ondisk_log_size":2997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:35.575291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431226880,"num_objects":6580,"num_object_clones":0,"num_object_copies":13160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10210,"num_write_kb":537280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":96,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:53.164577+0000","last_change":"2024-09-12T18:14:28.994380+0000","last_active":"2024-09-12T18:14:53.164577+0000","last_peered":"2024-09-12T18:14:53.164577+0000","last_clean":"2024-09-12T18:14:26.966377+0000","last_became_active":"2024-09-12T18:14:28.994380+0000","last_became_peered":"2024-09-12T18:14:28.994380+0000","last_unstale":"2024-09-12T18:14:53.164577+0000","last_undegraded":"2024-09-12T18:14:28.987510+0000","last_fullsized":"2024-09-12T18:14:28.987415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:34.598948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.165102+0000","last_change":"2024-09-12T18:14:29.002359+0000","last_active":"2024-09-12T18:14:53.165102+0000","last_peered":"2024-09-12T18:14:53.165102+0000","last_clean":"2024-09-12T18:14:26.966339+0000","last_became_active":"2024-09-12T18:14:29.002359+0000","last_became_peered":"2024-09-12T18:14:29.002359+0000","last_unstale":"2024-09-12T18:14:53.165102+0000","last_undegraded":"2024-09-12T18:14:53.165102+0000","last_fullsized":"2024-09-12T18:14:28.985063+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:33.800531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163445+0000","last_change":"2024-09-12T18:14:50.153231+0000","last_active":"2024-09-12T18:14:53.163445+0000","last_peered":"2024-09-12T18:14:53.163445+0000","last_clean":"2024-09-12T18:14:53.163445+0000","last_became_active":"2024-09-12T18:14:50.148083+0000","last_became_peered":"2024-09-12T18:14:50.148083+0000","last_unstale":"2024-09-12T18:14:53.163445+0000","last_undegraded":"2024-09-12T18:14:53.163445+0000","last_fullsized":"2024-09-12T18:14:53.163445+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:09.736701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"57'10244","reported_seq":10327,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:55.467850+0000","last_change":"2024-09-12T18:14:28.985835+0000","last_active":"2024-09-12T18:14:55.467850+0000","last_peered":"2024-09-12T18:14:55.467850+0000","last_clean":"2024-09-12T18:14:27.960039+0000","last_became_active":"2024-09-12T18:14:28.985835+0000","last_became_peered":"2024-09-12T18:14:28.985835+0000","last_unstale":"2024-09-12T18:14:55.467850+0000","last_undegraded":"2024-09-12T18:14:28.982086+0000","last_fullsized":"2024-09-12T18:14:28.981819+0000","mapping_epoch":43,"log_start":"45'7284","ondisk_log_start":"45'7284","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":696,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:59.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441712640,"num_objects":6740,"num_object_clones":0,"num_object_copies":13480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6740,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10244,"num_write_kb":543488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6740}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":97,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.165529+0000","last_change":"2024-09-12T18:14:50.155387+0000","last_active":"2024-09-12T18:14:53.165529+0000","last_peered":"2024-09-12T18:14:53.165529+0000","last_clean":"2024-09-12T18:14:53.165529+0000","last_became_active":"2024-09-12T18:14:50.154610+0000","last_became_peered":"2024-09-12T18:14:50.154610+0000","last_unstale":"2024-09-12T18:14:53.165529+0000","last_undegraded":"2024-09-12T18:14:53.165529+0000","last_fullsized":"2024-09-12T18:14:53.165529+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:35.187130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163565+0000","last_change":"2024-09-12T18:14:28.997335+0000","last_active":"2024-09-12T18:14:53.163565+0000","last_peered":"2024-09-12T18:14:53.163565+0000","last_clean":"2024-09-12T18:14:26.967631+0000","last_became_active":"2024-09-12T18:14:28.997335+0000","last_became_peered":"2024-09-12T18:14:28.997335+0000","last_unstale":"2024-09-12T18:14:53.163565+0000","last_undegraded":"2024-09-12T18:14:53.163565+0000","last_fullsized":"2024-09-12T18:14:28.988338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:33.800531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.164167+0000","last_change":"2024-09-12T18:14:50.182861+0000","last_active":"2024-09-12T18:14:53.164167+0000","last_peered":"2024-09-12T18:14:53.164167+0000","last_clean":"2024-09-12T18:14:53.164167+0000","last_became_active":"2024-09-12T18:14:50.181104+0000","last_became_peered":"2024-09-12T18:14:50.181104+0000","last_unstale":"2024-09-12T18:14:53.164167+0000","last_undegraded":"2024-09-12T18:14:53.164167+0000","last_fullsized":"2024-09-12T18:14:53.164167+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:42.493443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.164325+0000","last_change":"2024-09-12T18:14:50.157831+0000","last_active":"2024-09-12T18:14:53.164325+0000","last_peered":"2024-09-12T18:14:53.164325+0000","last_clean":"2024-09-12T18:14:53.164325+0000","last_became_active":"2024-09-12T18:14:50.154883+0000","last_became_peered":"2024-09-12T18:14:50.154883+0000","last_unstale":"2024-09-12T18:14:53.164325+0000","last_undegraded":"2024-09-12T18:14:53.164325+0000","last_fullsized":"2024-09-12T18:14:53.164325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:17.641815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":100,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:53.162253+0000","last_change":"2024-09-12T18:14:28.992424+0000","last_active":"2024-09-12T18:14:53.162253+0000","last_peered":"2024-09-12T18:14:53.162253+0000","last_clean":"2024-09-12T18:14:26.967261+0000","last_became_active":"2024-09-12T18:14:28.992424+0000","last_became_peered":"2024-09-12T18:14:28.992424+0000","last_unstale":"2024-09-12T18:14:53.162253+0000","last_undegraded":"2024-09-12T18:14:28.985794+0000","last_fullsized":"2024-09-12T18:14:28.985700+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:51.527032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.166701+0000","last_change":"2024-09-12T18:14:28.990680+0000","last_active":"2024-09-12T18:14:53.166701+0000","last_peered":"2024-09-12T18:14:53.166701+0000","last_clean":"2024-09-12T18:14:26.966522+0000","last_became_active":"2024-09-12T18:14:28.990680+0000","last_became_peered":"2024-09-12T18:14:28.990680+0000","last_unstale":"2024-09-12T18:14:53.166701+0000","last_undegraded":"2024-09-12T18:14:53.166701+0000","last_fullsized":"2024-09-12T18:14:28.985360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:46.424046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":46,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:53.162758+0000","last_change":"2024-09-12T18:14:29.007283+0000","last_active":"2024-09-12T18:14:53.162758+0000","last_peered":"2024-09-12T18:14:53.162758+0000","last_clean":"2024-09-12T18:13:23.413176+0000","last_became_active":"2024-09-12T18:14:29.007283+0000","last_became_peered":"2024-09-12T18:14:29.007283+0000","last_unstale":"2024-09-12T18:14:53.162758+0000","last_undegraded":"2024-09-12T18:14:28.986112+0000","last_fullsized":"2024-09-12T18:14:28.986011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:48.525288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.165688+0000","last_change":"2024-09-12T18:14:50.169843+0000","last_active":"2024-09-12T18:14:53.165688+0000","last_peered":"2024-09-12T18:14:53.165688+0000","last_clean":"2024-09-12T18:14:53.165688+0000","last_became_active":"2024-09-12T18:14:50.169342+0000","last_became_peered":"2024-09-12T18:14:50.169342+0000","last_unstale":"2024-09-12T18:14:53.165688+0000","last_undegraded":"2024-09-12T18:14:53.165688+0000","last_fullsized":"2024-09-12T18:14:53.165688+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:02.037297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.163160+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:14:53.163160+0000","last_peered":"2024-09-12T18:14:53.163160+0000","last_clean":"2024-09-12T18:14:53.163160+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:14:53.163160+0000","last_undegraded":"2024-09-12T18:14:53.163160+0000","last_fullsized":"2024-09-12T18:14:53.163160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":96,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163932+0000","last_change":"2024-09-12T18:14:50.184938+0000","last_active":"2024-09-12T18:14:53.163932+0000","last_peered":"2024-09-12T18:14:53.163932+0000","last_clean":"2024-09-12T18:14:53.163932+0000","last_became_active":"2024-09-12T18:14:50.183693+0000","last_became_peered":"2024-09-12T18:14:50.183693+0000","last_unstale":"2024-09-12T18:14:53.163932+0000","last_undegraded":"2024-09-12T18:14:53.163932+0000","last_fullsized":"2024-09-12T18:14:53.163932+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.885500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163312+0000","last_change":"2024-09-12T18:14:28.999450+0000","last_active":"2024-09-12T18:14:53.163312+0000","last_peered":"2024-09-12T18:14:53.163312+0000","last_clean":"2024-09-12T18:14:26.964499+0000","last_became_active":"2024-09-12T18:14:28.999450+0000","last_became_peered":"2024-09-12T18:14:28.999450+0000","last_unstale":"2024-09-12T18:14:53.163312+0000","last_undegraded":"2024-09-12T18:14:53.163312+0000","last_fullsized":"2024-09-12T18:14:28.983604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:17.589946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162925+0000","last_change":"2024-09-12T18:14:28.994901+0000","last_active":"2024-09-12T18:14:53.162925+0000","last_peered":"2024-09-12T18:14:53.162925+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.994901+0000","last_became_peered":"2024-09-12T18:14:28.994901+0000","last_unstale":"2024-09-12T18:14:53.162925+0000","last_undegraded":"2024-09-12T18:14:53.162925+0000","last_fullsized":"2024-09-12T18:14:28.987761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:16.042811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.163749+0000","last_change":"2024-09-12T18:14:28.999703+0000","last_active":"2024-09-12T18:14:53.163749+0000","last_peered":"2024-09-12T18:14:53.163749+0000","last_clean":"2024-09-12T18:14:26.964654+0000","last_became_active":"2024-09-12T18:14:28.999703+0000","last_became_peered":"2024-09-12T18:14:28.999703+0000","last_unstale":"2024-09-12T18:14:53.163749+0000","last_undegraded":"2024-09-12T18:14:53.163749+0000","last_fullsized":"2024-09-12T18:14:28.984199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:36.374765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":94,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.165399+0000","last_change":"2024-09-12T18:14:50.155186+0000","last_active":"2024-09-12T18:14:53.165399+0000","last_peered":"2024-09-12T18:14:53.165399+0000","last_clean":"2024-09-12T18:14:53.165399+0000","last_became_active":"2024-09-12T18:14:50.153703+0000","last_became_peered":"2024-09-12T18:14:50.153703+0000","last_unstale":"2024-09-12T18:14:53.165399+0000","last_undegraded":"2024-09-12T18:14:53.165399+0000","last_fullsized":"2024-09-12T18:14:53.165399+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:06.740394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":96,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162820+0000","last_change":"2024-09-12T18:14:50.171605+0000","last_active":"2024-09-12T18:14:53.162820+0000","last_peered":"2024-09-12T18:14:53.162820+0000","last_clean":"2024-09-12T18:14:53.162820+0000","last_became_active":"2024-09-12T18:14:50.170490+0000","last_became_peered":"2024-09-12T18:14:50.170490+0000","last_unstale":"2024-09-12T18:14:53.162820+0000","last_undegraded":"2024-09-12T18:14:53.162820+0000","last_fullsized":"2024-09-12T18:14:53.162820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:10.324029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.162688+0000","last_change":"2024-09-12T18:14:50.153622+0000","last_active":"2024-09-12T18:14:53.162688+0000","last_peered":"2024-09-12T18:14:53.162688+0000","last_clean":"2024-09-12T18:14:53.162688+0000","last_became_active":"2024-09-12T18:14:50.147796+0000","last_became_peered":"2024-09-12T18:14:50.147796+0000","last_unstale":"2024-09-12T18:14:53.162688+0000","last_undegraded":"2024-09-12T18:14:53.162688+0000","last_fullsized":"2024-09-12T18:14:53.162688+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:37.067296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.166609+0000","last_change":"2024-09-12T18:14:28.990330+0000","last_active":"2024-09-12T18:14:53.166609+0000","last_peered":"2024-09-12T18:14:53.166609+0000","last_clean":"2024-09-12T18:13:21.360759+0000","last_became_active":"2024-09-12T18:14:28.990330+0000","last_became_peered":"2024-09-12T18:14:28.990330+0000","last_unstale":"2024-09-12T18:14:53.166609+0000","last_undegraded":"2024-09-12T18:14:53.166609+0000","last_fullsized":"2024-09-12T18:14:28.982433+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:22.211651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.166007+0000","last_change":"2024-09-12T18:14:28.989659+0000","last_active":"2024-09-12T18:14:53.166007+0000","last_peered":"2024-09-12T18:14:53.166007+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.989659+0000","last_became_peered":"2024-09-12T18:14:28.989659+0000","last_unstale":"2024-09-12T18:14:53.166007+0000","last_undegraded":"2024-09-12T18:14:53.166007+0000","last_fullsized":"2024-09-12T18:14:28.982978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:55.630721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.170879+0000","last_change":"2024-09-12T18:14:50.156844+0000","last_active":"2024-09-12T18:14:53.170879+0000","last_peered":"2024-09-12T18:14:53.170879+0000","last_clean":"2024-09-12T18:14:53.170879+0000","last_became_active":"2024-09-12T18:14:50.153553+0000","last_became_peered":"2024-09-12T18:14:50.153553+0000","last_unstale":"2024-09-12T18:14:53.170879+0000","last_undegraded":"2024-09-12T18:14:53.170879+0000","last_fullsized":"2024-09-12T18:14:53.170879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:46.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.170886+0000","last_change":"2024-09-12T18:14:50.157369+0000","last_active":"2024-09-12T18:14:53.170886+0000","last_peered":"2024-09-12T18:14:53.170886+0000","last_clean":"2024-09-12T18:14:53.170886+0000","last_became_active":"2024-09-12T18:14:50.154078+0000","last_became_peered":"2024-09-12T18:14:50.154078+0000","last_unstale":"2024-09-12T18:14:53.170886+0000","last_undegraded":"2024-09-12T18:14:53.170886+0000","last_fullsized":"2024-09-12T18:14:53.170886+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:11.592827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":42,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.169832+0000","last_change":"2024-09-12T18:14:50.150354+0000","last_active":"2024-09-12T18:14:53.169832+0000","last_peered":"2024-09-12T18:14:53.169832+0000","last_clean":"2024-09-12T18:14:53.169832+0000","last_became_active":"2024-09-12T18:14:50.149911+0000","last_became_peered":"2024-09-12T18:14:50.149911+0000","last_unstale":"2024-09-12T18:14:53.169832+0000","last_undegraded":"2024-09-12T18:14:53.169832+0000","last_fullsized":"2024-09-12T18:14:53.169832+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:41.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.166795+0000","last_change":"2024-09-12T18:14:50.152272+0000","last_active":"2024-09-12T18:14:53.166795+0000","last_peered":"2024-09-12T18:14:53.166795+0000","last_clean":"2024-09-12T18:14:53.166795+0000","last_became_active":"2024-09-12T18:14:50.149458+0000","last_became_peered":"2024-09-12T18:14:50.149458+0000","last_unstale":"2024-09-12T18:14:53.166795+0000","last_undegraded":"2024-09-12T18:14:53.166795+0000","last_fullsized":"2024-09-12T18:14:53.166795+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:21.551945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":46,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:14:53.162255+0000","last_change":"2024-09-12T18:14:29.006685+0000","last_active":"2024-09-12T18:14:53.162255+0000","last_peered":"2024-09-12T18:14:53.162255+0000","last_clean":"2024-09-12T18:13:23.412529+0000","last_became_active":"2024-09-12T18:14:29.006685+0000","last_became_peered":"2024-09-12T18:14:29.006685+0000","last_unstale":"2024-09-12T18:14:53.162255+0000","last_undegraded":"2024-09-12T18:14:28.985391+0000","last_fullsized":"2024-09-12T18:14:28.985309+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:58.770044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.162447+0000","last_change":"2024-09-12T18:14:28.986499+0000","last_active":"2024-09-12T18:14:53.162447+0000","last_peered":"2024-09-12T18:14:53.162447+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986499+0000","last_became_peered":"2024-09-12T18:14:28.986499+0000","last_unstale":"2024-09-12T18:14:53.162447+0000","last_undegraded":"2024-09-12T18:14:53.162447+0000","last_fullsized":"2024-09-12T18:14:28.982656+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:06.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":95,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T18:14:53.167111+0000","last_change":"2024-09-12T18:14:29.001920+0000","last_active":"2024-09-12T18:14:53.167111+0000","last_peered":"2024-09-12T18:14:53.167111+0000","last_clean":"2024-09-12T18:14:26.966241+0000","last_became_active":"2024-09-12T18:14:29.001920+0000","last_became_peered":"2024-09-12T18:14:29.001920+0000","last_unstale":"2024-09-12T18:14:53.167111+0000","last_undegraded":"2024-09-12T18:14:53.167111+0000","last_fullsized":"2024-09-12T18:14:28.984447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:15.033970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":89,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T18:14:53.161666+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:14:53.161666+0000","last_peered":"2024-09-12T18:14:53.161666+0000","last_clean":"2024-09-12T18:14:53.161666+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:14:53.161666+0000","last_undegraded":"2024-09-12T18:14:53.161666+0000","last_fullsized":"2024-09-12T18:14:53.161666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":100,"reported_epoch":57,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:14:53.163609+0000","last_change":"2024-09-12T18:14:50.184231+0000","last_active":"2024-09-12T18:14:53.163609+0000","last_peered":"2024-09-12T18:14:53.163609+0000","last_clean":"2024-09-12T18:14:53.163609+0000","last_became_active":"2024-09-12T18:14:50.182469+0000","last_became_peered":"2024-09-12T18:14:50.182469+0000","last_unstale":"2024-09-12T18:14:53.163609+0000","last_undegraded":"2024-09-12T18:14:53.163609+0000","last_fullsized":"2024-09-12T18:14:53.163609+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:25.972741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6965559320,"num_objects":106287,"num_object_clones":0,"num_object_copies":212574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59228,"num_objects_misplaced":33184,"num_objects_unfound":0,"num_objects_dirty":106287,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":163927,"num_write_kb":8646785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":770,"num_bytes_recovered":50200576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":871817216,"data_stored":13949009944,"data_compressed":11972584,"data_compressed_allocated":871813120,"data_compressed_original":13949009920,"omap_allocated":0,"internal_metadata":0},"log_size":50473,"ondisk_log_size":50473,"up":20,"acting":23,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":7,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":38,"acting":51,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":21223,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":1,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426236,"kb_used_data":268708,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93945604,"statfs":{"total":96636764160,"available":96200298496,"internally_reserved":0,"allocated":275156992,"data_stored":4391748188,"data_compressed":3780571,"data_compressed_allocated":274468864,"data_compressed_original":4391485440,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595448,"kb_used_data":351848,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93776392,"statfs":{"total":96636764160,"available":96027025408,"internally_reserved":0,"allocated":360292352,"data_stored":5754567560,"data_compressed":4952981,"data_compressed_allocated":359645184,"data_compressed_original":5754322944,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,5,2,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348268,"kb_used_data":236568,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94023572,"statfs":{"total":96636764160,"available":96280137728,"internally_reserved":0,"allocated":242245632,"data_stored":3868490993,"data_compressed":3313892,"data_compressed_allocated":241770496,"data_compressed_original":3868311552,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":243748864,"data_stored":3899981824,"data_compressed":3335136,"data_compressed_allocated":243748864,"data_compressed_original":3899981824,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":356376576,"data_stored":5702025216,"data_compressed":4901197,"data_compressed_allocated":356376576,"data_compressed_original":5702025216,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":271691776,"data_stored":4347002904,"data_compressed":3736251,"data_compressed_allocated":271687680,"data_compressed_original":4347002880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:14:59.126 INFO:tasks.thrashosds.thrasher:Setting 4.19 to [2, 0, 1] 2024-09-12T18:14:59.126 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.19', '2', '0', '1'] 2024-09-12T18:14:59.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.19 2 0 1 2024-09-12T18:14:59.185 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:59.186 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:59.186 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:59.181+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.194 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:14:59.206 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:14:59.287 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:59.282+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:59.359 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:59.359 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:59.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:14:59.389 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:59.382+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:59.489 INFO:teuthology.orchestra.run.smithi062.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:14:59.490 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:59.486+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:14:59.495 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:14:59.495 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:14:59.527 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:59.527 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:59.546 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:14:59.594 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:59.593+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.692 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:59.689+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.703 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:59.703 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:59.725 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:14:59.793 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:59.789+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.885 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:14:59.885 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:14:59.894 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:14:59.893+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:14:59.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:14:59.995 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:14:59.990+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.068 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:00.068 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:00.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:00.133 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:00.130+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.198 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:00.194+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:00.295 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:00.295 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:00.299 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:00.297+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:00.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:00.382 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:00.382 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:00.400 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:00.394+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.400 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:00.400 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:00.403 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:00.404 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:00.470 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:00.470 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:176181 5.1 e59/49 5:88e50e30:::benchmark_data_smithi062_23645_object41072:head v 59'11006, mlcod=59'11003)", 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.466093+0000", 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0045682120000000003, 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0045881460000000004, 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466093+0000", 2024-09-12T18:15:00.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466093+0000", 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466093+0000", 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0999999999999998e-07 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466097+0000", 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3100000000000001e-06 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466103+0000", 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6939999999999998e-06 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466108+0000", 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5390000000000001e-06 2024-09-12T18:15:00.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.467267+0000", 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001158577 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.467282+0000", 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5466999999999999e-05 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:176186 5.6 e59/53 5:6cf6a46e:::benchmark_data_smithi062_23645_object41077:head v 59'10998, mlcod=59'10996)", 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.466242+0000", 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0044193280000000001, 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0044906030000000001, 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466242+0000", 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466242+0000", 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466242+0000", 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.15e-07 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466245+0000", 2024-09-12T18:15:00.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2320000000000001e-06 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466252+0000", 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3439999999999997e-06 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466256+0000", 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4660000000000001e-06 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466314+0000", 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7487e-05 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466341+0000", 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7526999999999999e-05 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:176187 5.7 5:e81a7184:::benchmark_data_smithi062_23645_object41078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:00.478 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.466398+0000", 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004262577, 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0043829960000000001, 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 176187 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466398+0000", 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466398+0000", 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466400+0000", 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0550000000000001e-06 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466404+0000", 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1450000000000001e-06 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466414+0000", 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0030000000000001e-05 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466420+0000", 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7900000000000002e-06 2024-09-12T18:15:00.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466465+0000", 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4675999999999997e-05 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466582+0000", 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116521 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.466680+0000", 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8280000000000001e-05 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:176188 5.6 e59/53 5:6a1190bc:::benchmark_data_smithi062_23645_object41079:head v 59'10999, mlcod=59'10996)", 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.468296+0000", 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0023649410000000002, 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025367660000000002, 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.483 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468296+0000", 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468296+0000", 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468297+0000", 2024-09-12T18:15:00.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468304+0000", 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6860000000000006e-06 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468314+0000", 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0103e-05 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468321+0000", 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6490000000000002e-06 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468372+0000", 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1344999999999997e-05 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468394+0000", 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1478999999999999e-05 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.486 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:176191 5.2 e59/49 5:45ba5948:::benchmark_data_smithi062_23645_object41082:head v 59'11036, mlcod=59'11034)", 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.468337+0000", 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002323627, 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025358680000000001, 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468337+0000", 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468337+0000", 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468338+0000", 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3099999999999999e-07 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468342+0000", 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9489999999999998e-06 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468348+0000", 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6640000000000001e-06 2024-09-12T18:15:00.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468353+0000", 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8570000000000003e-06 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468411+0000", 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8016999999999997e-05 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468436+0000", 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4878000000000001e-05 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:176190 5.1 e59/49 5:8af59475:::benchmark_data_smithi062_23645_object41081:head v 59'11007, mlcod=59'11003)", 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.468486+0000", 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002175172, 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024338860000000001, 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.491 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468486+0000", 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468486+0000", 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468487+0000", 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468496+0000", 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9469999999999992e-06 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468501+0000", 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468506+0000", 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4039999999999997e-06 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468751+0000", 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024553500000000001 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468761+0000", 2024-09-12T18:15:00.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0052e-05 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:176192 5.9 5:9c249a25:::benchmark_data_smithi062_23645_object41083:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.468882+0000", 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0017785559999999999, 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002115905, 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 176192 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468882+0000", 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468882+0000", 2024-09-12T18:15:00.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468883+0000", 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2900000000000002e-07 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468887+0000", 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9589999999999997e-06 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468896+0000", 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1589999999999993e-06 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.468900+0000", 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2889999999999999e-06 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469712+0000", 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00081180800000000002 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469852+0000", 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014038399999999999 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469970+0000", 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011775 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.499 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:176193 5.f 5:f90682b5:::benchmark_data_smithi062_23645_object41084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.469055+0000", 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0016064899999999999, 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020177110000000002, 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 176193 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469055+0000", 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469055+0000", 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469055+0000", 2024-09-12T18:15:00.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469057+0000", 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2089999999999999e-06 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469066+0000", 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2609999999999993e-06 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469069+0000", 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4130000000000002e-06 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469131+0000", 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1957000000000003e-05 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469257+0000", 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012652900000000001 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469377+0000", 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119128 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:176194 5.d 5:bd600e2e:::benchmark_data_smithi062_23645_object41085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.469160+0000", 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001501126, 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020053950000000001, 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.504 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 176194 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469160+0000", 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469160+0000", 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469161+0000", 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1100000000000005e-07 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469164+0000", 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7519999999999998e-06 2024-09-12T18:15:00.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469176+0000", 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1192999999999999e-05 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469181+0000", 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7969999999999997e-06 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469226+0000", 2024-09-12T18:15:00.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4660000000000003e-05 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469298+0000", 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1991999999999998e-05 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "MOSDPGPushReply(5.9 59/53 [PushReplyOp(5:939b52f4:::benchmark_data_smithi062_23645_object114857:head)])", 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.469874+0000", 2024-09-12T18:15:00.508 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00078706299999999996, 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001352692, 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469874+0000", 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469874+0000", 2024-09-12T18:15:00.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469874+0000", 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8900000000000001e-07 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469877+0000", 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2260000000000001e-06 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469884+0000", 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1840000000000004e-06 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.469891+0000", 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:176198 5.9 5.cd5d1fe9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:00.511 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:00.470076+0000", 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00058543899999999999, 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001182479, 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 176198 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.470076+0000", 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.470076+0000", 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.470076+0000", 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.44e-07 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.470082+0000", 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8320000000000002e-06 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.470091+0000", 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2320000000000007e-06 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:00.470097+0000", 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0270000000000001e-06 2024-09-12T18:15:00.514 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.515 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.515 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.515 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.515 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:00.515 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 11 2024-09-12T18:15:00.515 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:00.516 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:00.517 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:00.510+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.617 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:00.610+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.667 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:00.667 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:00.668 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:00.668 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:00.668 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:00.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:00.717 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:00.714+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:00.818 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:00.817+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:00.843 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:00.843 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:00.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:00.843 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:00.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 108.548424897, 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.844 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:00.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:00.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.850 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.448338016999998, 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:15:00.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.448247250999998, 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.856 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:15:00.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:15:00.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.861 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.448186227999997, 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:15:00.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:15:00.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:15:00.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:15:00.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:15:00.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:00.868 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.448127468999999, 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:00.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:00.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.448064419000005, 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.874 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:00.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.447125842999995, 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:00.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:00.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.446472131999997, 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.889 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:00.894 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.446385234999994, 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:15:00.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:15:00.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.446261613000004, 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:15:00.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:15:00.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 97.445870013000004, 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.907 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:15:00.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 33.587306984999998, 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:00.911 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:00.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:00.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 33.579284608000002, 2024-09-12T18:15:00.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.921 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:00.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 33.567699322000003, 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.924 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:00.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:00.929 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.6803473379999998, 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.930 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:00.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.6753733689999999, 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.936 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:00.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:00.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.6749044400000002, 2024-09-12T18:15:00.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:00.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.6728631160000003, 2024-09-12T18:15:00.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:00.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:00.952 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.6719553469999999, 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:00.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:00.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:00.957 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.6715271440000001, 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:00.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:00.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:00.962 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.962 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.962 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.962 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:00.962 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:00.962 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:00.963 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:00.961+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:00.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:01.064 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:01.058+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177805 5.2 5:4ac8361a:::benchmark_data_smithi062_23645_object42696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.110600+0000", 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0058476600000000002, 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058658679999999998, 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.117 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177805 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110600+0000", 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110600+0000", 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110601+0000", 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110604+0000", 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.886e-06 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110611+0000", 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110616+0000", 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.062e-06 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110665+0000", 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8738e-05 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110785+0000", 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119799 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.110899+0000", 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476699999999999 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114768+0000", 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003868322 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:177801 5.9 e59/53 5:9b778c33:::benchmark_data_smithi062_23645_object42692:head v 59'11029, mlcod=59'11027)", 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.112600+0000", 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0038478789999999998, 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003911337, 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.122 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112600+0000", 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112600+0000", 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112601+0000", 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-07 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112605+0000", 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1370000000000004e-06 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112611+0000", 2024-09-12T18:15:01.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.801e-06 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112614+0000", 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9369999999999997e-06 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112647+0000", 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2153999999999997e-05 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112660+0000", 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3427e-05 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177808 5.0 5:0d9b3b8b:::benchmark_data_smithi062_23645_object42699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.112884+0000", 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035640390000000002, 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003657946, 2024-09-12T18:15:01.126 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177808 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112884+0000", 2024-09-12T18:15:01.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112884+0000", 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112885+0000", 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9199999999999999e-07 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112889+0000", 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3109999999999999e-06 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112898+0000", 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1130000000000007e-06 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112905+0000", 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0650000000000001e-06 2024-09-12T18:15:01.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112982+0000", 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6259000000000003e-05 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113098+0000", 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116321 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177810 5.a 5:582aa75d:::benchmark_data_smithi062_23645_object42701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.112933+0000", 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035151560000000002, 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036417580000000001, 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177810 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112933+0000", 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112933+0000", 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112934+0000", 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-07 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112936+0000", 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.65e-06 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112943+0000", 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.126e-06 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112948+0000", 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0579999999999997e-06 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.112997+0000", 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8109000000000003e-05 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113099+0000", 2024-09-12T18:15:01.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102131 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177811 5.b 5:da9061c3:::benchmark_data_smithi062_23645_object42702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.113163+0000", 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0032847879999999999, 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034435809999999998, 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.135 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177811 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113163+0000", 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113163+0000", 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113164+0000", 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113168+0000", 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7120000000000002e-06 2024-09-12T18:15:01.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113176+0000", 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9019999999999999e-06 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113182+0000", 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2659999999999998e-06 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113227+0000", 2024-09-12T18:15:01.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4669999999999998e-05 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113313+0000", 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6258e-05 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177812 5.8 5:1d19d80a:::benchmark_data_smithi062_23645_object42703:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.113198+0000", 2024-09-12T18:15:01.139 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0032495990000000002, 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034391700000000001, 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177812 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113198+0000", 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113198+0000", 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113199+0000", 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8400000000000005e-07 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113202+0000", 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.796e-06 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113208+0000", 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1449999999999996e-06 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113213+0000", 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1440000000000002e-06 2024-09-12T18:15:01.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114449+0000", 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012357760000000001 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114550+0000", 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010108899999999999 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:177813 5.f e59/53 5:fbf72731:::benchmark_data_smithi062_23645_object42704:head v 59'11236, mlcod=59'11234)", 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.113631+0000", 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002816776, 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030474930000000001, 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113631+0000", 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113631+0000", 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113632+0000", 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113636+0000", 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.194e-06 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113647+0000", 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0557000000000001e-05 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113653+0000", 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113693+0000", 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0096999999999999e-05 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.113711+0000", 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7850999999999999e-05 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.147 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177816 5.c 5:3bb1da04:::benchmark_data_smithi062_23645_object42707:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.114973+0000", 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001475409, 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001762256, 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177816 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114973+0000", 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114973+0000", 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114974+0000", 2024-09-12T18:15:01.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114978+0000", 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4299999999999999e-06 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114989+0000", 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0732e-05 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.114997+0000", 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8599999999999993e-06 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115043+0000", 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6309e-05 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115150+0000", 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106594 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115258+0000", 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010802999999999999 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177817 5.3 5:c8b957c2:::benchmark_data_smithi062_23645_object42708:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.115047+0000", 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001400842, 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001761348, 2024-09-12T18:15:01.152 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177817 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115047+0000", 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115047+0000", 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115048+0000", 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115051+0000", 2024-09-12T18:15:01.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.236e-06 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115060+0000", 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9649999999999997e-06 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115067+0000", 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3790000000000003e-06 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115115+0000", 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8421000000000003e-05 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115181+0000", 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6103000000000001e-05 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115278+0000", 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999999e-05 2024-09-12T18:15:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:177818 5.c 5:3a83092e:::benchmark_data_smithi062_23645_object42709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.115178+0000", 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001270394, 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001703179, 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 177818 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115178+0000", 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115178+0000", 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115178+0000", 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8599999999999997e-07 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115182+0000", 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.337e-06 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115192+0000", 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0599e-05 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115199+0000", 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.229e-06 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.116736+0000", 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015377850000000001 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.116849+0000", 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113081 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:177815 5.f e59/53 5:fde85e9c:::benchmark_data_smithi062_23645_object42706:head v 59'11237, mlcod=59'11234)", 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:01.115387+0000", 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001061275, 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015497530000000001, 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.161 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115387+0000", 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115387+0000", 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115387+0000", 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.82e-07 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115392+0000", 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.578e-06 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115402+0000", 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6779999999999995e-06 2024-09-12T18:15:01.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115408+0000", 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3409999999999999e-06 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115455+0000", 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7352999999999999e-05 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:01.115474+0000", 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8337000000000001e-05 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 11 2024-09-12T18:15:01.165 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:01.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:01.167 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:01.162+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:01.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:15:01.267 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:01.262+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:01.362 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:01.362 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:01.363 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:01.363 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:01.363 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:01.368 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:01.365+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:01.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:01.469 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:01.466+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:01.570 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:01.569+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:01.582 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:01.582 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:01.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:01.582 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:01.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109277 5.a 5:5d564263:::benchmark_data_smithi062_23645_object109276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.326815746999998, 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054754219999999999, 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109277 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.583 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253335+0000", 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253336+0000", 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000001e-07 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253419+0000", 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3484000000000002e-05 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253429+0000", 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4860000000000003e-06 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.253435+0000", 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6000000000000003e-06 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255349+0000", 2024-09-12T18:15:01.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019138409999999999 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255439+0000", 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0214000000000001e-05 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.255519+0000", 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9678999999999994e-05 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.261379+0000", 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058597959999999996 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308005+0000", 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.046626758999999997 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308053+0000", 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7160000000000002e-05 2024-09-12T18:15:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308089+0000", 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6523000000000003e-05 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109279 5.a 5:5b4bfc88:::benchmark_data_smithi062_23645_object109278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.325883234999999, 2024-09-12T18:15:01.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053990327999999997, 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109279 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:15:01.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254267+0000", 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254268+0000", 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254340+0000", 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1948999999999998e-05 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254349+0000", 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8410000000000006e-06 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254356+0000", 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257053+0000", 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026971959999999998 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257175+0000", 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122055 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.257300+0000", 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012527999999999999 2024-09-12T18:15:01.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.263193+0000", 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058926550000000001 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308151+0000", 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.044958383999999997 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308211+0000", 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.965e-05 2024-09-12T18:15:01.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.308258+0000", 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6656000000000002e-05 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:109280 5.a 5:5841e5a6:::benchmark_data_smithi062_23645_object109279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.325782773, 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055630641000000002, 2024-09-12T18:15:01.595 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.596 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.596 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 109280 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254368+0000", 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2600000000000002e-07 2024-09-12T18:15:01.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254400+0000", 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1550000000000001e-05 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254406+0000", 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2389999999999999e-06 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.254410+0000", 2024-09-12T18:15:01.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9210000000000002e-06 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259366+0000", 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049558099999999997 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259447+0000", 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0791000000000006e-05 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.259522+0000", 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5292999999999999e-05 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.267145+0000", 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0076230359999999997 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309880+0000", 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.04273453 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309954+0000", 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4425000000000007e-05 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:27.309999+0000", 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4520000000000001e-05 2024-09-12T18:15:01.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.463897501, 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.608 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.450496394, 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:01.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:01.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:01.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:01.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:01.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.443922711999999, 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.621 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.443810796999999, 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.437921851, 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.43631225, 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.414984549, 2024-09-12T18:15:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168096 5.3 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.166965+0000", 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4131853879999996, 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.059680915000000001, 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168096 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166965+0000", 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166965+0000", 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166966+0000", 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1800000000000005e-07 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166968+0000", 2024-09-12T18:15:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4619999999999999e-06 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166978+0000", 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6949999999999995e-06 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.166983+0000", 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0509999999999996e-06 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168768+0000", 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001784454 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168845+0000", 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7136000000000001e-05 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168910+0000", 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4763000000000003e-05 2024-09-12T18:15:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171369+0000", 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024596179999999998 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226475+0000", 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055105358 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226519+0000", 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4829000000000001e-05 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226646+0000", 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012683099999999999 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168099 5.2 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.168633+0000", 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.411517924, 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.058126749999999998, 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168099 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168633+0000", 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168633+0000", 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168634+0000", 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.049e-06 2024-09-12T18:15:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168638+0000", 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2640000000000002e-06 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168649+0000", 2024-09-12T18:15:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0611999999999999e-05 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.168655+0000", 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7719999999999997e-06 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169747+0000", 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001091091 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169811+0000", 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4468999999999995e-05 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169868+0000", 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7352999999999998e-05 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173287+0000", 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034181599999999999 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226604+0000", 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053317788999999997 2024-09-12T18:15:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226694+0000", 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9248999999999999e-05 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.226759+0000", 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5942e-05 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168101 5.3 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.169660+0000", 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4104910610000001, 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.059397410999999997, 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168101 2024-09-12T18:15:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169660+0000", 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169660+0000", 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169661+0000", 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4499999999999995e-07 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169665+0000", 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0130000000000004e-06 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169675+0000", 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0329000000000001e-05 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169682+0000", 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.691e-06 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170052+0000", 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0003701 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170159+0000", 2024-09-12T18:15:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010710299999999999 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170284+0000", 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125167 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173158+0000", 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002873881 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.228884+0000", 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055726502999999997 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.228961+0000", 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6922999999999995e-05 2024-09-12T18:15:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229057+0000", 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5755999999999996e-05 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168102 5.1 5:80e4cf92:::benchmark_data_smithi062_23645_object32993:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4103499389999996, 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.058117533999999998, 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168102 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169801+0000", 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169805+0000", 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7179999999999998e-06 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169814+0000", 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7409999999999998e-06 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.169820+0000", 2024-09-12T18:15:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9699999999999996e-06 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.172640+0000", 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028201680000000001 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.172918+0000", 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027845700000000002 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173035+0000", 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116613 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.176709+0000", 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036744439999999998 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227815+0000", 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051105659999999997 2024-09-12T18:15:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227869+0000", 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.435e-05 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227918+0000", 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8801000000000003e-05 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168104 5.2 5:4dec6130:::benchmark_data_smithi062_23645_object32995:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4099110799999997, 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.059033397000000001, 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168104 2024-09-12T18:15:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170240+0000", 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4600000000000003e-07 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170244+0000", 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3950000000000001e-06 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170252+0000", 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5450000000000003e-06 2024-09-12T18:15:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.170258+0000", 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2700000000000004e-06 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171128+0000", 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087003799999999995 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171228+0000", 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100494 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171289+0000", 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0585999999999999e-05 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.173525+0000", 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002236535 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229158+0000", 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.055632216999999998 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229222+0000", 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4144000000000001e-05 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229273+0000", 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1326999999999998e-05 2024-09-12T18:15:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168107 5.c 5:3fc50a68:::benchmark_data_smithi062_23645_object32998:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4086385559999997, 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.056405869999999997, 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168107 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:15:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171512+0000", 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7599999999999998e-07 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171514+0000", 2024-09-12T18:15:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8759999999999999e-06 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171524+0000", 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6090000000000007e-06 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171527+0000", 2024-09-12T18:15:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3900000000000002e-06 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171564+0000", 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6819000000000001e-05 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171666+0000", 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101671 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171770+0000", 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104308 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174344+0000", 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002573728 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227798+0000", 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.053454462000000001 2024-09-12T18:15:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227846+0000", 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7271999999999997e-05 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.227918+0000", 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2459000000000005e-05 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168109 5.3 5:c1cd4c10:::benchmark_data_smithi062_23645_object33000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4085708329999997, 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.057955781999999997, 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168109 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171580+0000", 2024-09-12T18:15:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.37e-07 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171583+0000", 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.83e-06 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171592+0000", 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5320000000000006e-06 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171597+0000", 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.887e-06 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171639+0000", 2024-09-12T18:15:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2221000000000001e-05 2024-09-12T18:15:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171743+0000", 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010401 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.171853+0000", 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109687 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174322+0000", 2024-09-12T18:15:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002469794 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229137+0000", 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054814401999999998 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229406+0000", 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000268681 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229536+0000", 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013010100000000001 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168112 5.3 5:ced8fad0:::benchmark_data_smithi062_23645_object33003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.174728+0000", 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4054222029999996, 2024-09-12T18:15:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.056536131000000003, 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168112 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174728+0000", 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174728+0000", 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174729+0000", 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3699999999999999e-07 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174734+0000", 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5109999999999997e-06 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174747+0000", 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3393999999999999e-05 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174755+0000", 2024-09-12T18:15:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4089999999999997e-06 2024-09-12T18:15:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174793+0000", 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174862+0000", 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9220999999999993e-05 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174927+0000", 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4605999999999998e-05 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177046+0000", 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021195720000000001 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.231092+0000", 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054045779000000002 2024-09-12T18:15:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.231170+0000", 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8228999999999999e-05 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.231265+0000", 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4215000000000005e-05 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168113 5.5 5:a9b73708:::benchmark_data_smithi062_23645_object33004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.174770+0000", 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4053804310000002, 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.054411152999999997, 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168113 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174770+0000", 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174770+0000", 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174771+0000", 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.06e-07 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174773+0000", 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5110000000000002e-06 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174780+0000", 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7599999999999997e-06 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174786+0000", 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0759999999999999e-06 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174839+0000", 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2580000000000001e-05 2024-09-12T18:15:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.174996+0000", 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000157381 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.175160+0000", 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016406 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177320+0000", 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002160389 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229074+0000", 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051753929999999997 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229128+0000", 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229181+0000", 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3078000000000002e-05 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:168116 5.5 5:a12d9f14:::benchmark_data_smithi062_23645_object33007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.402487088, 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051700232999999998, 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 168116 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.713 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177664+0000", 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8100000000000003e-07 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177667+0000", 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2449999999999998e-06 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177676+0000", 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1550000000000007e-06 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177681+0000", 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7570000000000001e-06 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177717+0000", 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.523e-05 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177790+0000", 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2966000000000006e-05 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.177848+0000", 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8307999999999998e-05 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.179863+0000", 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020150530000000002 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229234+0000", 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.049371203000000002 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229308+0000", 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3918999999999995e-05 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:57.229364+0000", 2024-09-12T18:15:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5816000000000002e-05 2024-09-12T18:15:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:01.719 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:01.721 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:01.721 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:01.717+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:01.821 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:01.818+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:01.872 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:01.872 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:179669 5.9 5:9fb1e4a1:::benchmark_data_smithi062_23645_object44560:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.867355+0000", 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0051437540000000004, 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051678549999999998, 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:01.873 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 179669 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867355+0000", 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867355+0000", 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867356+0000", 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4600000000000004e-07 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867359+0000", 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0199999999999999e-06 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867368+0000", 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2240000000000001e-06 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867374+0000", 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4659999999999998e-06 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867427+0000", 2024-09-12T18:15:01.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3186999999999997e-05 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867522+0000", 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5523e-05 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867596+0000", 2024-09-12T18:15:01.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3350999999999996e-05 2024-09-12T18:15:01.878 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.878 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.878 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.878 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:179670 5.d 5:b03461f3:::benchmark_data_smithi062_23645_object44561:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.867523+0000", 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049755900000000002, 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0050695530000000001, 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 179670 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867523+0000", 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867523+0000", 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.880 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867524+0000", 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4900000000000001e-07 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867526+0000", 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1670000000000002e-06 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867534+0000", 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.541e-06 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867540+0000", 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1050000000000003e-06 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.868940+0000", 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001400634 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.869016+0000", 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5328999999999997e-05 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179668 5.c e59/53 5:39d01c81:::benchmark_data_smithi062_23645_object44559:head v 59'11074, mlcod=59'11071)", 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.867620+0000", 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0048788709999999999, 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0050312330000000004, 2024-09-12T18:15:01.883 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867620+0000", 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867620+0000", 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867620+0000", 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.72e-07 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867624+0000", 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4290000000000001e-06 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867632+0000", 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1899999999999995e-06 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867636+0000", 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.765e-06 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867680+0000", 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4453999999999998e-05 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867694+0000", 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179671 5.6 e59/53 5:6931ab40:::benchmark_data_smithi062_23645_object44562:head v 59'11210, mlcod=59'11208)", 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.867925+0000", 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0045741999999999996, 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0047776909999999997, 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.887 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.888 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867925+0000", 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867925+0000", 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867925+0000", 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7300000000000001e-07 2024-09-12T18:15:01.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867928+0000", 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2049999999999998e-06 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867937+0000", 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.704e-06 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867941+0000", 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9659999999999998e-06 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.867988+0000", 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7194999999999998e-05 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.868008+0000", 2024-09-12T18:15:01.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9528999999999999e-05 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:179672 5.9 5:924dd69c:::benchmark_data_smithi062_23645_object44563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.870500+0000", 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0019987989999999999, 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022547029999999998, 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 179672 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870500+0000", 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870500+0000", 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870501+0000", 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2109999999999999e-06 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870506+0000", 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4599999999999996e-06 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870515+0000", 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870523+0000", 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3080000000000002e-06 2024-09-12T18:15:01.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870952+0000", 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000429374 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871039+0000", 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6657999999999996e-05 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:01.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871110+0000", 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1614999999999998e-05 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179673 5.c e59/53 5:3c59b609:::benchmark_data_smithi062_23645_object44564:head v 59'11075, mlcod=59'11072)", 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.870895+0000", 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001603461, 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001923864, 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.897 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870895+0000", 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870895+0000", 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870896+0000", 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9900000000000001e-07 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870901+0000", 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1399999999999999e-06 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870907+0000", 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4049999999999997e-06 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870912+0000", 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1239999999999998e-06 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870943+0000", 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1894000000000003e-05 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870955+0000", 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2057e-05 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.901 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179675 5.6 e59/53 5:6df9b1a5:::benchmark_data_smithi062_23645_object44566:head v 59'11211, mlcod=59'11208)", 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.870952+0000", 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001546862, 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001917466, 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870952+0000", 2024-09-12T18:15:01.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870952+0000", 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870953+0000", 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8100000000000003e-07 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870956+0000", 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1080000000000001e-06 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870962+0000", 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5740000000000001e-06 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.870966+0000", 2024-09-12T18:15:01.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.698e-06 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871005+0000", 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8946999999999998e-05 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871023+0000", 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8023999999999999e-05 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179677 5.1 e59/49 5:8127f0ed:::benchmark_data_smithi062_23645_object44568:head v 59'11242, mlcod=59'11240)", 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.871244+0000", 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0012553449999999999, 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001677879, 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871244+0000", 2024-09-12T18:15:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871244+0000", 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871244+0000", 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871251+0000", 2024-09-12T18:15:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0520000000000004e-06 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871262+0000", 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0528e-05 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871268+0000", 2024-09-12T18:15:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8760000000000002e-06 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871312+0000", 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4712000000000002e-05 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.871332+0000", 2024-09-12T18:15:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0137999999999999e-05 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179676 5.6 e59/53 5:6ea89666:::benchmark_data_smithi062_23645_object44567:head v 59'11212, mlcod=59'11208)", 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.872295+0000", 2024-09-12T18:15:01.912 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000204014, 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00067572800000000001, 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872295+0000", 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872295+0000", 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872296+0000", 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3300000000000002e-07 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872301+0000", 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5770000000000001e-06 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872308+0000", 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.233e-06 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872312+0000", 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9740000000000004e-06 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872341+0000", 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8405999999999999e-05 2024-09-12T18:15:01.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872355+0000", 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4593000000000001e-05 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:179679 5.9 5:958bc21c:::benchmark_data_smithi062_23645_object44570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.872365+0000", 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00013437400000000001, 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00065779300000000005, 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 179679 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.917 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872365+0000", 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872365+0000", 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872365+0000", 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1200000000000002e-07 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872368+0000", 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7800000000000001e-06 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872374+0000", 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1539999999999999e-06 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872378+0000", 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0609999999999997e-06 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872629+0000", 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025075999999999999 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872793+0000", 2024-09-12T18:15:01.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000163683 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872924+0000", 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013152899999999999 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:179678 5.1 e59/49 5:85480f44:::benchmark_data_smithi062_23645_object44569:head v 59'11243, mlcod=59'11240)", 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.872827+0000", 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9996719, 2024-09-12T18:15:01.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00025965199999999997, 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872827+0000", 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872827+0000", 2024-09-12T18:15:01.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872828+0000", 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4099999999999997e-07 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872834+0000", 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7790000000000001e-06 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872845+0000", 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1601e-05 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872853+0000", 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2740000000000002e-06 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872911+0000", 2024-09-12T18:15:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8096000000000001e-05 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.872926+0000", 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5077e-05 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:179666 5.d 5:bd6886c0:::benchmark_data_smithi062_23645_object44557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:01.866531+0000", 2024-09-12T18:15:01.925 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0059682390000000002, 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0066079909999999997, 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 179666 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866531+0000", 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866531+0000", 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866531+0000", 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1899999999999998e-07 2024-09-12T18:15:01.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866533+0000", 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.79e-06 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866543+0000", 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0351e-05 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:01.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866547+0000", 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1969999999999998e-06 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866757+0000", 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00020980599999999999 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.866893+0000", 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013595 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:01.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:01.873117+0000", 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0062240489999999997 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 12 2024-09-12T18:15:01.930 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:01.931 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:01.926+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:01.932 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:02.032 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:02.026+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:02.077 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:02.077 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:02.077 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:02.077 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:02.077 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:02.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:02.142 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:02.141+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:02.218 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:15:02.235 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:02.233+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:02.249 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 109.953862907, 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:02.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:02.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:02.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:02.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.259 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.853776026999995, 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:15:02.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:15:02.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:15:02.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:15:02.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.853685260999995, 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.267 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:15:02.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:15:02.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:15:02.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:15:02.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:15:02.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:15:02.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.853624237999995, 2024-09-12T18:15:02.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:15:02.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:15:02.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:15:02.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:15:02.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:15:02.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:15:02.282 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.853565478999997, 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.283 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.284 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.284 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:02.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:02.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:02.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:02.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.291 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.853502429000002, 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:02.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:02.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:02.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:02.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:02.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:02.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.852563853000007, 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:02.300 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:02.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:02.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.308 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.308 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:02.308 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.851910141999994, 2024-09-12T18:15:02.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:02.308 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.308 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.312 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:02.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.851823245000006, 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.315 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:15:02.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:15:02.320 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.851699623000002, 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:15:02.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:15:02.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:15:02.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.328 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 98.851308023000001, 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:02.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:15:02.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:15:02.333 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 34.992744995000002, 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.334 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:02.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 34.984722617999999, 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:02.341 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:02.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 34.973137332, 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.347 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:02.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:02.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.0857853479999999, 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:02.354 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:02.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:02.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:02.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:02.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:02.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:02.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:02.361 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.080811379, 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:02.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:02.363 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:02.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.0803424499999998, 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.368 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.369 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:02.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:02.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:02.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:02.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:02.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.376 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.0783011260000004, 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.377 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:02.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.381 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.381 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:02.384 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.0773933570000001, 2024-09-12T18:15:02.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:02.385 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.387 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.387 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.387 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.387 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:02.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:02.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:02.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:02.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:02.393 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.0769651539999998, 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:02.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:02.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:02.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:02.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.399 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:02.400 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:02.400 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:02.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:02.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:02.420 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:02.414+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:02.503 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:02.498+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:02.577 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:02.578 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:02.579 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:02.594 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:02.597 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:02.598 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:02.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:02.641 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:02.638+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:02.705 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:02.701+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:02.799 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:02.799 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:02.805 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:02.802+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:02.820 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:02.913 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:02.910+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:03.008 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:03.005+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:03.028 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:03.028 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:03.049 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:03.109 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:03.105+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:03.211 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:03.206+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:03.212 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:03.212 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:03.231 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:03.311 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:03.306+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:03.412 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:03.409+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:03.424 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:03.425 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:03.444 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:03.532 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:03.529+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:03.614 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:03.610+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:03.640 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:03.640 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:03.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:03.715 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:03.713+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:03.816 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:03.816 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:03.816 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:03.810+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:03.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:03.926 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:03.918+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:04.018 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:04.014+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:04.033 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:04.033 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:04.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:04.119 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:04.117+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:04.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-09-12T18:15:04.219 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:04.217+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:04.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:15:04.248 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:04.248 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:04.269 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:04.321 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:04.317+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:04.421 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:04.418+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:04.427 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:04.427 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:04.450 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:04.496 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:15:04.496 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:15:04.496 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T18:15:04.496 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.165487 2024-09-12T18:15:04.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.1654874991699694 2024-09-12T18:15:04.539 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:04.537+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:04.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:04.623 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:04.621+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:04.640 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:04.640 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:04.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:04.724 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:04.718+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:04.725 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:04.758 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:04.759 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:04.776 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:04.779 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:04.780 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:04.824 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:04.818+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 112.563257049, 2024-09-12T18:15:04.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:04.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:04.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:04.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.46317016899999, 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.025576458999999999, 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.867 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394248+0000", 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394249+0000", 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.277e-06 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394282+0000", 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3402999999999999e-05 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394302+0000", 2024-09-12T18:15:04.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9973e-05 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394316+0000", 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4195999999999999e-05 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401106+0000", 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0067893509999999999 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401414+0000", 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030803100000000001 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401760+0000", 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00034599099999999997 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.407833+0000", 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0060736999999999996 2024-09-12T18:15:04.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419590+0000", 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011756429000000001 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419723+0000", 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000133156 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419824+0000", 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010095200000000001 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:04.873 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.46307940299999, 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032497506000000002, 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394338+0000", 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394340+0000", 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.457e-06 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394346+0000", 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5799999999999997e-06 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394364+0000", 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7710000000000002e-05 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394379+0000", 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.455e-05 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403725+0000", 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0093464040000000009 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403949+0000", 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000223635 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404291+0000", 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000342164 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411889+0000", 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075982640000000004 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.878 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426584+0000", 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014694830000000001 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426733+0000", 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014918599999999999 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.426836+0000", 2024-09-12T18:15:04.879 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010272600000000001 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.46301837999999, 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032919711999999997, 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.880 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394399+0000", 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394401+0000", 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.237e-06 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394408+0000", 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394426+0000", 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8876e-05 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394440+0000", 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3546999999999999e-05 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412256+0000", 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017816045999999999 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412553+0000", 2024-09-12T18:15:04.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029713999999999999 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.412828+0000", 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00027494200000000002 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417797+0000", 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049693080000000004 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.884 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427072+0000", 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0092749719999999994 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427216+0000", 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000143265 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427319+0000", 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103386 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.885 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.462959621, 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.886 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:04.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:04.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.462896571, 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:04.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:04.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.897 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.46195799500001, 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:04.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:04.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.46130428399999, 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.903 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:04.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:20 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.461217387, 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032580545000000002, 2024-09-12T18:15:04.909 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396200+0000", 2024-09-12T18:15:04.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396202+0000", 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.296e-06 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396209+0000", 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.25e-06 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396227+0000", 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396240+0000", 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3244000000000001e-05 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398699+0000", 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002458521 2024-09-12T18:15:04.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398909+0000", 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000209848 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.399158+0000", 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024949500000000002 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.404299+0000", 2024-09-12T18:15:04.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051405640000000002 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428469+0000", 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.024170434000000001 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428703+0000", 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000233558 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.914 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428781+0000", 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8019e-05 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:23 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.461093765, 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.031375707000000003, 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.915 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396324+0000", 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396325+0000", 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.44e-06 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396334+0000", 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9099999999999994e-06 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396354+0000", 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0089e-05 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396369+0000", 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4464000000000001e-05 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396498+0000", 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012950900000000001 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396837+0000", 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033898400000000002 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.397133+0000", 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029615400000000002 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.401156+0000", 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040229619999999997 2024-09-12T18:15:04.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427465+0000", 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.026308337000000001 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427603+0000", 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013836600000000001 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.920 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427700+0000", 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6491999999999997e-05 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:26 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 101.460702165, 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032999672000000001, 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:04.921 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396716+0000", 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396718+0000", 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1799999999999999e-06 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396726+0000", 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8499999999999994e-06 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398349+0000", 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016234940000000001 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.398399+0000", 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9879999999999997e-05 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408234+0000", 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0098353840000000008 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.408529+0000", 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029512800000000002 2024-09-12T18:15:04.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429715+0000", 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.021185756 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 37.602139137000002, 2024-09-12T18:15:04.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.927 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.928 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:04.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:04.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:04.931 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 37.594116759999999, 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:04.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.934 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:04.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:04.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 37.582531474, 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.938 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:04.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:04.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.6951794900000001, 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.944 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:04.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:04.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.6902055210000002, 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.950 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:04.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:04.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.689736592, 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:04.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:04.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:04.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.961 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.6876952679999997, 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:04.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:04.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.6867874990000002, 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:04.966 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:04.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.970 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 7.686359296, 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:04.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:04.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:04.975 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:04.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:04.978 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:04.970+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:05.077 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:05.073+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187394 5.1 5:8da86842:::benchmark_data_smithi062_23645_object52285:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061031+0000", 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.049821192, 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.049849313999999999, 2024-09-12T18:15:05.111 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187394 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061031+0000", 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061031+0000", 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061032+0000", 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9999999999999996e-07 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061036+0000", 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1370000000000004e-06 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061045+0000", 2024-09-12T18:15:05.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7520000000000002e-06 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061051+0000", 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4099999999999996e-06 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061099+0000", 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7954000000000002e-05 2024-09-12T18:15:05.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.056547081999999999, 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.056623054999999999, 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.116 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:05.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:05.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:05.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:05.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:05.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:05.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187385 5.4 5:296d5edf:::benchmark_data_smithi062_23645_object52276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.123 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.059627+0000", 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.051225739999999999, 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.051348851000000001, 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187385 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059627+0000", 2024-09-12T18:15:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059627+0000", 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059628+0000", 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1800000000000004e-07 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059632+0000", 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.109e-06 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059641+0000", 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.859e-06 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059648+0000", 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.224e-06 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059691+0000", 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3049000000000001e-05 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059758+0000", 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7649000000000002e-05 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.128 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187386 5.e 5:7a4a52df:::benchmark_data_smithi062_23645_object52277:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060477+0000", 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.050374921000000003, 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.050537051, 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187386 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060477+0000", 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060477+0000", 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060478+0000", 2024-09-12T18:15:05.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6899999999999996e-07 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060482+0000", 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0430000000000001e-06 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060493+0000", 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0295000000000001e-05 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060499+0000", 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.054e-06 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060551+0000", 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2311000000000001e-05 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060645+0000", 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3925000000000006e-05 2024-09-12T18:15:05.132 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187388 5.0 5:0809519d:::benchmark_data_smithi062_23645_object52279:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060523+0000", 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.050328927000000002, 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.050530147999999997, 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.133 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187388 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060523+0000", 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060523+0000", 2024-09-12T18:15:05.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060524+0000", 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7800000000000002e-07 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060526+0000", 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4250000000000001e-06 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060533+0000", 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.703e-06 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060539+0000", 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6969999999999998e-06 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060588+0000", 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8983999999999997e-05 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060692+0000", 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010446900000000001 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.050095353000000002, 2024-09-12T18:15:05.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.050334825, 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:05.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:05.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.142 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5.46a581e2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.050051387000000003, 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.050330751999999999, 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.146 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187390 5.f e60/53 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head v 60'11829, mlcod=60'11827)", 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060990+0000", 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.049862308000000001, 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.050175627, 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060990+0000", 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060990+0000", 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060991+0000", 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6899999999999997e-07 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060995+0000", 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5070000000000002e-06 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061003+0000", 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1049999999999995e-06 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061008+0000", 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061049+0000", 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0778999999999997e-05 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061070+0000", 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1178999999999998e-05 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187389 5.7 e60/21)", 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061021+0000", 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.049831633, 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.050175955000000001, 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061021+0000", 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061021+0000", 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061021+0000", 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5600000000000002e-07 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061024+0000", 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6800000000000002e-06 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061029+0000", 2024-09-12T18:15:05.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0610000000000003e-06 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061033+0000", 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2130000000000002e-06 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 9 2024-09-12T18:15:05.155 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:05.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:05.178 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:05.173+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:05.226 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:15:05.226 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.0 primary-affinity to 0.165487 (8108452) 2024-09-12T18:15:05.278 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:05.274+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:05.312 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:05.312 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:05.312 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:05.312 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:05.312 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:05.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:05.419 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:05.414+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:05.480 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:05.474+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:05.531 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.413297276000002, 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.399896169000002, 2024-09-12T18:15:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.393322486999999, 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.393210572000001, 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.387321625999999, 2024-09-12T18:15:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.385712025, 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.364384324, 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186998 5.5 5:abc1ca4a:::benchmark_data_smithi062_23645_object51889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69910483499999998, 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068453476999999999, 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186998 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830447+0000", 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830451+0000", 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830462+0000", 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0825000000000001e-05 2024-09-12T18:15:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830473+0000", 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830518+0000", 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4987000000000001e-05 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830623+0000", 2024-09-12T18:15:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010490899999999999 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830685+0000", 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1198999999999995e-05 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898706+0000", 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068020924999999996 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898763+0000", 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7914999999999997e-05 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898857+0000", 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3558000000000001e-05 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898899+0000", 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.21e-05 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186999 5.5 5:a5be6d45:::benchmark_data_smithi062_23645_object51890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69899555400000002, 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068700116000000006, 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186999 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830556+0000", 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830558+0000", 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830567+0000", 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830572+0000", 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.271e-06 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832086+0000", 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015141309999999999 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832189+0000", 2024-09-12T18:15:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010328299999999999 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832299+0000", 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109885 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898720+0000", 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066420542999999999 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899137+0000", 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041740499999999998 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899203+0000", 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5494999999999995e-05 2024-09-12T18:15:05.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899255+0000", 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2405999999999999e-05 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.584 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187000 5.5 5:ad951543:::benchmark_data_smithi062_23645_object51891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69888822500000003, 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068743992000000004, 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.585 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187000 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830663+0000", 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830666+0000", 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9050000000000001e-06 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830677+0000", 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0988000000000001e-05 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830682+0000", 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833659+0000", 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029767460000000002 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833755+0000", 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5978999999999997e-05 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833872+0000", 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116779 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898726+0000", 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064854262999999995 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899306+0000", 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057974299999999997 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899362+0000", 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6567999999999998e-05 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899406+0000", 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4081e-05 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187004 5.3 5:c7ad184c:::benchmark_data_smithi062_23645_object51895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69796669, 2024-09-12T18:15:05.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067576516000000003, 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187004 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.594 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:05.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831587+0000", 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0000000000000001e-06 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831597+0000", 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3919999999999992e-06 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831601+0000", 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.211e-06 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832123+0000", 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052220999999999995 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832228+0000", 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104901 2024-09-12T18:15:05.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832332+0000", 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104298 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834361+0000", 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020281549999999998 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898978+0000", 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064617544999999998 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899052+0000", 2024-09-12T18:15:05.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4402999999999999e-05 2024-09-12T18:15:05.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899160+0000", 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010777600000000001 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187006 5.5 5:ab27be23:::benchmark_data_smithi062_23645_object51897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69693457599999997, 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070397003999999999, 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187006 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832617+0000", 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832620+0000", 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999999e-06 2024-09-12T18:15:05.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832630+0000", 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2529999999999993e-06 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832637+0000", 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.866e-06 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835192+0000", 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025558999999999998 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835290+0000", 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7355000000000006e-05 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835381+0000", 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1231999999999997e-05 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899455+0000", 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064073781999999996 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902827+0000", 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003372103 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902954+0000", 2024-09-12T18:15:05.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012695 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903013+0000", 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8956999999999998e-05 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187002 5.f e60/53 5:f316353f:::benchmark_data_smithi062_23645_object51893:head v 60'11800, mlcod=60'11795)", 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:05.607 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.695613229, 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067384802999999993, 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:05.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833938+0000", 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9200000000000002e-07 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833958+0000", 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833964+0000", 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8480000000000003e-06 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833969+0000", 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5009999999999998e-06 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834034+0000", 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4665999999999994e-05 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834053+0000", 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9221000000000001e-05 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901272+0000", 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067219152000000004 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901322+0000", 2024-09-12T18:15:05.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.011e-05 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187008 5.0 5:09c03dc0:::benchmark_data_smithi062_23645_object51899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69555307700000002, 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067136113999999997, 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187008 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833998+0000", 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834002+0000", 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834028+0000", 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5894e-05 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834037+0000", 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834094+0000", 2024-09-12T18:15:05.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6916000000000002e-05 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834215+0000", 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121709 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.900976+0000", 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066761176000000005 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901041+0000", 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4304e-05 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901133+0000", 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.268e-05 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.617 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187011 5.6 5:6422621a:::benchmark_data_smithi062_23645_object51902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69500283100000004, 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067142944999999996, 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187011 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834553+0000", 2024-09-12T18:15:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834562+0000", 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834570+0000", 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834630+0000", 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9957000000000002e-05 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834731+0000", 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100751 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834834+0000", 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010338199999999999 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899126+0000", 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064291736000000002 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901333+0000", 2024-09-12T18:15:05.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022070890000000002 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901538+0000", 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020443600000000001 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901691+0000", 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152817 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187014 5.2 5:45b0919f:::benchmark_data_smithi062_23645_object51905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.69368138800000001, 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067748596999999994, 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.625 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187014 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835870+0000", 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.285e-06 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835883+0000", 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2276000000000001e-05 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835893+0000", 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:15:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835900+0000", 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835956+0000", 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6276000000000001e-05 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898671+0000", 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.062715530000000005 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898855+0000", 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183284 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903145+0000", 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042906580000000001 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903556+0000", 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041042800000000001 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903590+0000", 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4440000000000002e-05 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903618+0000", 2024-09-12T18:15:05.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7521999999999998e-05 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.47524517100000002, 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070729645999999993, 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:05.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124936+0000", 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064320978000000001 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124991+0000", 2024-09-12T18:15:05.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5550999999999997e-05 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125035+0000", 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3859999999999997e-05 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.468793442, 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068614100999999997, 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.638 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:05.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126682+0000", 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.065744891 2024-09-12T18:15:05.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129287+0000", 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026049409999999999 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129333+0000", 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016999999999997e-05 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129371+0000", 2024-09-12T18:15:05.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7796000000000002e-05 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5:4781a562:::benchmark_data_smithi062_23645_object52283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.468749476, 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.073009940999999995, 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.644 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:05.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124774+0000", 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.063958509999999996 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124908+0000", 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013461199999999999 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125013+0000", 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104153 2024-09-12T18:15:05.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129380+0000", 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043676100000000001 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133738+0000", 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043580950000000002 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133769+0000", 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1032999999999999e-05 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133811+0000", 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187395 5.a 5:58aaa639:::benchmark_data_smithi062_23645_object52286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:05.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.46817174900000003, 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068114076999999995, 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187395 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:05.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061383+0000", 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.72e-06 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122886+0000", 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.061503331000000001 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122905+0000", 2024-09-12T18:15:05.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029e-05 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126609+0000", 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037042030000000001 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126714+0000", 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010544600000000001 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:05.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129385+0000", 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026710869999999999 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129433+0000", 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7567e-05 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129493+0000", 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.995e-05 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.655 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:05.656 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:05.656 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:05.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:05.658 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:05.652+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:05.758 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:05.754+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:05.816 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:05.816 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:05.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.816 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:189015 5.9 e61/53)", 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.813249+0000", 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0027359200000000002, 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002753592, 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813249+0000", 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813249+0000", 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813249+0000", 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2700000000000001e-07 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813251+0000", 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.95e-06 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813256+0000", 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6959999999999996e-06 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813260+0000", 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3100000000000002e-06 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.819 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:189042 5.f 5:f83b8eff:::benchmark_data_smithi062_23645_object53933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.813706+0000", 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0022792390000000002, 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023546650000000001, 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 189042 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813706+0000", 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813706+0000", 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813706+0000", 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5700000000000002e-07 2024-09-12T18:15:05.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813709+0000", 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8509999999999999e-06 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813715+0000", 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1959999999999996e-06 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813719+0000", 2024-09-12T18:15:05.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1110000000000001e-06 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814930+0000", 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001210781 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.815110+0000", 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017930800000000001 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.823 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.815259+0000", 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014966 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:189041 5.1 e61/49)", 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.813967+0000", 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020182220000000001, 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021614770000000002, 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.824 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813967+0000", 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813967+0000", 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813967+0000", 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8500000000000001e-07 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813985+0000", 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7482999999999998e-05 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813992+0000", 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0849999999999999e-06 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813996+0000", 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5460000000000002e-06 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:189040 5.2 e61/49 5:47cb73dd:::benchmark_data_smithi062_23645_object53931:head v 61'11839, mlcod=61'11836)", 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.814003+0000", 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0019813880000000002, 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021713790000000002, 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.827 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814003+0000", 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814003+0000", 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814004+0000", 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7099999999999998e-07 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814006+0000", 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9010000000000001e-06 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814011+0000", 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5219999999999998e-06 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814013+0000", 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2900000000000001e-06 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814050+0000", 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6452999999999998e-05 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.814062+0000", 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2301e-05 2024-09-12T18:15:05.830 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:189022 5.9 e61/53)", 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.815983+0000", 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.7990000000000001e-06, 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00024611400000000002, 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.815983+0000", 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.815983+0000", 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.815984+0000", 2024-09-12T18:15:05.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.223e-06 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.815992+0000", 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8869999999999992e-06 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816018+0000", 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5814999999999999e-05 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816041+0000", 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3139e-05 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:189028 5.f e61/53)", 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.816172+0000", 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9998131, 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000100166, 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.834 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816172+0000", 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816172+0000", 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816173+0000", 2024-09-12T18:15:05.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816179+0000", 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4920000000000001e-06 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816193+0000", 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4085e-05 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.836 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816206+0000", 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2995e-05 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:189030 5.7 e61/21)", 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.816237+0000", 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9997478, 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7311000000000005e-05, 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.837 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816237+0000", 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816237+0000", 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.838 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816238+0000", 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2399999999999997e-07 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816242+0000", 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1760000000000003e-06 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816255+0000", 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.291e-05 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.839 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816264+0000", 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3840000000000003e-06 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:189035 5.f e61/53)", 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.816284+0000", 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9997015, 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3500999999999999e-05, 2024-09-12T18:15:05.840 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816284+0000", 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816284+0000", 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816284+0000", 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816300+0000", 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6177000000000001e-05 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816308+0000", 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1610000000000003e-06 2024-09-12T18:15:05.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816313+0000", 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4299999999999999e-06 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:189015 5.9 5:923830bd:::benchmark_data_smithi062_23645_object53906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.802971+0000", 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.013014016, 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.013445904, 2024-09-12T18:15:05.843 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 189015 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.802971+0000", 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.802971+0000", 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.802972+0000", 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.802975+0000", 2024-09-12T18:15:05.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.67e-06 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.802985+0000", 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3139999999999993e-06 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.802991+0000", 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5939999999999999e-06 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.806851+0000", 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0038598270000000001 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.806993+0000", 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014228600000000001 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.807124+0000", 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000130872 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.810800+0000", 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003675738 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:189039 5.f e61/53)", 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.816321+0000", 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9996643, 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017027700000000001, 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.848 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816321+0000", 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816321+0000", 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816321+0000", 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.36e-07 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816323+0000", 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.779e-06 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816329+0000", 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2999999999999998e-06 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816333+0000", 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2359999999999998e-06 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:189022 5.9 5:9ab705f9:::benchmark_data_smithi062_23645_object53913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.805075+0000", 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.010910227, 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.011465664, 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.851 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 189022 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.805075+0000", 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.805075+0000", 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.805076+0000", 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6299999999999993e-07 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.805080+0000", 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6399999999999996e-06 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.805091+0000", 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0722e-05 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.805099+0000", 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2390000000000002e-06 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.808730+0000", 2024-09-12T18:15:05.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0036311389999999998 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.808920+0000", 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018969599999999999 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.809096+0000", 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017621299999999999 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:189031 5.1 e61/49 5:80941448:::benchmark_data_smithi062_23645_object53922:head v 61'11818, mlcod=61'11814)", 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.810995+0000", 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0049901920000000001, 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0056316559999999996, 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.810995+0000", 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.810995+0000", 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.810995+0000", 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8200000000000001e-07 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.810997+0000", 2024-09-12T18:15:05.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.531e-06 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811003+0000", 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5219999999999998e-06 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811008+0000", 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5390000000000001e-06 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811175+0000", 2024-09-12T18:15:05.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000167727 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811193+0000", 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7261999999999998e-05 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:189035 5.f 5:f71eb59c:::benchmark_data_smithi062_23645_object53926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.811105+0000", 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0048801540000000003, 2024-09-12T18:15:05.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0055772230000000001, 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 189035 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811105+0000", 2024-09-12T18:15:05.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811105+0000", 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811106+0000", 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811109+0000", 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811118+0000", 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7830000000000004e-06 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811125+0000", 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5519999999999999e-06 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811181+0000", 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5389000000000001e-05 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811316+0000", 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000134845 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.811445+0000", 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012897000000000001 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816636+0000", 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0051918010000000002 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:189039 5.f 5:f19b8caa:::benchmark_data_smithi062_23645_object53930:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.812892+0000", 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0030927260000000001, 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0038826009999999998, 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:05.864 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 189039 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.812892+0000", 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:05.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.812892+0000", 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.812893+0000", 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.540000000000001e-07 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.812896+0000", 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3799999999999998e-06 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.812906+0000", 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.812912+0000", 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1160000000000004e-06 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813451+0000", 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00053839299999999997 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813594+0000", 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014366100000000001 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.813747+0000", 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015311200000000001 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.816681+0000", 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029331169999999998 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.868 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:05.869 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.869 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:05.869 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:05.869 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 14 2024-09-12T18:15:05.869 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:05.870 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:05.871 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:05.864+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:05.971 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:05.966+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:06.065 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:06.065 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:06.065 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:06.065 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:06.065 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:06.071 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:06.066+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:06.085 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:06.172 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:06.166+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 113.942783577, 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:06.238 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:06.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:06.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.244 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:06.245 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 102.842486149, 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:06.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:06.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:06.251 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 102.842423099, 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.252 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:06.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 102.84148452300001, 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:06.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.264 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 102.84083081199999, 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:06.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.270 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.981665665000001, 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.271 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:06.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:06.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:06.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.973643287999998, 2024-09-12T18:15:06.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:06.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:06.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:06.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.962058001999999, 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:06.284 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:06.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:06.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:06.291 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.0747060180000005, 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.292 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:06.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:06.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:06.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.296 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.299 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.0697320490000006, 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.300 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.301 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.301 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.301 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:06.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.302 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:06.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:06.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:06.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:06.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:06.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:06.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:06.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.307 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.307 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:06.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:06.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:06.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:06.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:06.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:06.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:06.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:06.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.311 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.0692631200000005, 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.312 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:06.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:06.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:06.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:06.318 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.0672217960000001, 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.0663140270000007, 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:06.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:06.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.329 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.0658858240000004, 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:06.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:06.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:06.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:06.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:06.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:06.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:06.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:06.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:06.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:06.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:06.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:06.337 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.337 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.337 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.338 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:06.338 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:06.338 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.405355677, 2024-09-12T18:15:06.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:06.339 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.339 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.339 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.339 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.339 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.340 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.340 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:06.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.340 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:06.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.342 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:06.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:06.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:06.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:06.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:06.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:06.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:06.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:06.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:06.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:06.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:06.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:06.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:06.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:06.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:06.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:06.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:06.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:06.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:06.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:06.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:06.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:06.352 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.352 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.352 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.353 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:06.353 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:06.353 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.403111056, 2024-09-12T18:15:06.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:06.354 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.354 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.354 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.354 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.354 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:06.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.358 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:06.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.4005778150000001, 2024-09-12T18:15:06.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:06.362 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.362 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.362 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.362 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.362 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.362 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:06.364 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.365 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:06.366 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.367 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:06.368 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.400119825, 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.369 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.370 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.371 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.372 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:06.373 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.374 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:06.375 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.1756223429999999, 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.376 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.377 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.378 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.379 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.380 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:06.380 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:06.380 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.380 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.380 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:06.381 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.382 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.383 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 1.1755888130000001, 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:06.384 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.385 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.386 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.386 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:06.386 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:06.386 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:06.386 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.386 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:06.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:06.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:06.388 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:06.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:06.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:06.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:06.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:06.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:06.394 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:06.395 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:06.397 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:06.390+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:06.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:06.497 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:06.490+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:06.569 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:06.569 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:06.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.570 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190912 5.5 5:aedd989a:::benchmark_data_smithi062_23645_object55803:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.570 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.562566+0000", 2024-09-12T18:15:06.570 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0051370879999999997, 2024-09-12T18:15:06.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051601859999999998, 2024-09-12T18:15:06.570 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190912 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562566+0000", 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562566+0000", 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562566+0000", 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2999999999999999e-07 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562575+0000", 2024-09-12T18:15:06.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3669999999999997e-06 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562584+0000", 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8319999999999995e-06 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562591+0000", 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6960000000000005e-06 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562646+0000", 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4923000000000003e-05 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562757+0000", 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110411 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562858+0000", 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010156400000000001 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:06.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565577+0000", 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027184430000000001 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:190913 5.9 e61/53 5:91d1a807:::benchmark_data_smithi062_23645_object55804:head v 61'11899, mlcod=61'11896)", 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.562997+0000", 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047058819999999998, 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048104489999999996, 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562997+0000", 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562997+0000", 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.562997+0000", 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563003+0000", 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2120000000000002e-06 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563012+0000", 2024-09-12T18:15:06.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6809999999999993e-06 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563019+0000", 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3589999999999996e-06 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565602+0000", 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025833150000000001 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565619+0000", 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7135000000000001e-05 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190915 5.2 5:4572ae79:::benchmark_data_smithi062_23645_object55806:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.563698+0000", 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0040050679999999996, 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041640460000000002, 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.579 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190915 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563698+0000", 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563698+0000", 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563698+0000", 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3500000000000002e-07 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563700+0000", 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.119e-06 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563707+0000", 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.563712+0000", 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4920000000000004e-06 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564113+0000", 2024-09-12T18:15:06.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040130299999999999 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564220+0000", 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010741199999999999 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564325+0000", 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104626 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190916 5.5 5:a58bb2f8:::benchmark_data_smithi062_23645_object55807:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.564084+0000", 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0036186529999999999, 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038443890000000001, 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.584 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190916 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564084+0000", 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564084+0000", 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564085+0000", 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4300000000000003e-07 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564089+0000", 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8850000000000001e-06 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564097+0000", 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2719999999999997e-06 2024-09-12T18:15:06.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564103+0000", 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3759999999999996e-06 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564246+0000", 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014253200000000001 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564358+0000", 2024-09-12T18:15:06.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112657 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564462+0000", 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010323999999999999 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565790+0000", 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013284799999999999 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190917 5.c 5:3e5afcc7:::benchmark_data_smithi062_23645_object55808:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.564884+0000", 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028183940000000001, 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031179630000000001, 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190917 2024-09-12T18:15:06.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564884+0000", 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564884+0000", 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564895+0000", 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0971e-05 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564900+0000", 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.028e-06 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564912+0000", 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:15:06.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564920+0000", 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6090000000000003e-06 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565368+0000", 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00044802399999999999 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565592+0000", 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000224014 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565654+0000", 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2088000000000006e-05 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190918 5.1 5:89a8a8c9:::benchmark_data_smithi062_23645_object55809:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.593 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.564951+0000", 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027515560000000001, 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031153140000000001, 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190918 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564951+0000", 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564951+0000", 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564952+0000", 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.92e-07 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564955+0000", 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2229999999999999e-06 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564964+0000", 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8049999999999996e-06 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.564970+0000", 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.993e-06 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565011+0000", 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1038000000000002e-05 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565113+0000", 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101675 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565209+0000", 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6028999999999998e-05 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190919 5.8 5:16bbf5fb:::benchmark_data_smithi062_23645_object55810:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.565194+0000", 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0025082939999999999, 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029387829999999999, 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.598 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190919 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565194+0000", 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565194+0000", 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565195+0000", 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.09e-07 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565199+0000", 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6490000000000001e-06 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565209+0000", 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0084e-05 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565217+0000", 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6380000000000004e-06 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.565940+0000", 2024-09-12T18:15:06.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00072347299999999998 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566057+0000", 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117377 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190921 5.4 5:2896e49d:::benchmark_data_smithi062_23645_object55812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.566216+0000", 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014867439999999999, 2024-09-12T18:15:06.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00198051, 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190921 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566216+0000", 2024-09-12T18:15:06.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566216+0000", 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566217+0000", 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4600000000000003e-07 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566220+0000", 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7249999999999999e-06 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566232+0000", 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1066999999999999e-05 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566238+0000", 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3539999999999996e-06 2024-09-12T18:15:06.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566338+0000", 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010043999999999999 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566442+0000", 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010336399999999999 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190922 5.3 5:cb312ce7:::benchmark_data_smithi062_23645_object55813:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.566254+0000", 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001448672, 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002002289, 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190922 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.607 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566254+0000", 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566254+0000", 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566254+0000", 2024-09-12T18:15:06.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9499999999999998e-07 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566257+0000", 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.446e-06 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566264+0000", 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9940000000000003e-06 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566269+0000", 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9200000000000003e-06 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566371+0000", 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010225000000000001 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566472+0000", 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010132 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566583+0000", 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011099699999999999 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190923 5.c 5:3c049ba3:::benchmark_data_smithi062_23645_object55814:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.566278+0000", 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001424324, 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020462200000000001, 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.611 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190923 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566278+0000", 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566278+0000", 2024-09-12T18:15:06.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566279+0000", 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999998e-07 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566281+0000", 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.244e-06 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566293+0000", 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2544999999999999e-05 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566302+0000", 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780000000000006e-06 2024-09-12T18:15:06.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567173+0000", 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087078000000000003 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567277+0000", 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010374000000000001 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567390+0000", 2024-09-12T18:15:06.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113164 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190924 5.2 5:4d6e2c49:::benchmark_data_smithi062_23645_object55815:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.566315+0000", 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001387374, 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020689520000000002, 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190924 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566315+0000", 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566315+0000", 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566316+0000", 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0160000000000001e-06 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566320+0000", 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8029999999999998e-06 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566333+0000", 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2751999999999999e-05 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.566339+0000", 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9460000000000003e-06 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567660+0000", 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013213750000000001 2024-09-12T18:15:06.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567760+0000", 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100295 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567856+0000", 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5354999999999998e-05 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190925 5.5 5:aa5dc4ed:::benchmark_data_smithi062_23645_object55816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.567636+0000", 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.6464999999999995e-05, 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00080626099999999996, 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190925 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.622 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567636+0000", 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567636+0000", 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567637+0000", 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567642+0000", 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9880000000000004e-06 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567656+0000", 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869999999999999e-05 2024-09-12T18:15:06.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567663+0000", 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9070000000000001e-06 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567716+0000", 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3193999999999999e-05 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567835+0000", 2024-09-12T18:15:06.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118396 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567941+0000", 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105926 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190926 5.6 5:6695cfa0:::benchmark_data_smithi062_23645_object55817:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.567678+0000", 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 2.4851999999999999e-05, 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00082249600000000003, 2024-09-12T18:15:06.626 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190926 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567678+0000", 2024-09-12T18:15:06.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567678+0000", 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567678+0000", 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567681+0000", 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.463e-06 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567687+0000", 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6649999999999997e-06 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567694+0000", 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6749999999999996e-06 2024-09-12T18:15:06.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567777+0000", 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2798000000000002e-05 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190927 5.6 5.4a0e5a76 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.567711+0000", 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999919, 2024-09-12T18:15:06.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084128000000000002, 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190927 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567711+0000", 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567711+0000", 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567711+0000", 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567714+0000", 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3700000000000002e-06 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567720+0000", 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3459999999999999e-06 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567725+0000", 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0669999999999999e-06 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:190928 5.a 5:58e1753d:::benchmark_data_smithi062_23645_object55819:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.567907+0000", 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997954, 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00069160599999999999, 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 190928 2024-09-12T18:15:06.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567907+0000", 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567907+0000", 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567908+0000", 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567915+0000", 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3839999999999999e-06 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567924+0000", 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2309999999999996e-06 2024-09-12T18:15:06.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567930+0000", 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0730000000000001e-06 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567979+0000", 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9815999999999999e-05 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.568096+0000", 2024-09-12T18:15:06.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116642 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "MOSDPGPush(5.9 61/53 [PushOp(5:966796ab:::benchmark_data_smithi062_23645_object66461:head, version: 35'4157, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:966796ab:::benchmark_data_smithi062_23645_object66461:head@35'4157, size: 65536, copy_subset: [(0, 65536)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 65536, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:06.567872+0000", 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998307, 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00080516500000000005, 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:06.638 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567872+0000", 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567872+0000", 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567872+0000", 2024-09-12T18:15:06.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1399999999999997e-07 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567923+0000", 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0900999999999999e-05 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567941+0000", 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7839999999999999e-05 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:06.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:06.567955+0000", 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4445e-05 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 16 2024-09-12T18:15:06.641 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:06.642 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:06.640+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:06.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:06.743 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:06.738+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:06.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:06.844 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:06.840+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:06.847 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:06.848 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:06.848 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:06.848 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:06.848 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:06.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:06.933 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:06.945 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:06.940+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:06.955 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:06.955 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:06.974 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:06.974 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:06.977 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:06.978 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:07.047 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.042+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.070 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:07.071 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:07.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:07.147 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.142+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:07.247 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:07.248 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.242+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:15:07.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:07.349 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.346+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.419 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:07.419 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:07.437 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:07.450 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.446+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.551 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.546+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.595 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:07.595 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:07.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:07.652 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:07.648+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:07.753 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.750+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.775 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:07.775 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:07.796 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:07.881 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:07.878+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:07.957 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:07.952+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:07.993 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:07.993 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:08.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:08.057 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:08.054+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:08.157 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:08.152+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:08.207 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:08.207 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:08.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:08.257 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:15:08.274 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:08.272+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:08.359 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:08.354+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:08.380 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:08.380 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:08.400 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:08.488 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:08.484+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:08.561 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:08.556+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:08.592 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:08.592 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:08.612 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:08.698 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:08.696+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:08.763 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:08.758+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:08.807 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:08.807 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:08.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:08.870 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:08.868+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:08.965 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:08.958+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:08.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:08.987 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:08.987 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:09.008 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:09.066 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:09.060+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:09.118 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:09.137 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:09.155 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:09.155 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:09.158 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:09.159 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:09.167 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:09.164+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:09.205 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:09.205 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:09.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:09.267 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:09.264+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:09.368 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:09.364+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:09.393 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:09.393 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:09.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:09.393 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.275400495, 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:09.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.261999388, 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.399 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:09.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.255425706, 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:09.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:09.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:09.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.255313790999999, 2024-09-12T18:15:09.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:09.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.249424845, 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:09.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:09.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.247815244000002, 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:09.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:09.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:09.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:09.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.226487543000001, 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.426 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:09.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.430 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186998 5.5 5:abc1ca4a:::benchmark_data_smithi062_23645_object51889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5612080539999997, 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068453476999999999, 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.431 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186998 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830447+0000", 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830451+0000", 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830462+0000", 2024-09-12T18:15:09.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0825000000000001e-05 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830473+0000", 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830518+0000", 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4987000000000001e-05 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830623+0000", 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010490899999999999 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830685+0000", 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1198999999999995e-05 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898706+0000", 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068020924999999996 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898763+0000", 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7914999999999997e-05 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898857+0000", 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3558000000000001e-05 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898899+0000", 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.21e-05 2024-09-12T18:15:09.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186999 5.5 5:a5be6d45:::benchmark_data_smithi062_23645_object51890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5610987730000003, 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068700116000000006, 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.437 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186999 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830556+0000", 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830558+0000", 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830567+0000", 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830572+0000", 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.271e-06 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832086+0000", 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015141309999999999 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832189+0000", 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010328299999999999 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832299+0000", 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109885 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898720+0000", 2024-09-12T18:15:09.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066420542999999999 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899137+0000", 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041740499999999998 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899203+0000", 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5494999999999995e-05 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899255+0000", 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2405999999999999e-05 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187000 5.5 5:ad951543:::benchmark_data_smithi062_23645_object51891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5609914439999999, 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068743992000000004, 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187000 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830663+0000", 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830666+0000", 2024-09-12T18:15:09.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9050000000000001e-06 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830677+0000", 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0988000000000001e-05 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830682+0000", 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833659+0000", 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029767460000000002 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833755+0000", 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5978999999999997e-05 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833872+0000", 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116779 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898726+0000", 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064854262999999995 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899306+0000", 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057974299999999997 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899362+0000", 2024-09-12T18:15:09.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6567999999999998e-05 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899406+0000", 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4081e-05 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187004 5.3 5:c7ad184c:::benchmark_data_smithi062_23645_object51895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5600699090000001, 2024-09-12T18:15:09.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067576516000000003, 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187004 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:09.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831587+0000", 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0000000000000001e-06 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831597+0000", 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3919999999999992e-06 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831601+0000", 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.211e-06 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832123+0000", 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052220999999999995 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832228+0000", 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104901 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832332+0000", 2024-09-12T18:15:09.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104298 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834361+0000", 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020281549999999998 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898978+0000", 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064617544999999998 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899052+0000", 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4402999999999999e-05 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899160+0000", 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010777600000000001 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187006 5.5 5:ab27be23:::benchmark_data_smithi062_23645_object51897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5590377950000001, 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070397003999999999, 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187006 2024-09-12T18:15:09.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832617+0000", 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832620+0000", 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999999e-06 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832630+0000", 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2529999999999993e-06 2024-09-12T18:15:09.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832637+0000", 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.866e-06 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835192+0000", 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025558999999999998 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835290+0000", 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7355000000000006e-05 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835381+0000", 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1231999999999997e-05 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899455+0000", 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064073781999999996 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902827+0000", 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003372103 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902954+0000", 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012695 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903013+0000", 2024-09-12T18:15:09.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8956999999999998e-05 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187002 5.f e60/53 5:f316353f:::benchmark_data_smithi062_23645_object51893:head v 60'11800, mlcod=60'11795)", 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5577164479999999, 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067384802999999993, 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833938+0000", 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9200000000000002e-07 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833958+0000", 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833964+0000", 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8480000000000003e-06 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833969+0000", 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5009999999999998e-06 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834034+0000", 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4665999999999994e-05 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834053+0000", 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9221000000000001e-05 2024-09-12T18:15:09.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901272+0000", 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067219152000000004 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901322+0000", 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.011e-05 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.466 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187008 5.0 5:09c03dc0:::benchmark_data_smithi062_23645_object51899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5576562960000002, 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067136113999999997, 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187008 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:09.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833998+0000", 2024-09-12T18:15:09.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834002+0000", 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834028+0000", 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5894e-05 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834037+0000", 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834094+0000", 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6916000000000002e-05 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834215+0000", 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121709 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.900976+0000", 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066761176000000005 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901041+0000", 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4304e-05 2024-09-12T18:15:09.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901133+0000", 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.268e-05 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187011 5.6 5:6422621a:::benchmark_data_smithi062_23645_object51902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5571060499999998, 2024-09-12T18:15:09.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067142944999999996, 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187011 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834553+0000", 2024-09-12T18:15:09.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834562+0000", 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834570+0000", 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834630+0000", 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9957000000000002e-05 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834731+0000", 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100751 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834834+0000", 2024-09-12T18:15:09.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010338199999999999 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899126+0000", 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064291736000000002 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901333+0000", 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022070890000000002 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901538+0000", 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020443600000000001 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901691+0000", 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152817 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187014 5.2 5:45b0919f:::benchmark_data_smithi062_23645_object51905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.478 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.5557846069999997, 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067748596999999994, 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187014 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835870+0000", 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.285e-06 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835883+0000", 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2276000000000001e-05 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835893+0000", 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835900+0000", 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:09.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835956+0000", 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6276000000000001e-05 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898671+0000", 2024-09-12T18:15:09.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.062715530000000005 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898855+0000", 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183284 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903145+0000", 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042906580000000001 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903556+0000", 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041042800000000001 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903590+0000", 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4440000000000002e-05 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903618+0000", 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7521999999999998e-05 2024-09-12T18:15:09.485 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3373483899999998, 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070729645999999993, 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:09.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124936+0000", 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064320978000000001 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124991+0000", 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5550999999999997e-05 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125035+0000", 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3859999999999997e-05 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.491 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3308966609999997, 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068614100999999997, 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:09.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126682+0000", 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.065744891 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129287+0000", 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026049409999999999 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129333+0000", 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016999999999997e-05 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129371+0000", 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7796000000000002e-05 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.497 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5:4781a562:::benchmark_data_smithi062_23645_object52283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3308526949999999, 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.073009940999999995, 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124774+0000", 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.063958509999999996 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124908+0000", 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013461199999999999 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125013+0000", 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104153 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129380+0000", 2024-09-12T18:15:09.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043676100000000001 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133738+0000", 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043580950000000002 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133769+0000", 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1032999999999999e-05 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133811+0000", 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187395 5.a 5:58aaa639:::benchmark_data_smithi062_23645_object52286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.3302749680000003, 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068114076999999995, 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:09.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187395 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061383+0000", 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.72e-06 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122886+0000", 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.061503331000000001 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122905+0000", 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029e-05 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126609+0000", 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037042030000000001 2024-09-12T18:15:09.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126714+0000", 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010544600000000001 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129385+0000", 2024-09-12T18:15:09.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026710869999999999 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129433+0000", 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7567e-05 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129493+0000", 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.995e-05 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:09.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:09.510 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:09.511 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:09.512 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:09.506+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:09.611 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:09.608+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:09.663 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:09.663 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:198565 5.7 5:e3fc5b7b:::benchmark_data_smithi062_23645_object63456:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:09.659978+0000", 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004379422, 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0043982930000000002, 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.664 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 198565 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.659978+0000", 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.659978+0000", 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.659978+0000", 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9500000000000001e-07 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.659981+0000", 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1909999999999999e-06 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.659987+0000", 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0090000000000004e-06 2024-09-12T18:15:09.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.659990+0000", 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5439999999999999e-06 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660033+0000", 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2837999999999999e-05 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:09.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660117+0000", 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3991000000000003e-05 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660179+0000", 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1511000000000001e-05 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:198566 5.f 5:fad32aa9:::benchmark_data_smithi062_23645_object63457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:09.668 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:09.660000+0000", 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0043571850000000004, 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0044179420000000002, 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 198566 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660000+0000", 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660000+0000", 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660000+0000", 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6800000000000001e-07 2024-09-12T18:15:09.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660002+0000", 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1670000000000002e-06 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660009+0000", 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5729999999999996e-06 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660014+0000", 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0490000000000003e-06 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.661670+0000", 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016559229999999999 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.661795+0000", 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012516299999999999 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.661914+0000", 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119289 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:198568 5.7 5:eb9ef084:::benchmark_data_smithi062_23645_object63459:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:09.660449+0000", 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0039081749999999998, 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0040044599999999996, 2024-09-12T18:15:09.673 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "reached pg", 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 198568 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660449+0000", 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660449+0000", 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660449+0000", 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7000000000000005e-07 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660452+0000", 2024-09-12T18:15:09.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4260000000000002e-06 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660459+0000", 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6009999999999997e-06 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.660464+0000", 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9529999999999998e-06 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.664392+0000", 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0039271920000000004 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:198574 5.7 5.a1250c87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:09.663120+0000", 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0012373569999999999, 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001360736, 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:09.677 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 198574 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663120+0000", 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663120+0000", 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663121+0000", 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3570000000000001e-06 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663125+0000", 2024-09-12T18:15:09.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6739999999999999e-06 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663135+0000", 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0013999999999999e-05 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663140+0000", 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2079999999999999e-06 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:198575 5.7 5.8d28e107 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:09.663151+0000", 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0012058259999999999, 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0013552869999999999, 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 198575 2024-09-12T18:15:09.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663151+0000", 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663151+0000", 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663152+0000", 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2800000000000003e-07 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663153+0000", 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.654e-06 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663158+0000", 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2129999999999999e-06 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:09.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:09.663161+0000", 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8590000000000001e-06 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 5 2024-09-12T18:15:09.684 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:09.685 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:09.713 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:09.706+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:09.813 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:09.810+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:09.881 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:09.881 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:09.881 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:09.881 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:09.881 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:09.902 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:09.914 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:09.910+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-09-12T18:15:10.015 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.010+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.056 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:10.056 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:10.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:10.056 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:10.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 117.76073730900001, 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:10.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:10.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.064 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 106.660439881, 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:10.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:10.070 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 106.66037683099999, 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:10.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:10.076 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 106.659438255, 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:10.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:10.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:10.082 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 106.658784544, 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:10.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:10.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:10.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:10.088 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 42.799619397000001, 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:10.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:10.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:10.094 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 42.791597019999998, 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:10.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 42.780011733999999, 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:10.102 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:10.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:10.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.108 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.89265975, 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:10.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:10.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.887685781, 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.115 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:10.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:10.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.120 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.887216852, 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:10.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:10.126 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.885175528, 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:10.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:10.131 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.884267759, 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:10.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:10.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.883839556, 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.136 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:10.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.2233094089999996, 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:10.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:10.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.146 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.2210647879999996, 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:10.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.2185315469999995, 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.153 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:10.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.158 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.2180735570000003, 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:10.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:10.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.163 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:10.164 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.993576075, 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.165 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:10.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:10.170 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.9935425450000004, 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.171 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:10.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:10.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.176 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.177 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.177 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:10.177 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:10.177 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:10.178 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:10.179 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.174+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.256 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:15:10.256 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:15:10.256 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:15:10.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:15:10.278 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.274+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:15:10.334 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200187 5.2 5:4639245e:::benchmark_data_smithi062_23645_object65078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.329005+0000", 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050507649999999996, 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050743840000000004, 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200187 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329005+0000", 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329005+0000", 2024-09-12T18:15:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329006+0000", 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329009+0000", 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4869999999999998e-06 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329016+0000", 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.635e-06 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329021+0000", 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4999999999999999e-06 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329216+0000", 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194787 2024-09-12T18:15:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329385+0000", 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169204 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329469+0000", 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.352e-05 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332629+0000", 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003159851 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200188 5.b 5:dca4bf84:::benchmark_data_smithi062_23645_object65079:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.329034+0000", 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050219519999999997, 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051180990000000001, 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200188 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329034+0000", 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329034+0000", 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329034+0000", 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1e-07 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329035+0000", 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4610000000000001e-06 2024-09-12T18:15:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329039+0000", 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.771e-06 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329043+0000", 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6179999999999999e-06 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331085+0000", 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020424470000000002 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331201+0000", 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115561 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200190 5.b 5:d33e3ca2:::benchmark_data_smithi062_23645_object65081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.329093+0000", 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049631140000000002, 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051378400000000003, 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200190 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329093+0000", 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329093+0000", 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329093+0000", 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3300000000000003e-07 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329095+0000", 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.305e-06 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329101+0000", 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5029999999999997e-06 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329104+0000", 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2370000000000001e-06 2024-09-12T18:15:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333985+0000", 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048807149999999999 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334130+0000", 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014526900000000001 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200192 5.3 5:cf4db2a7:::benchmark_data_smithi062_23645_object65083:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.329275+0000", 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047803419999999999, 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050174679999999998, 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200192 2024-09-12T18:15:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329275+0000", 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329275+0000", 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329276+0000", 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329279+0000", 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7389999999999999e-06 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329286+0000", 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2200000000000003e-06 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329291+0000", 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9679999999999997e-06 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332854+0000", 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035631830000000001 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332962+0000", 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108274 2024-09-12T18:15:10.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333061+0000", 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8309999999999999e-05 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200193 5.b 5.bc6499fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.329323+0000", 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0047330549999999999, 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050099879999999999, 2024-09-12T18:15:10.353 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200193 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329323+0000", 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329323+0000", 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329323+0000", 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9299999999999998e-07 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329326+0000", 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7980000000000001e-06 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329335+0000", 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3619999999999995e-06 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.329344+0000", 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8140000000000007e-06 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200196 5.1 5:825b32a2:::benchmark_data_smithi062_23645_object65087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.331686+0000", 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0023695510000000001, 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002673056, 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.357 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200196 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331686+0000", 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331686+0000", 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331687+0000", 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6600000000000005e-07 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331691+0000", 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0740000000000003e-06 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331699+0000", 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4540000000000007e-06 2024-09-12T18:15:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331706+0000", 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8210000000000004e-06 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331759+0000", 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2379000000000001e-05 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331860+0000", 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331969+0000", 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010846200000000001 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200197 5.4 5:28755300:::benchmark_data_smithi062_23645_object65088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.331803+0000", 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0022526320000000001, 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025920769999999999, 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200197 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331803+0000", 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331803+0000", 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331804+0000", 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331807+0000", 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.303e-06 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331817+0000", 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0032e-05 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331823+0000", 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.117e-06 2024-09-12T18:15:10.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331875+0000", 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.168e-05 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.331986+0000", 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111191 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333759+0000", 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017725690000000001 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333805+0000", 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6601999999999999e-05 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200198 5.a 5:5d5284a2:::benchmark_data_smithi062_23645_object65089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.332213+0000", 2024-09-12T18:15:10.366 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0018426549999999999, 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022199810000000002, 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200198 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332213+0000", 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332213+0000", 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332214+0000", 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1399999999999995e-07 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332217+0000", 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5489999999999998e-06 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332226+0000", 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.157e-06 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332231+0000", 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6180000000000003e-06 2024-09-12T18:15:10.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332293+0000", 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1334000000000006e-05 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.332447+0000", 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015452900000000001 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200201 5.2 5:479d7099:::benchmark_data_smithi062_23645_object65092:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.333450+0000", 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00060601700000000004, 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010133939999999999, 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200201 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.371 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333450+0000", 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333450+0000", 2024-09-12T18:15:10.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333451+0000", 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9900000000000009e-07 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333455+0000", 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9859999999999996e-06 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333464+0000", 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8190000000000003e-06 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333472+0000", 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3379999999999999e-06 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333521+0000", 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9051000000000002e-05 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333662+0000", 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014129499999999999 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333777+0000", 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114838 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:200187 5.2 e62/49)", 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.333787+0000", 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00026883799999999998, 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00070627400000000001, 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333787+0000", 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333787+0000", 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333787+0000", 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9999999999999998e-07 2024-09-12T18:15:10.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333792+0000", 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2710000000000003e-06 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333799+0000", 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9000000000000006e-06 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333805+0000", 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4909999999999996e-06 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200203 5.6 5:6191eeb8:::benchmark_data_smithi062_23645_object65094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.333836+0000", 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00021959, 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067928800000000001, 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.379 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200203 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333836+0000", 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333836+0000", 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333837+0000", 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333841+0000", 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1760000000000003e-06 2024-09-12T18:15:10.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333850+0000", 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6649999999999992e-06 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333857+0000", 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7560000000000002e-06 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333905+0000", 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8260999999999998e-05 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334035+0000", 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130479 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334151+0000", 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011598 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.383 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200204 5.c 5:3f99b320:::benchmark_data_smithi062_23645_object65095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.333964+0000", 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1317999999999995e-05, 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058359600000000003, 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.384 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200204 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333964+0000", 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333964+0000", 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333965+0000", 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333969+0000", 2024-09-12T18:15:10.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3950000000000001e-06 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333984+0000", 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5429000000000001e-05 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.333990+0000", 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1260000000000003e-06 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334133+0000", 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014291 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334244+0000", 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011122500000000001 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334344+0000", 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9811999999999999e-05 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.388 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200206 5.6 5.feb33466 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.334225+0000", 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998307, 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035525500000000001, 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.389 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200206 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334225+0000", 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334225+0000", 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334226+0000", 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334229+0000", 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.292e-06 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334237+0000", 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3289999999999994e-06 2024-09-12T18:15:10.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.334243+0000", 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8300000000000001e-06 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:200184 5.b 5:d611cb3e:::benchmark_data_smithi062_23645_object65075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:10.326100+0000", 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0079561230000000007, 2024-09-12T18:15:10.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085064170000000005, 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 200184 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326100+0000", 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326100+0000", 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326100+0000", 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.99e-07 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326103+0000", 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326111+0000", 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1340000000000004e-06 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326116+0000", 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1089999999999997e-06 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326160+0000", 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4270000000000001e-05 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:10.326283+0000", 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012288199999999999 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:10.396 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2024-09-12T18:15:10.397 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:10.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:10.398 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.394+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.498 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:10.496+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:10.600 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.594+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.605 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:10.605 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:10.606 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:10.606 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:10.606 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:10.621 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:15:10.621 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 62, 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "fsid": "5c1106a1-8b30-400f-94eb-0bea28eb5927", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "created": "2024-09-12T18:13:00.942825+0000", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "modified": "2024-09-12T18:15:08.242036+0000", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "last_up_change": "2024-09-12T18:14:27.958747+0000", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "last_in_change": "2024-09-12T18:13:01.815814+0000", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_num": 5804032, 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_set": [ 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "nodeep-scrub", 2024-09-12T18:15:10.622 INFO:teuthology.orchestra.run.smithi062.stdout: "pglog_hardlimit", 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "purged_snapdirs", 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_deletes", 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "sortbitwise" 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_version": 4, 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_snapshot": "", 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_max": 5, 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd": 3, 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:15:10.623 INFO:teuthology.orchestra.run.smithi062.stdout: "min_compat_client": "jewel", 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "require_osd_release": "squid", 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_crimson": false, 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pools": [ 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 1, 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": ".mgr", 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:10.380891+0000", 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:15:10.624 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 1, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 1, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 1, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 1, 2024-09-12T18:15:10.625 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 1, 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "11", 2024-09-12T18:15:10.626 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:15:10.627 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:15:10.628 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:15:10.629 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_max": 32, 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 1 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": {} 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:15:10.630 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 3.0299999713897705, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 3.0299999713897705, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.33000001311302185, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.54865521192550659, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.55000001192092896, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 2, 2024-09-12T18:15:10.631 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "rbd", 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:16.182185+0000", 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 8193, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:15:10.632 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 8, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 8, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 8, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 8, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 8, 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:15:10.633 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "15", 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:15:10.634 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 2, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 15, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:15:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:15:10.636 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd": {} 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.637 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 1.4900000095367432, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 1.4900000095367432, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.54865521192550659, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.55000001192092896, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.638 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 3, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:20.398999+0000", 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:15:10.639 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 32, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 32, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 32, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 32, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 32, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:15:10.640 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "18", 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:15:10.641 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:15:10.642 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:15:10.643 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 16, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_priority": 5 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:15:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": "cephfs" 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.2400000095367432, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.2400000095367432, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.5, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.54865521192550659, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.55000001192092896, 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-09-12T18:15:10.645 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 4, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "cephfs_data", 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:21.732662+0000", 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:15:10.646 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 64, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 64, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 64, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 64, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 64, 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:15:10.647 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "19", 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:15:10.648 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:15:10.649 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:15:10.650 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "options": { 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_min": 64, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.651 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "cephfs": { 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "data": "cephfs" 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.4300000667572021, 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.4300000667572021, 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-12T18:15:10.652 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.54865521192550659, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.55000001192092896, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "pool": 5, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": "unique_pool_0", 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "create_time": "2024-09-12T18:13:38.126670+0000", 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "flags_names": "hashpspool", 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type": 1, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "size": 2, 2024-09-12T18:15:10.653 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": 1, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_rule": 0, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "is_stretch_pool": false, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "object_hash": 2, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": 16, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num": 16, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_placement_num_target": 16, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_target": 16, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num_pending": 16, 2024-09-12T18:15:10.654 INFO:teuthology.orchestra.run.smithi062.stdout: "last_pg_merge_meta": { 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "source_pgid": "0.0", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "ready_epoch": 0, 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_started": 0, 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_epoch_clean": 0, 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "source_version": "0'0", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "target_version": "0'0" 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_change": "23", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend": "0", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "auid": 0, 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:15:10.655 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_seq": 0, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_epoch": 0, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_snaps": [], 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps": "[]", 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_bytes": 0, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "quota_max_objects": 0, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "tiers": [], 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_of": -1, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "read_tier": -1, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "write_tier": -1, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_mode": "none", 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_bytes": 0, 2024-09-12T18:15:10.656 INFO:teuthology.orchestra.run.smithi062.stdout: "target_max_objects": 0, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_flush_age": 0, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "cache_min_evict_age": 0, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profile": "", 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_params": { 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "none" 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_period": 0, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_count": 0, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "use_gmt_hitset": true, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:15:10.657 INFO:teuthology.orchestra.run.smithi062.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "grade_table": [], 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "stripe_width": 0, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "expected_num_objects": 0, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "fast_read": false, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "options": {}, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "application_metadata": { 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "rados": {} 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "read_balance": { 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "score_type": "Fair distribution", 2024-09-12T18:15:10.658 INFO:teuthology.orchestra.run.smithi062.stdout: "score_acting": 2.2400000095367432, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "score_stable": 2.6099998950958252, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_acting": 1.5, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "raw_score_stable": 1.75, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity_weighted": 0.54865521192550659, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity": 0.55000001192092896, 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.659 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "d5348027-f4dc-457f-8b4e-a4341015d874", 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 0, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 0.1654815673828125, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 26, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 43, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:15:10.660 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6800", 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6801", 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.661 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6802", 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6803", 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.662 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6806", 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6807", 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.663 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6804", 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.129:6805", 2024-09-12T18:15:10.664 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1368744816 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.129:6801/1368744816", 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.129:6803/1368744816", 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.129:6807/1368744816", 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.129:6805/1368744816", 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "exists" 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.665 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "939481c0-5bf6-4136-b772-e0ba4c215bf1", 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 1, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 1, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 55, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:15:10.666 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6800", 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6801", 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.667 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6802", 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6803", 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6806", 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6807", 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.669 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6804", 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.151:6805", 2024-09-12T18:15:10.670 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 1445669154 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.151:6801/1445669154", 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.151:6803/1445669154", 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.151:6807/1445669154", 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.151:6805/1445669154", 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.671 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "uuid": "66fc0ac1-f14f-48bf-a557-110b23bff1d2", 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "up": 1, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "in": 1, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "weight": 0.4669189453125, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_affinity": 0.4804840087890625, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_begin": 0, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "last_clean_end": 0, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "up_from": 8, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "up_thru": 54, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "down_at": 0, 2024-09-12T18:15:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: "lost_at": 0, 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addrs": { 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6800", 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6801", 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.673 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addrs": { 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6802", 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6803", 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.674 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addrs": { 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6806", 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6807", 2024-09-12T18:15:10.675 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addrs": { 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6804", 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T18:15:10.676 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.176:6805", 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 752868242 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "public_addr": "172.21.15.176:6801/752868242", 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_addr": "172.21.15.176:6803/752868242", 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_back_addr": "172.21.15.176:6807/752868242", 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "heartbeat_front_addr": "172.21.15.176:6805/752868242", 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "state": [ 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "exists", 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: "up" 2024-09-12T18:15:10.677 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_xinfo": [ 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 0, 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.730957+0000", 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 42 2024-09-12T18:15:10.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 1, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.793073+0000", 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": 2, 2024-09-12T18:15:10.679 INFO:teuthology.orchestra.run.smithi062.stdout: "down_stamp": "0.000000", 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_probability": 0, 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "laggy_interval": 0, 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "features": 4540719139924082687, 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "old_weight": 0, 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "last_purged_snaps_scrub": "2024-09-12T18:13:07.762001+0000", 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "dead_epoch": 0 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap": [], 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_items": [], 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_upmap_primaries": [], 2024-09-12T18:15:10.680 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_temp": [ 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "1.0", 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.0", 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1", 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.6", 2024-09-12T18:15:10.682 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.b", 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.683 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.d", 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.e", 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.11", 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.16", 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.685 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.17", 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.19", 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.686 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1b", 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1c", 2024-09-12T18:15:10.687 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "3.1f", 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.688 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.0", 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1", 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.2", 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.3", 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.a", 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.b", 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.c", 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.d", 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.692 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.e", 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.13", 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1a", 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1b", 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1d", 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.1e", 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.695 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.25", 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.27", 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.29", 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.2b", 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.31", 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "4.38", 2024-09-12T18:15:10.698 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.3", 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.6", 2024-09-12T18:15:10.699 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.9", 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.700 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.c", 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: 1, 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: "pgid": "5.f", 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: "osds": [ 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: 2 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.701 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "primary_temp": [], 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklist": {}, 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "range_blocklist": {}, 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "erasure_code_profiles": { 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "default": { 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-failure-domain": "osd", 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "k": "2", 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "m": "1", 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "plugin": "jerasure", 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "technique": "reed_sol_van" 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T18:15:10.702 INFO:teuthology.orchestra.run.smithi062.stdout: "removed_snaps_queue": [], 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "new_removed_snaps": [], 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "new_purged_snaps": [], 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_node_flags": {}, 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "device_class_flags": {}, 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode": { 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_enabled": false, 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_bucket_count": 0, 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: "stretch_mode_bucket": 0 2024-09-12T18:15:10.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T18:15:10.704 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:15:10.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:10.706 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.698+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.707 INFO:tasks.thrashosds.thrasher:j is {'epoch': 62, 'fsid': '5c1106a1-8b30-400f-94eb-0bea28eb5927', 'created': '2024-09-12T18:13:00.942825+0000', 'modified': '2024-09-12T18:15:08.242036+0000', 'last_up_change': '2024-09-12T18:14:27.958747+0000', 'last_in_change': '2024-09-12T18:13:01.815814+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:13:10.380891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.5486552119255066, 'average_primary_affinity': 0.550000011920929, 'average_primary_affinity_weighted': 0.550000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:13:16.182185+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.5486552119255066, 'average_primary_affinity': 0.550000011920929, 'average_primary_affinity_weighted': 0.550000011920929}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:13:20.398999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.5486552119255066, 'average_primary_affinity': 0.550000011920929, 'average_primary_affinity_weighted': 0.550000011920929}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:13:21.732662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.430000066757202, 'score_stable': 2.430000066757202, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 0.5486552119255066, 'average_primary_affinity': 0.550000011920929, 'average_primary_affinity_weighted': 0.550000011920929}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-12T18:13:38.126670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.609999895095825, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.5486552119255066, 'average_primary_affinity': 0.550000011920929, 'average_primary_affinity_weighted': 0.550000011920929}}], 'osds': [{'osd': 0, 'uuid': 'd5348027-f4dc-457f-8b4e-a4341015d874', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.1654815673828125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 26, 'down_at': 43, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 1368744816}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 1368744816}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 1368744816}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 1368744816}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 1368744816}]}, 'public_addr': '172.21.15.129:6801/1368744816', 'cluster_addr': '172.21.15.129:6803/1368744816', 'heartbeat_back_addr': '172.21.15.129:6807/1368744816', 'heartbeat_front_addr': '172.21.15.129:6805/1368744816', 'state': ['exists']}, {'osd': 1, 'uuid': '939481c0-5bf6-4136-b772-e0ba4c215bf1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 55, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 1445669154}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 1445669154}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 1445669154}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 1445669154}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 1445669154}]}, 'public_addr': '172.21.15.151:6801/1445669154', 'cluster_addr': '172.21.15.151:6803/1445669154', 'heartbeat_back_addr': '172.21.15.151:6807/1445669154', 'heartbeat_front_addr': '172.21.15.151:6805/1445669154', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '66fc0ac1-f14f-48bf-a557-110b23bff1d2', 'up': 1, 'in': 1, 'weight': 0.4669189453125, 'primary_affinity': 0.4804840087890625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 54, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6800', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6801', 'nonce': 752868242}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6802', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6803', 'nonce': 752868242}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6806', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6807', 'nonce': 752868242}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6804', 'nonce': 752868242}, {'type': 'v1', 'addr': '172.21.15.176:6805', 'nonce': 752868242}]}, 'public_addr': '172.21.15.176:6801/752868242', 'cluster_addr': '172.21.15.176:6803/752868242', 'heartbeat_back_addr': '172.21.15.176:6807/752868242', 'heartbeat_front_addr': '172.21.15.176:6805/752868242', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.730957+0000', 'dead_epoch': 42}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.793073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:13:07.762001+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '1.0', 'osds': [1, 2]}, {'pgid': '3.0', 'osds': [1, 2]}, {'pgid': '3.1', 'osds': [1, 2]}, {'pgid': '3.6', 'osds': [1, 2]}, {'pgid': '3.b', 'osds': [1, 2]}, {'pgid': '3.d', 'osds': [1, 2]}, {'pgid': '3.e', 'osds': [1, 2]}, {'pgid': '3.11', 'osds': [1, 2]}, {'pgid': '3.16', 'osds': [1, 2]}, {'pgid': '3.17', 'osds': [1, 2]}, {'pgid': '3.19', 'osds': [1, 2]}, {'pgid': '3.1b', 'osds': [1, 2]}, {'pgid': '3.1c', 'osds': [1, 2]}, {'pgid': '3.1f', 'osds': [1, 2]}, {'pgid': '4.0', 'osds': [1, 2]}, {'pgid': '4.1', 'osds': [1, 2]}, {'pgid': '4.2', 'osds': [1, 2]}, {'pgid': '4.3', 'osds': [1, 2]}, {'pgid': '4.a', 'osds': [1, 2]}, {'pgid': '4.b', 'osds': [1, 2]}, {'pgid': '4.c', 'osds': [1, 2]}, {'pgid': '4.d', 'osds': [1, 2]}, {'pgid': '4.e', 'osds': [1, 2]}, {'pgid': '4.13', 'osds': [1, 2]}, {'pgid': '4.1a', 'osds': [1, 2]}, {'pgid': '4.1b', 'osds': [1, 2]}, {'pgid': '4.1d', 'osds': [1, 2]}, {'pgid': '4.1e', 'osds': [1, 2]}, {'pgid': '4.25', 'osds': [1, 2]}, {'pgid': '4.27', 'osds': [1, 2]}, {'pgid': '4.29', 'osds': [1, 2]}, {'pgid': '4.2b', 'osds': [1, 2]}, {'pgid': '4.31', 'osds': [1, 2]}, {'pgid': '4.38', 'osds': [1, 2]}, {'pgid': '5.3', 'osds': [1, 2]}, {'pgid': '5.6', 'osds': [1, 2]}, {'pgid': '5.9', 'osds': [2]}, {'pgid': '5.c', 'osds': [1, 2]}, {'pgid': '5.f', 'osds': [2]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:15:10.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:15:10.807 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:10.802+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:10.907 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:10.904+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:10.913 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.796324892000001, 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.782923785000001, 2024-09-12T18:15:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.776350102999999, 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.776238188000001, 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.770349242000002, 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.768739641, 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.747411939999999, 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186998 5.5 5:abc1ca4a:::benchmark_data_smithi062_23645_object51889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0821324509999997, 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068453476999999999, 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186998 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830447+0000", 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830451+0000", 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830462+0000", 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0825000000000001e-05 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830473+0000", 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830518+0000", 2024-09-12T18:15:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4987000000000001e-05 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830623+0000", 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010490899999999999 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830685+0000", 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1198999999999995e-05 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898706+0000", 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068020924999999996 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898763+0000", 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7914999999999997e-05 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898857+0000", 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3558000000000001e-05 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898899+0000", 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.21e-05 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186999 5.5 5:a5be6d45:::benchmark_data_smithi062_23645_object51890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0820231700000003, 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068700116000000006, 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186999 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830556+0000", 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830558+0000", 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-09-12T18:15:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830567+0000", 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830572+0000", 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.271e-06 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832086+0000", 2024-09-12T18:15:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015141309999999999 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832189+0000", 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010328299999999999 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832299+0000", 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109885 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898720+0000", 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066420542999999999 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899137+0000", 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041740499999999998 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899203+0000", 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5494999999999995e-05 2024-09-12T18:15:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899255+0000", 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2405999999999999e-05 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187000 5.5 5:ad951543:::benchmark_data_smithi062_23645_object51891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0819158409999998, 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068743992000000004, 2024-09-12T18:15:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187000 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830663+0000", 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830666+0000", 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9050000000000001e-06 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830677+0000", 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0988000000000001e-05 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830682+0000", 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833659+0000", 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029767460000000002 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833755+0000", 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5978999999999997e-05 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833872+0000", 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116779 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898726+0000", 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064854262999999995 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899306+0000", 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057974299999999997 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899362+0000", 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6567999999999998e-05 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899406+0000", 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4081e-05 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187004 5.3 5:c7ad184c:::benchmark_data_smithi062_23645_object51895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.080994306, 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067576516000000003, 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187004 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831587+0000", 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0000000000000001e-06 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831597+0000", 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3919999999999992e-06 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831601+0000", 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.211e-06 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832123+0000", 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052220999999999995 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832228+0000", 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104901 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832332+0000", 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104298 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834361+0000", 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020281549999999998 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898978+0000", 2024-09-12T18:15:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064617544999999998 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899052+0000", 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4402999999999999e-05 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899160+0000", 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010777600000000001 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187006 5.5 5:ab27be23:::benchmark_data_smithi062_23645_object51897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.079962192, 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070397003999999999, 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187006 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832617+0000", 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832620+0000", 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999999e-06 2024-09-12T18:15:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832630+0000", 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2529999999999993e-06 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832637+0000", 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.866e-06 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835192+0000", 2024-09-12T18:15:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025558999999999998 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835290+0000", 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7355000000000006e-05 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835381+0000", 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1231999999999997e-05 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899455+0000", 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064073781999999996 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902827+0000", 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003372103 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902954+0000", 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012695 2024-09-12T18:15:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903013+0000", 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8956999999999998e-05 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187002 5.f e60/53 5:f316353f:::benchmark_data_smithi062_23645_object51893:head v 60'11800, mlcod=60'11795)", 2024-09-12T18:15:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0786408449999998, 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067384802999999993, 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833938+0000", 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9200000000000002e-07 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833958+0000", 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833964+0000", 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8480000000000003e-06 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833969+0000", 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5009999999999998e-06 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834034+0000", 2024-09-12T18:15:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4665999999999994e-05 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834053+0000", 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9221000000000001e-05 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901272+0000", 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067219152000000004 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901322+0000", 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.011e-05 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187008 5.0 5:09c03dc0:::benchmark_data_smithi062_23645_object51899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0785806930000001, 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067136113999999997, 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187008 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833998+0000", 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834002+0000", 2024-09-12T18:15:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834028+0000", 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5894e-05 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834037+0000", 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834094+0000", 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6916000000000002e-05 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834215+0000", 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121709 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.900976+0000", 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066761176000000005 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901041+0000", 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4304e-05 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901133+0000", 2024-09-12T18:15:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.268e-05 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187011 5.6 5:6422621a:::benchmark_data_smithi062_23645_object51902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0780304469999997, 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067142944999999996, 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187011 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834553+0000", 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834562+0000", 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834570+0000", 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834630+0000", 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9957000000000002e-05 2024-09-12T18:15:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834731+0000", 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100751 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834834+0000", 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010338199999999999 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899126+0000", 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064291736000000002 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901333+0000", 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022070890000000002 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901538+0000", 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020443600000000001 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901691+0000", 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152817 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187014 5.2 5:45b0919f:::benchmark_data_smithi062_23645_object51905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.0767090039999996, 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067748596999999994, 2024-09-12T18:15:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187014 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835870+0000", 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.285e-06 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835883+0000", 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2276000000000001e-05 2024-09-12T18:15:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835893+0000", 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835900+0000", 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835956+0000", 2024-09-12T18:15:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6276000000000001e-05 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898671+0000", 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.062715530000000005 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898855+0000", 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183284 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903145+0000", 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042906580000000001 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903556+0000", 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041042800000000001 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903590+0000", 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4440000000000002e-05 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903618+0000", 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7521999999999998e-05 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.8582727869999998, 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070729645999999993, 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124936+0000", 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064320978000000001 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124991+0000", 2024-09-12T18:15:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5550999999999997e-05 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125035+0000", 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3859999999999997e-05 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.8518210579999996, 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068614100999999997, 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126682+0000", 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.065744891 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129287+0000", 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026049409999999999 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129333+0000", 2024-09-12T18:15:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016999999999997e-05 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129371+0000", 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7796000000000002e-05 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5:4781a562:::benchmark_data_smithi062_23645_object52283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.8517770919999998, 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.073009940999999995, 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124774+0000", 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.063958509999999996 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124908+0000", 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013461199999999999 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125013+0000", 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104153 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129380+0000", 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043676100000000001 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133738+0000", 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043580950000000002 2024-09-12T18:15:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133769+0000", 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1032999999999999e-05 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133811+0000", 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187395 5.a 5:58aaa639:::benchmark_data_smithi062_23645_object52286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.8511993650000003, 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068114076999999995, 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187395 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061383+0000", 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.72e-06 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122886+0000", 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.061503331000000001 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122905+0000", 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029e-05 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126609+0000", 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037042030000000001 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126714+0000", 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010544600000000001 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129385+0000", 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026710869999999999 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129433+0000", 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7567e-05 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129493+0000", 2024-09-12T18:15:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.995e-05 2024-09-12T18:15:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:11.028 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:11.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:11.030 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.024+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.043 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:15:11.045 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:15:11.063 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-09-12T18:15:10.372621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5370743733,"num_objects":81969,"num_object_clones":0,"num_object_copies":163938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":44422,"num_objects_misplaced":25647,"num_objects_unfound":0,"num_objects_dirty":81969,"num_whiteouts":0,"num_read":87,"num_read_kb":74,"num_write":188463,"num_write_kb":8649473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2207,"num_bytes_recovered":144704102,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50871,"ondisk_log_size":50871,"up":145,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1339008,"kb_used_data":719268,"kb_used_omap":4,"kb_used_meta":619643,"kb_avail":281776512,"statfs":{"total":289910292480,"available":288539148288,"internally_reserved":0,"allocated":736530432,"data_stored":11754837773,"data_compressed":10116827,"data_compressed_allocated":734633984,"data_compressed_original":11754110976,"omap_allocated":4785,"internal_metadata":634514767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-786104320,"num_objects":-11995,"num_object_clones":0,"num_object_copies":-23990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-7246,"num_objects_misplaced":-3752,"num_objects_unfound":0,"num_objects_dirty":-11995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11995,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":710,"num_bytes_recovered":46530560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003203"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.238198+0000","last_change":"2024-09-12T18:14:28.991575+0000","last_active":"2024-09-12T18:15:05.238198+0000","last_peered":"2024-09-12T18:15:05.238198+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.991575+0000","last_became_peered":"2024-09-12T18:14:28.991575+0000","last_unstale":"2024-09-12T18:15:05.238198+0000","last_undegraded":"2024-09-12T18:15:05.238198+0000","last_fullsized":"2024-09-12T18:14:28.986867+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:11.318507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240290+0000","last_change":"2024-09-12T18:14:28.985875+0000","last_active":"2024-09-12T18:15:05.240290+0000","last_peered":"2024-09-12T18:15:05.240290+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.985875+0000","last_became_peered":"2024-09-12T18:14:28.985875+0000","last_unstale":"2024-09-12T18:15:05.240290+0000","last_undegraded":"2024-09-12T18:15:05.240290+0000","last_fullsized":"2024-09-12T18:14:28.983086+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:32.772807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240074+0000","last_change":"2024-09-12T18:14:29.006849+0000","last_active":"2024-09-12T18:15:05.240074+0000","last_peered":"2024-09-12T18:15:05.240074+0000","last_clean":"2024-09-12T18:14:26.967529+0000","last_became_active":"2024-09-12T18:14:29.006849+0000","last_became_peered":"2024-09-12T18:14:29.006849+0000","last_unstale":"2024-09-12T18:15:05.240074+0000","last_undegraded":"2024-09-12T18:15:05.240074+0000","last_fullsized":"2024-09-12T18:14:28.985692+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.068034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.234547+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:15:05.234547+0000","last_peered":"2024-09-12T18:15:05.234547+0000","last_clean":"2024-09-12T18:15:05.234547+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:15:05.234547+0000","last_undegraded":"2024-09-12T18:15:05.234547+0000","last_fullsized":"2024-09-12T18:15:05.234547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.237528+0000","last_change":"2024-09-12T18:14:28.999716+0000","last_active":"2024-09-12T18:15:05.237528+0000","last_peered":"2024-09-12T18:15:05.237528+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.999716+0000","last_became_peered":"2024-09-12T18:14:28.999716+0000","last_unstale":"2024-09-12T18:15:05.237528+0000","last_undegraded":"2024-09-12T18:15:05.237528+0000","last_fullsized":"2024-09-12T18:14:28.985087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:26.637057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.237851+0000","last_change":"2024-09-12T18:14:43.091871+0000","last_active":"2024-09-12T18:15:05.237851+0000","last_peered":"2024-09-12T18:15:05.237851+0000","last_clean":"2024-09-12T18:15:05.237851+0000","last_became_active":"2024-09-12T18:14:43.088851+0000","last_became_peered":"2024-09-12T18:14:43.088851+0000","last_unstale":"2024-09-12T18:15:05.237851+0000","last_undegraded":"2024-09-12T18:15:05.237851+0000","last_fullsized":"2024-09-12T18:15:05.237851+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.534130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.238262+0000","last_change":"2024-09-12T18:14:43.092087+0000","last_active":"2024-09-12T18:15:05.238262+0000","last_peered":"2024-09-12T18:15:05.238262+0000","last_clean":"2024-09-12T18:15:05.238262+0000","last_became_active":"2024-09-12T18:14:43.089409+0000","last_became_peered":"2024-09-12T18:14:43.089409+0000","last_unstale":"2024-09-12T18:15:05.238262+0000","last_undegraded":"2024-09-12T18:15:05.238262+0000","last_fullsized":"2024-09-12T18:15:05.238262+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.981162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":27,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235280+0000","last_change":"2024-09-12T18:14:50.153022+0000","last_active":"2024-09-12T18:15:05.235280+0000","last_peered":"2024-09-12T18:15:05.235280+0000","last_clean":"2024-09-12T18:15:05.235280+0000","last_became_active":"2024-09-12T18:14:50.148389+0000","last_became_peered":"2024-09-12T18:14:50.148389+0000","last_unstale":"2024-09-12T18:15:05.235280+0000","last_undegraded":"2024-09-12T18:15:05.235280+0000","last_fullsized":"2024-09-12T18:15:05.235280+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:33.427407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.243264+0000","last_change":"2024-09-12T18:14:28.988500+0000","last_active":"2024-09-12T18:15:05.243264+0000","last_peered":"2024-09-12T18:15:05.243264+0000","last_clean":"2024-09-12T18:14:26.965869+0000","last_became_active":"2024-09-12T18:14:28.988500+0000","last_became_peered":"2024-09-12T18:14:28.988500+0000","last_unstale":"2024-09-12T18:15:05.243264+0000","last_undegraded":"2024-09-12T18:15:05.243264+0000","last_fullsized":"2024-09-12T18:14:28.983895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:29.110353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.239733+0000","last_change":"2024-09-12T18:14:29.001601+0000","last_active":"2024-09-12T18:15:05.239733+0000","last_peered":"2024-09-12T18:15:05.239733+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:29.001601+0000","last_became_peered":"2024-09-12T18:14:29.001601+0000","last_unstale":"2024-09-12T18:15:05.239733+0000","last_undegraded":"2024-09-12T18:15:05.239733+0000","last_fullsized":"2024-09-12T18:14:28.983569+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:43.515638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.235974+0000","last_change":"2024-09-12T18:14:43.089717+0000","last_active":"2024-09-12T18:15:05.235974+0000","last_peered":"2024-09-12T18:15:05.235974+0000","last_clean":"2024-09-12T18:15:05.235974+0000","last_became_active":"2024-09-12T18:14:43.088841+0000","last_became_peered":"2024-09-12T18:14:43.088841+0000","last_unstale":"2024-09-12T18:15:05.235974+0000","last_undegraded":"2024-09-12T18:15:05.235974+0000","last_fullsized":"2024-09-12T18:15:05.235974+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.068034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.234359+0000","last_change":"2024-09-12T18:14:28.990013+0000","last_active":"2024-09-12T18:15:05.234359+0000","last_peered":"2024-09-12T18:15:05.234359+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.990013+0000","last_became_peered":"2024-09-12T18:14:28.990013+0000","last_unstale":"2024-09-12T18:15:05.234359+0000","last_undegraded":"2024-09-12T18:15:05.234359+0000","last_fullsized":"2024-09-12T18:14:28.983502+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:25.262310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236905+0000","last_change":"2024-09-12T18:14:28.990334+0000","last_active":"2024-09-12T18:15:05.236905+0000","last_peered":"2024-09-12T18:15:05.236905+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.990334+0000","last_became_peered":"2024-09-12T18:14:28.990334+0000","last_unstale":"2024-09-12T18:15:05.236905+0000","last_undegraded":"2024-09-12T18:15:05.236905+0000","last_fullsized":"2024-09-12T18:14:28.985267+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:47.949899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.233903+0000","last_change":"2024-09-12T18:14:28.990979+0000","last_active":"2024-09-12T18:15:05.233903+0000","last_peered":"2024-09-12T18:15:05.233903+0000","last_clean":"2024-09-12T18:14:26.966724+0000","last_became_active":"2024-09-12T18:14:28.990979+0000","last_became_peered":"2024-09-12T18:14:28.990979+0000","last_unstale":"2024-09-12T18:15:05.233903+0000","last_undegraded":"2024-09-12T18:15:05.233903+0000","last_fullsized":"2024-09-12T18:14:28.983213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:41.590912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236437+0000","last_change":"2024-09-12T18:14:50.169405+0000","last_active":"2024-09-12T18:15:05.236437+0000","last_peered":"2024-09-12T18:15:05.236437+0000","last_clean":"2024-09-12T18:15:05.236437+0000","last_became_active":"2024-09-12T18:14:50.168728+0000","last_became_peered":"2024-09-12T18:14:50.168728+0000","last_unstale":"2024-09-12T18:15:05.236437+0000","last_undegraded":"2024-09-12T18:15:05.236437+0000","last_fullsized":"2024-09-12T18:15:05.236437+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:01.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.235185+0000","last_change":"2024-09-12T18:14:43.089479+0000","last_active":"2024-09-12T18:15:05.235185+0000","last_peered":"2024-09-12T18:15:05.235185+0000","last_clean":"2024-09-12T18:15:05.235185+0000","last_became_active":"2024-09-12T18:14:43.088622+0000","last_became_peered":"2024-09-12T18:14:43.088622+0000","last_unstale":"2024-09-12T18:15:05.235185+0000","last_undegraded":"2024-09-12T18:15:05.235185+0000","last_fullsized":"2024-09-12T18:15:05.235185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:59.550636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.238514+0000","last_change":"2024-09-12T18:14:28.991226+0000","last_active":"2024-09-12T18:15:05.238514+0000","last_peered":"2024-09-12T18:15:05.238514+0000","last_clean":"2024-09-12T18:14:26.966274+0000","last_became_active":"2024-09-12T18:14:28.991226+0000","last_became_peered":"2024-09-12T18:14:28.991226+0000","last_unstale":"2024-09-12T18:15:05.238514+0000","last_undegraded":"2024-09-12T18:15:05.238514+0000","last_fullsized":"2024-09-12T18:14:28.987101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236376+0000","last_change":"2024-09-12T18:14:29.001937+0000","last_active":"2024-09-12T18:15:05.236376+0000","last_peered":"2024-09-12T18:15:05.236376+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:29.001937+0000","last_became_peered":"2024-09-12T18:14:29.001937+0000","last_unstale":"2024-09-12T18:15:05.236376+0000","last_undegraded":"2024-09-12T18:15:05.236376+0000","last_fullsized":"2024-09-12T18:14:28.984391+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:43.301906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236110+0000","last_change":"2024-09-12T18:14:28.988751+0000","last_active":"2024-09-12T18:15:05.236110+0000","last_peered":"2024-09-12T18:15:05.236110+0000","last_clean":"2024-09-12T18:14:26.964977+0000","last_became_active":"2024-09-12T18:14:28.988751+0000","last_became_peered":"2024-09-12T18:14:28.988751+0000","last_unstale":"2024-09-12T18:15:05.236110+0000","last_undegraded":"2024-09-12T18:15:05.236110+0000","last_fullsized":"2024-09-12T18:14:28.984192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:33.074692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.239841+0000","last_change":"2024-09-12T18:14:43.097711+0000","last_active":"2024-09-12T18:15:05.239841+0000","last_peered":"2024-09-12T18:15:05.239841+0000","last_clean":"2024-09-12T18:15:05.239841+0000","last_became_active":"2024-09-12T18:14:43.095429+0000","last_became_peered":"2024-09-12T18:14:43.095429+0000","last_unstale":"2024-09-12T18:15:05.239841+0000","last_undegraded":"2024-09-12T18:15:05.239841+0000","last_fullsized":"2024-09-12T18:15:05.239841+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:55.449555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235912+0000","last_change":"2024-09-12T18:14:50.158644+0000","last_active":"2024-09-12T18:15:05.235912+0000","last_peered":"2024-09-12T18:15:05.235912+0000","last_clean":"2024-09-12T18:15:05.235912+0000","last_became_active":"2024-09-12T18:14:50.155884+0000","last_became_peered":"2024-09-12T18:14:50.155884+0000","last_unstale":"2024-09-12T18:15:05.235912+0000","last_undegraded":"2024-09-12T18:15:05.235912+0000","last_fullsized":"2024-09-12T18:15:05.235912+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:21.618515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.233394+0000","last_change":"2024-09-12T18:14:28.986176+0000","last_active":"2024-09-12T18:15:05.233394+0000","last_peered":"2024-09-12T18:15:05.233394+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986176+0000","last_became_peered":"2024-09-12T18:14:28.986176+0000","last_unstale":"2024-09-12T18:15:05.233394+0000","last_undegraded":"2024-09-12T18:15:05.233394+0000","last_fullsized":"2024-09-12T18:14:28.982633+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:43.709402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.237907+0000","last_change":"2024-09-12T18:14:50.171203+0000","last_active":"2024-09-12T18:15:05.237907+0000","last_peered":"2024-09-12T18:15:05.237907+0000","last_clean":"2024-09-12T18:15:05.237907+0000","last_became_active":"2024-09-12T18:14:50.170030+0000","last_became_peered":"2024-09-12T18:14:50.170030+0000","last_unstale":"2024-09-12T18:15:05.237907+0000","last_undegraded":"2024-09-12T18:15:05.237907+0000","last_fullsized":"2024-09-12T18:15:05.237907+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:07.199861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.234936+0000","last_change":"2024-09-12T18:14:28.984971+0000","last_active":"2024-09-12T18:15:05.234936+0000","last_peered":"2024-09-12T18:15:05.234936+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.984971+0000","last_became_peered":"2024-09-12T18:14:28.984971+0000","last_unstale":"2024-09-12T18:15:05.234936+0000","last_undegraded":"2024-09-12T18:15:05.234936+0000","last_fullsized":"2024-09-12T18:14:28.981823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:14.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236906+0000","last_change":"2024-09-12T18:14:50.183037+0000","last_active":"2024-09-12T18:15:05.236906+0000","last_peered":"2024-09-12T18:15:05.236906+0000","last_clean":"2024-09-12T18:15:05.236906+0000","last_became_active":"2024-09-12T18:14:50.181893+0000","last_became_peered":"2024-09-12T18:14:50.181893+0000","last_unstale":"2024-09-12T18:15:05.236906+0000","last_undegraded":"2024-09-12T18:15:05.236906+0000","last_fullsized":"2024-09-12T18:15:05.236906+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:13.033823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.239514+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:15:05.239514+0000","last_peered":"2024-09-12T18:15:05.239514+0000","last_clean":"2024-09-12T18:15:05.239514+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:15:05.239514+0000","last_undegraded":"2024-09-12T18:15:05.239514+0000","last_fullsized":"2024-09-12T18:15:05.239514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236155+0000","last_change":"2024-09-12T18:14:50.154905+0000","last_active":"2024-09-12T18:15:05.236155+0000","last_peered":"2024-09-12T18:15:05.236155+0000","last_clean":"2024-09-12T18:15:05.236155+0000","last_became_active":"2024-09-12T18:14:50.152280+0000","last_became_peered":"2024-09-12T18:14:50.152280+0000","last_unstale":"2024-09-12T18:15:05.236155+0000","last_undegraded":"2024-09-12T18:15:05.236155+0000","last_fullsized":"2024-09-12T18:15:05.236155+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.746595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.234423+0000","last_change":"2024-09-12T18:14:28.990141+0000","last_active":"2024-09-12T18:15:05.234423+0000","last_peered":"2024-09-12T18:15:05.234423+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.990141+0000","last_became_peered":"2024-09-12T18:14:28.990141+0000","last_unstale":"2024-09-12T18:15:05.234423+0000","last_undegraded":"2024-09-12T18:15:05.234423+0000","last_fullsized":"2024-09-12T18:14:28.983927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:35.607790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236641+0000","last_change":"2024-09-12T18:14:28.991634+0000","last_active":"2024-09-12T18:15:05.236641+0000","last_peered":"2024-09-12T18:15:05.236641+0000","last_clean":"2024-09-12T18:14:26.964656+0000","last_became_active":"2024-09-12T18:14:28.991634+0000","last_became_peered":"2024-09-12T18:14:28.991634+0000","last_unstale":"2024-09-12T18:15:05.236641+0000","last_undegraded":"2024-09-12T18:15:05.236641+0000","last_fullsized":"2024-09-12T18:14:28.986517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:25.262310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.233610+0000","last_change":"2024-09-12T18:14:28.988633+0000","last_active":"2024-09-12T18:15:05.233610+0000","last_peered":"2024-09-12T18:15:05.233610+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.988633+0000","last_became_peered":"2024-09-12T18:14:28.988633+0000","last_unstale":"2024-09-12T18:15:05.233610+0000","last_undegraded":"2024-09-12T18:15:05.233610+0000","last_fullsized":"2024-09-12T18:14:28.982701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:51.891520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.237877+0000","last_change":"2024-09-12T18:14:28.984685+0000","last_active":"2024-09-12T18:15:05.237877+0000","last_peered":"2024-09-12T18:15:05.237877+0000","last_clean":"2024-09-12T18:14:26.964387+0000","last_became_active":"2024-09-12T18:14:28.984685+0000","last_became_peered":"2024-09-12T18:14:28.984685+0000","last_unstale":"2024-09-12T18:15:05.237877+0000","last_undegraded":"2024-09-12T18:15:05.237877+0000","last_fullsized":"2024-09-12T18:14:28.981979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.968501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.233396+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:15:05.233396+0000","last_peered":"2024-09-12T18:15:05.233396+0000","last_clean":"2024-09-12T18:15:05.233396+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:15:05.233396+0000","last_undegraded":"2024-09-12T18:15:05.233396+0000","last_fullsized":"2024-09-12T18:15:05.233396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.239347+0000","last_change":"2024-09-12T18:14:28.986692+0000","last_active":"2024-09-12T18:15:05.239347+0000","last_peered":"2024-09-12T18:15:05.239347+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986692+0000","last_became_peered":"2024-09-12T18:14:28.986692+0000","last_unstale":"2024-09-12T18:15:05.239347+0000","last_undegraded":"2024-09-12T18:15:05.239347+0000","last_fullsized":"2024-09-12T18:14:28.983093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":101,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.233851+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:15:05.233851+0000","last_peered":"2024-09-12T18:15:05.233851+0000","last_clean":"2024-09-12T18:15:05.233851+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:15:05.233851+0000","last_undegraded":"2024-09-12T18:15:05.233851+0000","last_fullsized":"2024-09-12T18:15:05.233851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.235950+0000","last_change":"2024-09-12T18:14:28.988479+0000","last_active":"2024-09-12T18:15:05.235950+0000","last_peered":"2024-09-12T18:15:05.235950+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.988479+0000","last_became_peered":"2024-09-12T18:14:28.988479+0000","last_unstale":"2024-09-12T18:15:05.235950+0000","last_undegraded":"2024-09-12T18:15:05.235950+0000","last_fullsized":"2024-09-12T18:14:28.983564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:42.780406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.238871+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:15:05.238871+0000","last_peered":"2024-09-12T18:15:05.238871+0000","last_clean":"2024-09-12T18:15:05.238871+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:15:05.238871+0000","last_undegraded":"2024-09-12T18:15:05.238871+0000","last_fullsized":"2024-09-12T18:15:05.238871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.236228+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:15:05.236228+0000","last_peered":"2024-09-12T18:15:05.236228+0000","last_clean":"2024-09-12T18:15:05.236228+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:15:05.236228+0000","last_undegraded":"2024-09-12T18:15:05.236228+0000","last_fullsized":"2024-09-12T18:15:05.236228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.238517+0000","last_change":"2024-09-12T18:14:50.183970+0000","last_active":"2024-09-12T18:15:05.238517+0000","last_peered":"2024-09-12T18:15:05.238517+0000","last_clean":"2024-09-12T18:15:05.238517+0000","last_became_active":"2024-09-12T18:14:50.181892+0000","last_became_peered":"2024-09-12T18:14:50.181892+0000","last_unstale":"2024-09-12T18:15:05.238517+0000","last_undegraded":"2024-09-12T18:15:05.238517+0000","last_fullsized":"2024-09-12T18:15:05.238517+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:36.372798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.237549+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:15:05.237549+0000","last_peered":"2024-09-12T18:15:05.237549+0000","last_clean":"2024-09-12T18:15:05.237549+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:15:05.237549+0000","last_undegraded":"2024-09-12T18:15:05.237549+0000","last_fullsized":"2024-09-12T18:15:05.237549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":110,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.233432+0000","last_change":"2024-09-12T18:14:28.990705+0000","last_active":"2024-09-12T18:15:05.233432+0000","last_peered":"2024-09-12T18:15:05.233432+0000","last_clean":"2024-09-12T18:14:26.966580+0000","last_became_active":"2024-09-12T18:14:28.990705+0000","last_became_peered":"2024-09-12T18:14:28.990705+0000","last_unstale":"2024-09-12T18:15:05.233432+0000","last_undegraded":"2024-09-12T18:14:28.982812+0000","last_fullsized":"2024-09-12T18:14:28.982612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.599315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"61'11697","reported_seq":16190,"reported_epoch":61,"state":"active+undersized+degraded+remapped+backfilling","last_fresh":"2024-09-12T18:15:05.499005+0000","last_change":"2024-09-12T18:14:50.275038+0000","last_active":"2024-09-12T18:15:05.499005+0000","last_peered":"2024-09-12T18:15:05.499005+0000","last_clean":"2024-09-12T18:14:27.974509+0000","last_became_active":"2024-09-12T18:14:50.260894+0000","last_became_peered":"2024-09-12T18:14:50.260894+0000","last_unstale":"2024-09-12T18:15:05.499005+0000","last_undegraded":"2024-09-12T18:14:50.151797+0000","last_fullsized":"2024-09-12T18:14:50.130906+0000","mapping_epoch":53,"log_start":"47'7900","ondisk_log_start":"47'7900","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336265216,"num_objects":5131,"num_object_clones":0,"num_object_copies":10262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3288,"num_objects_misplaced":5131,"num_objects_unfound":0,"num_objects_dirty":5131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11697,"num_write_kb":538496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2199,"num_bytes_recovered":144113664,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":5131}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":103,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.236941+0000","last_change":"2024-09-12T18:14:28.996036+0000","last_active":"2024-09-12T18:15:05.236941+0000","last_peered":"2024-09-12T18:15:05.236941+0000","last_clean":"2024-09-12T18:14:26.967637+0000","last_became_active":"2024-09-12T18:14:28.996036+0000","last_became_peered":"2024-09-12T18:14:28.996036+0000","last_unstale":"2024-09-12T18:15:05.236941+0000","last_undegraded":"2024-09-12T18:14:28.988347+0000","last_fullsized":"2024-09-12T18:14:28.988302+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:09.439841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.233121+0000","last_change":"2024-09-12T18:14:28.983580+0000","last_active":"2024-09-12T18:15:05.233121+0000","last_peered":"2024-09-12T18:15:05.233121+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.983580+0000","last_became_peered":"2024-09-12T18:14:28.983580+0000","last_unstale":"2024-09-12T18:15:05.233121+0000","last_undegraded":"2024-09-12T18:15:05.233121+0000","last_fullsized":"2024-09-12T18:14:28.982025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"61'11765","reported_seq":11857,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.502129+0000","last_change":"2024-09-12T18:14:28.991545+0000","last_active":"2024-09-12T18:15:05.502129+0000","last_peered":"2024-09-12T18:15:05.502129+0000","last_clean":"2024-09-12T18:14:27.943375+0000","last_became_active":"2024-09-12T18:14:28.991545+0000","last_became_peered":"2024-09-12T18:14:28.991545+0000","last_unstale":"2024-09-12T18:15:05.502129+0000","last_undegraded":"2024-09-12T18:14:28.983008+0000","last_fullsized":"2024-09-12T18:14:28.982804+0000","mapping_epoch":43,"log_start":"50'8808","ondisk_log_start":"50'8808","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":2001,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:08.785401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338493440,"num_objects":5165,"num_object_clones":0,"num_object_copies":10330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11765,"num_write_kb":541760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":5165}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":30,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236285+0000","last_change":"2024-09-12T18:14:50.219915+0000","last_active":"2024-09-12T18:15:05.236285+0000","last_peered":"2024-09-12T18:15:05.236285+0000","last_clean":"2024-09-12T18:15:05.236285+0000","last_became_active":"2024-09-12T18:14:50.154668+0000","last_became_peered":"2024-09-12T18:14:50.154668+0000","last_unstale":"2024-09-12T18:15:05.236285+0000","last_undegraded":"2024-09-12T18:15:05.236285+0000","last_fullsized":"2024-09-12T18:15:05.236285+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:17.043905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.237653+0000","last_change":"2024-09-12T18:14:28.986017+0000","last_active":"2024-09-12T18:15:05.237653+0000","last_peered":"2024-09-12T18:15:05.237653+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986017+0000","last_became_peered":"2024-09-12T18:14:28.986017+0000","last_unstale":"2024-09-12T18:15:05.237653+0000","last_undegraded":"2024-09-12T18:15:05.237653+0000","last_fullsized":"2024-09-12T18:14:28.982203+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:50.876261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"61'11538","reported_seq":11630,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.496419+0000","last_change":"2024-09-12T18:14:28.994795+0000","last_active":"2024-09-12T18:15:05.496419+0000","last_peered":"2024-09-12T18:15:05.496419+0000","last_clean":"2024-09-12T18:14:27.957179+0000","last_became_active":"2024-09-12T18:14:28.994795+0000","last_became_peered":"2024-09-12T18:14:28.994795+0000","last_unstale":"2024-09-12T18:15:05.496419+0000","last_undegraded":"2024-09-12T18:14:28.988893+0000","last_fullsized":"2024-09-12T18:14:28.988790+0000","mapping_epoch":43,"log_start":"50'8581","ondisk_log_start":"50'8581","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":2001,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:46.707507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327811072,"num_objects":5002,"num_object_clones":0,"num_object_copies":10004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5002,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11538,"num_write_kb":529280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":5002}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":30,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235373+0000","last_change":"2024-09-12T18:14:50.225115+0000","last_active":"2024-09-12T18:15:05.235373+0000","last_peered":"2024-09-12T18:15:05.235373+0000","last_clean":"2024-09-12T18:15:05.235373+0000","last_became_active":"2024-09-12T18:14:50.152871+0000","last_became_peered":"2024-09-12T18:14:50.152871+0000","last_unstale":"2024-09-12T18:15:05.235373+0000","last_undegraded":"2024-09-12T18:15:05.235373+0000","last_fullsized":"2024-09-12T18:15:05.235373+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:54.959622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.239139+0000","last_change":"2024-09-12T18:14:50.153445+0000","last_active":"2024-09-12T18:15:05.239139+0000","last_peered":"2024-09-12T18:15:05.239139+0000","last_clean":"2024-09-12T18:15:05.239139+0000","last_became_active":"2024-09-12T18:14:50.150125+0000","last_became_peered":"2024-09-12T18:14:50.150125+0000","last_unstale":"2024-09-12T18:15:05.239139+0000","last_undegraded":"2024-09-12T18:15:05.239139+0000","last_fullsized":"2024-09-12T18:15:05.239139+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.154003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"61'11693","reported_seq":11785,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.494197+0000","last_change":"2024-09-12T18:14:28.990209+0000","last_active":"2024-09-12T18:15:05.494197+0000","last_peered":"2024-09-12T18:15:05.494197+0000","last_clean":"2024-09-12T18:14:27.963737+0000","last_became_active":"2024-09-12T18:14:28.990209+0000","last_became_peered":"2024-09-12T18:14:28.990209+0000","last_unstale":"2024-09-12T18:15:05.494197+0000","last_undegraded":"2024-09-12T18:14:28.982157+0000","last_fullsized":"2024-09-12T18:14:28.981997+0000","mapping_epoch":43,"log_start":"50'8703","ondisk_log_start":"50'8703","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2990,"log_dups_size":2001,"ondisk_log_size":2990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:12.511476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336789504,"num_objects":5139,"num_object_clones":0,"num_object_copies":10278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11693,"num_write_kb":538624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":5139}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.240273+0000","last_change":"2024-09-12T18:14:43.096073+0000","last_active":"2024-09-12T18:15:05.240273+0000","last_peered":"2024-09-12T18:15:05.240273+0000","last_clean":"2024-09-12T18:15:05.240273+0000","last_became_active":"2024-09-12T18:14:43.092815+0000","last_became_peered":"2024-09-12T18:14:43.092815+0000","last_unstale":"2024-09-12T18:15:05.240273+0000","last_undegraded":"2024-09-12T18:15:05.240273+0000","last_fullsized":"2024-09-12T18:15:05.240273+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.757546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236501+0000","last_change":"2024-09-12T18:14:50.156851+0000","last_active":"2024-09-12T18:15:05.236501+0000","last_peered":"2024-09-12T18:15:05.236501+0000","last_clean":"2024-09-12T18:15:05.236501+0000","last_became_active":"2024-09-12T18:14:50.154011+0000","last_became_peered":"2024-09-12T18:14:50.154011+0000","last_unstale":"2024-09-12T18:15:05.236501+0000","last_undegraded":"2024-09-12T18:15:05.236501+0000","last_fullsized":"2024-09-12T18:15:05.236501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:47.047802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"61'11816","reported_seq":11909,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.494519+0000","last_change":"2024-09-12T18:14:28.990067+0000","last_active":"2024-09-12T18:15:05.494519+0000","last_peered":"2024-09-12T18:15:05.494519+0000","last_clean":"2024-09-12T18:14:27.953436+0000","last_became_active":"2024-09-12T18:14:28.990067+0000","last_became_peered":"2024-09-12T18:14:28.990067+0000","last_unstale":"2024-09-12T18:15:05.494519+0000","last_undegraded":"2024-09-12T18:14:28.983735+0000","last_fullsized":"2024-09-12T18:14:28.983614+0000","mapping_epoch":43,"log_start":"47'8045","ondisk_log_start":"47'8045","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3771,"log_dups_size":0,"ondisk_log_size":3771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:33.488431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":336265240,"num_objects":5132,"num_object_clones":0,"num_object_copies":10264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5132,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5132,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11816,"num_write_kb":542273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":5132}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":106,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235524+0000","last_change":"2024-09-12T18:14:50.157932+0000","last_active":"2024-09-12T18:15:05.235524+0000","last_peered":"2024-09-12T18:15:05.235524+0000","last_clean":"2024-09-12T18:15:05.235524+0000","last_became_active":"2024-09-12T18:14:50.155849+0000","last_became_peered":"2024-09-12T18:14:50.155849+0000","last_unstale":"2024-09-12T18:15:05.235524+0000","last_undegraded":"2024-09-12T18:15:05.235524+0000","last_fullsized":"2024-09-12T18:15:05.235524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:59.541267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.239498+0000","last_change":"2024-09-12T18:14:50.149296+0000","last_active":"2024-09-12T18:15:05.239498+0000","last_peered":"2024-09-12T18:15:05.239498+0000","last_clean":"2024-09-12T18:15:05.239498+0000","last_became_active":"2024-09-12T18:14:50.148183+0000","last_became_peered":"2024-09-12T18:14:50.148183+0000","last_unstale":"2024-09-12T18:15:05.239498+0000","last_undegraded":"2024-09-12T18:15:05.239498+0000","last_fullsized":"2024-09-12T18:15:05.239498+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:42.934775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"61'11609","reported_seq":11703,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.512778+0000","last_change":"2024-09-12T18:14:50.187560+0000","last_active":"2024-09-12T18:15:05.512778+0000","last_peered":"2024-09-12T18:15:05.512778+0000","last_clean":"2024-09-12T18:15:05.512778+0000","last_became_active":"2024-09-12T18:14:50.146949+0000","last_became_peered":"2024-09-12T18:14:50.146949+0000","last_unstale":"2024-09-12T18:15:05.512778+0000","last_undegraded":"2024-09-12T18:15:05.512778+0000","last_fullsized":"2024-09-12T18:15:05.512778+0000","mapping_epoch":53,"log_start":"50'8647","ondisk_log_start":"50'8647","created":21,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2962,"log_dups_size":2001,"ondisk_log_size":2962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:46.634231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333643776,"num_objects":5091,"num_object_clones":0,"num_object_copies":10182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":5091,"num_objects_unfound":0,"num_objects_dirty":5091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11609,"num_write_kb":534400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":5091}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.238101+0000","last_change":"2024-09-12T18:14:43.095580+0000","last_active":"2024-09-12T18:15:05.238101+0000","last_peered":"2024-09-12T18:15:05.238101+0000","last_clean":"2024-09-12T18:15:05.238101+0000","last_became_active":"2024-09-12T18:14:43.092061+0000","last_became_peered":"2024-09-12T18:14:43.092061+0000","last_unstale":"2024-09-12T18:15:05.238101+0000","last_undegraded":"2024-09-12T18:15:05.238101+0000","last_fullsized":"2024-09-12T18:15:05.238101+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:03.825242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235434+0000","last_change":"2024-09-12T18:14:50.156024+0000","last_active":"2024-09-12T18:15:05.235434+0000","last_peered":"2024-09-12T18:15:05.235434+0000","last_clean":"2024-09-12T18:15:05.235434+0000","last_became_active":"2024-09-12T18:14:50.150316+0000","last_became_peered":"2024-09-12T18:14:50.150316+0000","last_unstale":"2024-09-12T18:15:05.235434+0000","last_undegraded":"2024-09-12T18:15:05.235434+0000","last_fullsized":"2024-09-12T18:15:05.235434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:23.273569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"61'11881","reported_seq":11971,"reported_epoch":61,"state":"active+undersized+degraded+remapped+backfill_wait","last_fresh":"2024-09-12T18:15:05.462769+0000","last_change":"2024-09-12T18:14:50.279784+0000","last_active":"2024-09-12T18:15:05.462769+0000","last_peered":"2024-09-12T18:15:05.462769+0000","last_clean":"2024-09-12T18:14:27.963889+0000","last_became_active":"2024-09-12T18:14:50.267757+0000","last_became_peered":"2024-09-12T18:14:50.267757+0000","last_unstale":"2024-09-12T18:15:05.462769+0000","last_undegraded":"2024-09-12T18:14:50.153375+0000","last_fullsized":"2024-09-12T18:14:50.133093+0000","mapping_epoch":53,"log_start":"47'8100","ondisk_log_start":"47'8100","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3781,"log_dups_size":0,"ondisk_log_size":3781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337969152,"num_objects":5157,"num_object_clones":0,"num_object_copies":10314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5157,"num_objects_misplaced":5157,"num_objects_unfound":0,"num_objects_dirty":5157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11881,"num_write_kb":545216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":5157}],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.235110+0000","last_change":"2024-09-12T18:14:28.993136+0000","last_active":"2024-09-12T18:15:05.235110+0000","last_peered":"2024-09-12T18:15:05.235110+0000","last_clean":"2024-09-12T18:13:21.360759+0000","last_became_active":"2024-09-12T18:14:28.993136+0000","last_became_peered":"2024-09-12T18:14:28.993136+0000","last_unstale":"2024-09-12T18:15:05.235110+0000","last_undegraded":"2024-09-12T18:15:05.235110+0000","last_fullsized":"2024-09-12T18:14:28.982738+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:36.374765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235678+0000","last_change":"2024-09-12T18:14:50.155019+0000","last_active":"2024-09-12T18:15:05.235678+0000","last_peered":"2024-09-12T18:15:05.235678+0000","last_clean":"2024-09-12T18:15:05.235678+0000","last_became_active":"2024-09-12T18:14:50.153137+0000","last_became_peered":"2024-09-12T18:14:50.153137+0000","last_unstale":"2024-09-12T18:15:05.235678+0000","last_undegraded":"2024-09-12T18:15:05.235678+0000","last_fullsized":"2024-09-12T18:15:05.235678+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:59.015252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"61'11740","reported_seq":11831,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.509783+0000","last_change":"2024-09-12T18:14:28.985893+0000","last_active":"2024-09-12T18:15:05.509783+0000","last_peered":"2024-09-12T18:15:05.509783+0000","last_clean":"2024-09-12T18:14:27.960780+0000","last_became_active":"2024-09-12T18:14:28.985893+0000","last_became_peered":"2024-09-12T18:14:28.985893+0000","last_unstale":"2024-09-12T18:15:05.509783+0000","last_undegraded":"2024-09-12T18:14:28.983300+0000","last_fullsized":"2024-09-12T18:14:28.983198+0000","mapping_epoch":43,"log_start":"50'8801","ondisk_log_start":"50'8801","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2939,"log_dups_size":2059,"ondisk_log_size":2939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:06.548143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333185024,"num_objects":5084,"num_object_clones":0,"num_object_copies":10168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5084,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11740,"num_write_kb":538368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":5084}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.235365+0000","last_change":"2024-09-12T18:14:29.000093+0000","last_active":"2024-09-12T18:15:05.235365+0000","last_peered":"2024-09-12T18:15:05.235365+0000","last_clean":"2024-09-12T18:13:21.360759+0000","last_became_active":"2024-09-12T18:14:29.000093+0000","last_became_peered":"2024-09-12T18:14:29.000093+0000","last_unstale":"2024-09-12T18:15:05.235365+0000","last_undegraded":"2024-09-12T18:15:05.235365+0000","last_fullsized":"2024-09-12T18:14:28.983532+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:41.816820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.237637+0000","last_change":"2024-09-12T18:14:28.989349+0000","last_active":"2024-09-12T18:15:05.237637+0000","last_peered":"2024-09-12T18:15:05.237637+0000","last_clean":"2024-09-12T18:14:26.965985+0000","last_became_active":"2024-09-12T18:14:28.989349+0000","last_became_peered":"2024-09-12T18:14:28.989349+0000","last_unstale":"2024-09-12T18:15:05.237637+0000","last_undegraded":"2024-09-12T18:15:05.237637+0000","last_fullsized":"2024-09-12T18:14:28.985176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:26.084753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"61'11962","reported_seq":12052,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.502840+0000","last_change":"2024-09-12T18:14:28.990052+0000","last_active":"2024-09-12T18:15:05.502840+0000","last_peered":"2024-09-12T18:15:05.502840+0000","last_clean":"2024-09-12T18:14:27.964926+0000","last_became_active":"2024-09-12T18:14:28.990052+0000","last_became_peered":"2024-09-12T18:14:28.990052+0000","last_unstale":"2024-09-12T18:15:05.502840+0000","last_undegraded":"2024-09-12T18:14:28.983843+0000","last_fullsized":"2024-09-12T18:14:28.983744+0000","mapping_epoch":43,"log_start":"50'9026","ondisk_log_start":"50'9026","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2936,"log_dups_size":2088,"ondisk_log_size":2936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:18.318566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343146496,"num_objects":5236,"num_object_clones":0,"num_object_copies":10472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11962,"num_write_kb":550336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":5236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":256,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235680+0000","last_change":"2024-09-12T18:14:51.740775+0000","last_active":"2024-09-12T18:15:05.235680+0000","last_peered":"2024-09-12T18:15:05.235680+0000","last_clean":"2024-09-12T18:15:05.235680+0000","last_became_active":"2024-09-12T18:14:51.740386+0000","last_became_peered":"2024-09-12T18:14:51.740386+0000","last_unstale":"2024-09-12T18:15:05.235680+0000","last_undegraded":"2024-09-12T18:15:05.235680+0000","last_fullsized":"2024-09-12T18:15:05.235680+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:48.598883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.234003+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:15:05.234003+0000","last_peered":"2024-09-12T18:15:05.234003+0000","last_clean":"2024-09-12T18:15:05.234003+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:15:05.234003+0000","last_undegraded":"2024-09-12T18:15:05.234003+0000","last_fullsized":"2024-09-12T18:15:05.234003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.239159+0000","last_change":"2024-09-12T18:14:28.996605+0000","last_active":"2024-09-12T18:15:05.239159+0000","last_peered":"2024-09-12T18:15:05.239159+0000","last_clean":"2024-09-12T18:14:26.966733+0000","last_became_active":"2024-09-12T18:14:28.996605+0000","last_became_peered":"2024-09-12T18:14:28.996605+0000","last_unstale":"2024-09-12T18:15:05.239159+0000","last_undegraded":"2024-09-12T18:15:05.239159+0000","last_fullsized":"2024-09-12T18:14:28.986752+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:48.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240622+0000","last_change":"2024-09-12T18:14:29.007445+0000","last_active":"2024-09-12T18:15:05.240622+0000","last_peered":"2024-09-12T18:15:05.240622+0000","last_clean":"2024-09-12T18:14:26.967919+0000","last_became_active":"2024-09-12T18:14:29.007445+0000","last_became_peered":"2024-09-12T18:14:29.007445+0000","last_unstale":"2024-09-12T18:15:05.240622+0000","last_undegraded":"2024-09-12T18:15:05.240622+0000","last_fullsized":"2024-09-12T18:14:28.987718+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.981162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"61'11585","reported_seq":11674,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.494870+0000","last_change":"2024-09-12T18:13:39.304779+0000","last_active":"2024-09-12T18:15:05.494870+0000","last_peered":"2024-09-12T18:15:05.494870+0000","last_clean":"2024-09-12T18:15:05.494870+0000","last_became_active":"2024-09-12T18:13:39.304291+0000","last_became_peered":"2024-09-12T18:13:39.304291+0000","last_unstale":"2024-09-12T18:15:05.494870+0000","last_undegraded":"2024-09-12T18:15:05.494870+0000","last_fullsized":"2024-09-12T18:15:05.494870+0000","mapping_epoch":21,"log_start":"47'7800","ondisk_log_start":"47'7800","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:56.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333643776,"num_objects":5091,"num_object_clones":0,"num_object_copies":10182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11585,"num_write_kb":533632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.233665+0000","last_change":"2024-09-12T18:14:28.990119+0000","last_active":"2024-09-12T18:15:05.233665+0000","last_peered":"2024-09-12T18:15:05.233665+0000","last_clean":"2024-09-12T18:14:26.966684+0000","last_became_active":"2024-09-12T18:14:28.990119+0000","last_became_peered":"2024-09-12T18:14:28.990119+0000","last_unstale":"2024-09-12T18:15:05.233665+0000","last_undegraded":"2024-09-12T18:15:05.233665+0000","last_fullsized":"2024-09-12T18:14:28.982822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:36.432922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236782+0000","last_change":"2024-09-12T18:14:50.170827+0000","last_active":"2024-09-12T18:15:05.236782+0000","last_peered":"2024-09-12T18:15:05.236782+0000","last_clean":"2024-09-12T18:15:05.236782+0000","last_became_active":"2024-09-12T18:14:50.169096+0000","last_became_peered":"2024-09-12T18:14:50.169096+0000","last_unstale":"2024-09-12T18:15:05.236782+0000","last_undegraded":"2024-09-12T18:15:05.236782+0000","last_fullsized":"2024-09-12T18:15:05.236782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:44.642918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.239569+0000","last_change":"2024-09-12T18:14:29.001622+0000","last_active":"2024-09-12T18:15:05.239569+0000","last_peered":"2024-09-12T18:15:05.239569+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:29.001622+0000","last_became_peered":"2024-09-12T18:14:29.001622+0000","last_unstale":"2024-09-12T18:15:05.239569+0000","last_undegraded":"2024-09-12T18:15:05.239569+0000","last_fullsized":"2024-09-12T18:14:28.983595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:10.448683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"61'11734","reported_seq":11832,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.512753+0000","last_change":"2024-09-12T18:14:50.226763+0000","last_active":"2024-09-12T18:15:05.512753+0000","last_peered":"2024-09-12T18:15:05.512753+0000","last_clean":"2024-09-12T18:15:05.512753+0000","last_became_active":"2024-09-12T18:14:50.183118+0000","last_became_peered":"2024-09-12T18:14:50.183118+0000","last_unstale":"2024-09-12T18:15:05.512753+0000","last_undegraded":"2024-09-12T18:15:05.512753+0000","last_fullsized":"2024-09-12T18:15:05.512753+0000","mapping_epoch":53,"log_start":"50'8742","ondisk_log_start":"50'8742","created":21,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2992,"log_dups_size":2001,"ondisk_log_size":2992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:24.263006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331612160,"num_objects":5060,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":5060,"num_objects_unfound":0,"num_objects_dirty":5060,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11734,"num_write_kb":537408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":5060}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.238022+0000","last_change":"2024-09-12T18:14:28.987263+0000","last_active":"2024-09-12T18:15:05.238022+0000","last_peered":"2024-09-12T18:15:05.238022+0000","last_clean":"2024-09-12T18:14:26.964774+0000","last_became_active":"2024-09-12T18:14:28.987263+0000","last_became_peered":"2024-09-12T18:14:28.987263+0000","last_unstale":"2024-09-12T18:15:05.238022+0000","last_undegraded":"2024-09-12T18:15:05.238022+0000","last_fullsized":"2024-09-12T18:14:28.982703+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:34.334370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.234640+0000","last_change":"2024-09-12T18:14:50.149691+0000","last_active":"2024-09-12T18:15:05.234640+0000","last_peered":"2024-09-12T18:15:05.234640+0000","last_clean":"2024-09-12T18:15:05.234640+0000","last_became_active":"2024-09-12T18:14:50.146843+0000","last_became_peered":"2024-09-12T18:14:50.146843+0000","last_unstale":"2024-09-12T18:15:05.234640+0000","last_undegraded":"2024-09-12T18:15:05.234640+0000","last_fullsized":"2024-09-12T18:15:05.234640+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:23.075521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.237777+0000","last_change":"2024-09-12T18:14:28.989372+0000","last_active":"2024-09-12T18:15:05.237777+0000","last_peered":"2024-09-12T18:15:05.237777+0000","last_clean":"2024-09-12T18:14:26.966105+0000","last_became_active":"2024-09-12T18:14:28.989372+0000","last_became_peered":"2024-09-12T18:14:28.989372+0000","last_unstale":"2024-09-12T18:15:05.237777+0000","last_undegraded":"2024-09-12T18:15:05.237777+0000","last_fullsized":"2024-09-12T18:14:28.985512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:32.414142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"61'11978","reported_seq":12066,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.504643+0000","last_change":"2024-09-12T18:13:39.303887+0000","last_active":"2024-09-12T18:15:05.504643+0000","last_peered":"2024-09-12T18:15:05.504643+0000","last_clean":"2024-09-12T18:15:05.504643+0000","last_became_active":"2024-09-12T18:13:39.303308+0000","last_became_peered":"2024-09-12T18:13:39.303308+0000","last_unstale":"2024-09-12T18:15:05.504643+0000","last_undegraded":"2024-09-12T18:15:05.504643+0000","last_fullsized":"2024-09-12T18:15:05.504643+0000","mapping_epoch":21,"log_start":"50'9011","ondisk_log_start":"50'9011","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2967,"log_dups_size":2088,"ondisk_log_size":2967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:51.598853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":337379328,"num_objects":5148,"num_object_clones":0,"num_object_copies":10296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11978,"num_write_kb":548032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":114,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.234359+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:15:05.234359+0000","last_peered":"2024-09-12T18:15:05.234359+0000","last_clean":"2024-09-12T18:15:05.234359+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:15:05.234359+0000","last_undegraded":"2024-09-12T18:15:05.234359+0000","last_fullsized":"2024-09-12T18:15:05.234359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.233993+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:15:05.233993+0000","last_peered":"2024-09-12T18:15:05.233993+0000","last_clean":"2024-09-12T18:15:05.233993+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:15:05.233993+0000","last_undegraded":"2024-09-12T18:15:05.233993+0000","last_fullsized":"2024-09-12T18:15:05.233993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240571+0000","last_change":"2024-09-12T18:14:28.995181+0000","last_active":"2024-09-12T18:15:05.240571+0000","last_peered":"2024-09-12T18:15:05.240571+0000","last_clean":"2024-09-12T18:14:26.966888+0000","last_became_active":"2024-09-12T18:14:28.995181+0000","last_became_peered":"2024-09-12T18:14:28.995181+0000","last_unstale":"2024-09-12T18:15:05.240571+0000","last_undegraded":"2024-09-12T18:15:05.240571+0000","last_fullsized":"2024-09-12T18:14:28.984245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:41.590912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"61'11919","reported_seq":12014,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.513225+0000","last_change":"2024-09-12T18:14:50.227630+0000","last_active":"2024-09-12T18:15:05.513225+0000","last_peered":"2024-09-12T18:15:05.513225+0000","last_clean":"2024-09-12T18:15:05.513225+0000","last_became_active":"2024-09-12T18:14:50.183818+0000","last_became_peered":"2024-09-12T18:14:50.183818+0000","last_unstale":"2024-09-12T18:15:05.513225+0000","last_undegraded":"2024-09-12T18:15:05.513225+0000","last_fullsized":"2024-09-12T18:15:05.513225+0000","mapping_epoch":53,"log_start":"50'8980","ondisk_log_start":"50'8980","created":21,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2939,"log_dups_size":2088,"ondisk_log_size":2939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:35.553466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340721664,"num_objects":5199,"num_object_clones":0,"num_object_copies":10398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":5199,"num_objects_unfound":0,"num_objects_dirty":5199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11919,"num_write_kb":547776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":5199}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.236067+0000","last_change":"2024-09-12T18:14:43.094420+0000","last_active":"2024-09-12T18:15:05.236067+0000","last_peered":"2024-09-12T18:15:05.236067+0000","last_clean":"2024-09-12T18:15:05.236067+0000","last_became_active":"2024-09-12T18:14:43.092106+0000","last_became_peered":"2024-09-12T18:14:43.092106+0000","last_unstale":"2024-09-12T18:15:05.236067+0000","last_undegraded":"2024-09-12T18:15:05.236067+0000","last_fullsized":"2024-09-12T18:15:05.236067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.122610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240700+0000","last_change":"2024-09-12T18:14:28.996017+0000","last_active":"2024-09-12T18:15:05.240700+0000","last_peered":"2024-09-12T18:15:05.240700+0000","last_clean":"2024-09-12T18:14:26.967087+0000","last_became_active":"2024-09-12T18:14:28.996017+0000","last_became_peered":"2024-09-12T18:14:28.996017+0000","last_unstale":"2024-09-12T18:15:05.240700+0000","last_undegraded":"2024-09-12T18:15:05.240700+0000","last_fullsized":"2024-09-12T18:14:28.984627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.436294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.234907+0000","last_change":"2024-09-12T18:14:50.153928+0000","last_active":"2024-09-12T18:15:05.234907+0000","last_peered":"2024-09-12T18:15:05.234907+0000","last_clean":"2024-09-12T18:15:05.234907+0000","last_became_active":"2024-09-12T18:14:50.148471+0000","last_became_peered":"2024-09-12T18:14:50.148471+0000","last_unstale":"2024-09-12T18:15:05.234907+0000","last_undegraded":"2024-09-12T18:15:05.234907+0000","last_fullsized":"2024-09-12T18:15:05.234907+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:58.933592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"61'11804","reported_seq":11903,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.496652+0000","last_change":"2024-09-12T18:14:43.153281+0000","last_active":"2024-09-12T18:15:05.496652+0000","last_peered":"2024-09-12T18:15:05.496652+0000","last_clean":"2024-09-12T18:15:05.496652+0000","last_became_active":"2024-09-12T18:14:43.095320+0000","last_became_peered":"2024-09-12T18:14:43.095320+0000","last_unstale":"2024-09-12T18:15:05.496652+0000","last_undegraded":"2024-09-12T18:15:05.496652+0000","last_fullsized":"2024-09-12T18:15:05.496652+0000","mapping_epoch":49,"log_start":"50'8813","ondisk_log_start":"50'8813","created":21,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2991,"log_dups_size":2030,"ondisk_log_size":2991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:55.103505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333185024,"num_objects":5084,"num_object_clones":0,"num_object_copies":10168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11804,"num_write_kb":540416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240583+0000","last_change":"2024-09-12T18:14:28.995478+0000","last_active":"2024-09-12T18:15:05.240583+0000","last_peered":"2024-09-12T18:15:05.240583+0000","last_clean":"2024-09-12T18:14:26.966971+0000","last_became_active":"2024-09-12T18:14:28.995478+0000","last_became_peered":"2024-09-12T18:14:28.995478+0000","last_unstale":"2024-09-12T18:15:05.240583+0000","last_undegraded":"2024-09-12T18:15:05.240583+0000","last_fullsized":"2024-09-12T18:14:28.984421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:41.482471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236260+0000","last_change":"2024-09-12T18:14:28.989022+0000","last_active":"2024-09-12T18:15:05.236260+0000","last_peered":"2024-09-12T18:15:05.236260+0000","last_clean":"2024-09-12T18:13:16.311210+0000","last_became_active":"2024-09-12T18:14:28.989022+0000","last_became_peered":"2024-09-12T18:14:28.989022+0000","last_unstale":"2024-09-12T18:15:05.236260+0000","last_undegraded":"2024-09-12T18:15:05.236260+0000","last_fullsized":"2024-09-12T18:14:28.984576+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:45.833129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235073+0000","last_change":"2024-09-12T18:14:50.156323+0000","last_active":"2024-09-12T18:15:05.235073+0000","last_peered":"2024-09-12T18:15:05.235073+0000","last_clean":"2024-09-12T18:15:05.235073+0000","last_became_active":"2024-09-12T18:14:50.150056+0000","last_became_peered":"2024-09-12T18:14:50.150056+0000","last_unstale":"2024-09-12T18:15:05.235073+0000","last_undegraded":"2024-09-12T18:15:05.235073+0000","last_fullsized":"2024-09-12T18:15:05.235073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:38.764067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"61'11772","reported_seq":11869,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.514923+0000","last_change":"2024-09-12T18:14:43.129916+0000","last_active":"2024-09-12T18:15:05.514923+0000","last_peered":"2024-09-12T18:15:05.514923+0000","last_clean":"2024-09-12T18:15:05.514923+0000","last_became_active":"2024-09-12T18:14:43.089403+0000","last_became_peered":"2024-09-12T18:14:43.089403+0000","last_unstale":"2024-09-12T18:15:05.514923+0000","last_undegraded":"2024-09-12T18:15:05.514923+0000","last_fullsized":"2024-09-12T18:15:05.514923+0000","mapping_epoch":49,"log_start":"50'8813","ondisk_log_start":"50'8813","created":21,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":2059,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:35.575291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328859648,"num_objects":5018,"num_object_clones":0,"num_object_copies":10036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11772,"num_write_kb":537280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":104,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.238998+0000","last_change":"2024-09-12T18:14:28.994380+0000","last_active":"2024-09-12T18:15:05.238998+0000","last_peered":"2024-09-12T18:15:05.238998+0000","last_clean":"2024-09-12T18:14:26.966377+0000","last_became_active":"2024-09-12T18:14:28.994380+0000","last_became_peered":"2024-09-12T18:14:28.994380+0000","last_unstale":"2024-09-12T18:15:05.238998+0000","last_undegraded":"2024-09-12T18:14:28.987510+0000","last_fullsized":"2024-09-12T18:14:28.987415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:34.598948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236058+0000","last_change":"2024-09-12T18:14:29.002359+0000","last_active":"2024-09-12T18:15:05.236058+0000","last_peered":"2024-09-12T18:15:05.236058+0000","last_clean":"2024-09-12T18:14:26.966339+0000","last_became_active":"2024-09-12T18:14:29.002359+0000","last_became_peered":"2024-09-12T18:14:29.002359+0000","last_unstale":"2024-09-12T18:15:05.236058+0000","last_undegraded":"2024-09-12T18:15:05.236058+0000","last_fullsized":"2024-09-12T18:14:28.985063+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:33.800531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235647+0000","last_change":"2024-09-12T18:14:50.153231+0000","last_active":"2024-09-12T18:15:05.235647+0000","last_peered":"2024-09-12T18:15:05.235647+0000","last_clean":"2024-09-12T18:15:05.235647+0000","last_became_active":"2024-09-12T18:14:50.148083+0000","last_became_peered":"2024-09-12T18:14:50.148083+0000","last_unstale":"2024-09-12T18:15:05.235647+0000","last_undegraded":"2024-09-12T18:15:05.235647+0000","last_fullsized":"2024-09-12T18:15:05.235647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:09.736701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"61'11778","reported_seq":11869,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.502238+0000","last_change":"2024-09-12T18:14:28.985835+0000","last_active":"2024-09-12T18:15:05.502238+0000","last_peered":"2024-09-12T18:15:05.502238+0000","last_clean":"2024-09-12T18:14:27.960039+0000","last_became_active":"2024-09-12T18:14:28.985835+0000","last_became_peered":"2024-09-12T18:14:28.985835+0000","last_unstale":"2024-09-12T18:15:05.502238+0000","last_undegraded":"2024-09-12T18:14:28.982086+0000","last_fullsized":"2024-09-12T18:14:28.981819+0000","mapping_epoch":43,"log_start":"50'8784","ondisk_log_start":"50'8784","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:38.268087+0000","last_clean_scrub_stamp":"2024-09-12T18:13:38.268087+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":2001,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:59.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":341180416,"num_objects":5206,"num_object_clones":0,"num_object_copies":10412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11778,"num_write_kb":543488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":5206}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":105,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.239382+0000","last_change":"2024-09-12T18:14:50.155387+0000","last_active":"2024-09-12T18:15:05.239382+0000","last_peered":"2024-09-12T18:15:05.239382+0000","last_clean":"2024-09-12T18:15:05.239382+0000","last_became_active":"2024-09-12T18:14:50.154610+0000","last_became_peered":"2024-09-12T18:14:50.154610+0000","last_unstale":"2024-09-12T18:15:05.239382+0000","last_undegraded":"2024-09-12T18:15:05.239382+0000","last_fullsized":"2024-09-12T18:15:05.239382+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:35.187130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236996+0000","last_change":"2024-09-12T18:14:28.997335+0000","last_active":"2024-09-12T18:15:05.236996+0000","last_peered":"2024-09-12T18:15:05.236996+0000","last_clean":"2024-09-12T18:14:26.967631+0000","last_became_active":"2024-09-12T18:14:28.997335+0000","last_became_peered":"2024-09-12T18:14:28.997335+0000","last_unstale":"2024-09-12T18:15:05.236996+0000","last_undegraded":"2024-09-12T18:15:05.236996+0000","last_fullsized":"2024-09-12T18:14:28.988338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:33.800531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.238919+0000","last_change":"2024-09-12T18:14:50.182861+0000","last_active":"2024-09-12T18:15:05.238919+0000","last_peered":"2024-09-12T18:15:05.238919+0000","last_clean":"2024-09-12T18:15:05.238919+0000","last_became_active":"2024-09-12T18:14:50.181104+0000","last_became_peered":"2024-09-12T18:14:50.181104+0000","last_unstale":"2024-09-12T18:15:05.238919+0000","last_undegraded":"2024-09-12T18:15:05.238919+0000","last_fullsized":"2024-09-12T18:15:05.238919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:42.493443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.234897+0000","last_change":"2024-09-12T18:14:50.157831+0000","last_active":"2024-09-12T18:15:05.234897+0000","last_peered":"2024-09-12T18:15:05.234897+0000","last_clean":"2024-09-12T18:15:05.234897+0000","last_became_active":"2024-09-12T18:14:50.154883+0000","last_became_peered":"2024-09-12T18:14:50.154883+0000","last_unstale":"2024-09-12T18:15:05.234897+0000","last_undegraded":"2024-09-12T18:15:05.234897+0000","last_fullsized":"2024-09-12T18:15:05.234897+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:17.641815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":108,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.234776+0000","last_change":"2024-09-12T18:14:28.992424+0000","last_active":"2024-09-12T18:15:05.234776+0000","last_peered":"2024-09-12T18:15:05.234776+0000","last_clean":"2024-09-12T18:14:26.967261+0000","last_became_active":"2024-09-12T18:14:28.992424+0000","last_became_peered":"2024-09-12T18:14:28.992424+0000","last_unstale":"2024-09-12T18:15:05.234776+0000","last_undegraded":"2024-09-12T18:14:28.985794+0000","last_fullsized":"2024-09-12T18:14:28.985700+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:51.527032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":4}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.238187+0000","last_change":"2024-09-12T18:14:28.990680+0000","last_active":"2024-09-12T18:15:05.238187+0000","last_peered":"2024-09-12T18:15:05.238187+0000","last_clean":"2024-09-12T18:14:26.966522+0000","last_became_active":"2024-09-12T18:14:28.990680+0000","last_became_peered":"2024-09-12T18:14:28.990680+0000","last_unstale":"2024-09-12T18:15:05.238187+0000","last_undegraded":"2024-09-12T18:15:05.238187+0000","last_fullsized":"2024-09-12T18:14:28.985360+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:46.424046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":54,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.240508+0000","last_change":"2024-09-12T18:14:29.007283+0000","last_active":"2024-09-12T18:15:05.240508+0000","last_peered":"2024-09-12T18:15:05.240508+0000","last_clean":"2024-09-12T18:13:23.413176+0000","last_became_active":"2024-09-12T18:14:29.007283+0000","last_became_peered":"2024-09-12T18:14:29.007283+0000","last_unstale":"2024-09-12T18:15:05.240508+0000","last_undegraded":"2024-09-12T18:14:28.986112+0000","last_fullsized":"2024-09-12T18:14:28.986011+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:48.525288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.239610+0000","last_change":"2024-09-12T18:14:50.169843+0000","last_active":"2024-09-12T18:15:05.239610+0000","last_peered":"2024-09-12T18:15:05.239610+0000","last_clean":"2024-09-12T18:15:05.239610+0000","last_became_active":"2024-09-12T18:14:50.169342+0000","last_became_peered":"2024-09-12T18:14:50.169342+0000","last_unstale":"2024-09-12T18:15:05.239610+0000","last_undegraded":"2024-09-12T18:15:05.239610+0000","last_fullsized":"2024-09-12T18:15:05.239610+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:02.037297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.237819+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:15:05.237819+0000","last_peered":"2024-09-12T18:15:05.237819+0000","last_clean":"2024-09-12T18:15:05.237819+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:15:05.237819+0000","last_undegraded":"2024-09-12T18:15:05.237819+0000","last_fullsized":"2024-09-12T18:15:05.237819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.238349+0000","last_change":"2024-09-12T18:14:50.184938+0000","last_active":"2024-09-12T18:15:05.238349+0000","last_peered":"2024-09-12T18:15:05.238349+0000","last_clean":"2024-09-12T18:15:05.238349+0000","last_became_active":"2024-09-12T18:14:50.183693+0000","last_became_peered":"2024-09-12T18:14:50.183693+0000","last_unstale":"2024-09-12T18:15:05.238349+0000","last_undegraded":"2024-09-12T18:15:05.238349+0000","last_fullsized":"2024-09-12T18:15:05.238349+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:44.885500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.235520+0000","last_change":"2024-09-12T18:14:28.999450+0000","last_active":"2024-09-12T18:15:05.235520+0000","last_peered":"2024-09-12T18:15:05.235520+0000","last_clean":"2024-09-12T18:14:26.964499+0000","last_became_active":"2024-09-12T18:14:28.999450+0000","last_became_peered":"2024-09-12T18:14:28.999450+0000","last_unstale":"2024-09-12T18:15:05.235520+0000","last_undegraded":"2024-09-12T18:15:05.235520+0000","last_fullsized":"2024-09-12T18:14:28.983604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:17.589946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236618+0000","last_change":"2024-09-12T18:14:28.994901+0000","last_active":"2024-09-12T18:15:05.236618+0000","last_peered":"2024-09-12T18:15:05.236618+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.994901+0000","last_became_peered":"2024-09-12T18:14:28.994901+0000","last_unstale":"2024-09-12T18:15:05.236618+0000","last_undegraded":"2024-09-12T18:15:05.236618+0000","last_fullsized":"2024-09-12T18:14:28.987761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:16.042811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.235909+0000","last_change":"2024-09-12T18:14:28.999703+0000","last_active":"2024-09-12T18:15:05.235909+0000","last_peered":"2024-09-12T18:15:05.235909+0000","last_clean":"2024-09-12T18:14:26.964654+0000","last_became_active":"2024-09-12T18:14:28.999703+0000","last_became_peered":"2024-09-12T18:14:28.999703+0000","last_unstale":"2024-09-12T18:15:05.235909+0000","last_undegraded":"2024-09-12T18:15:05.235909+0000","last_fullsized":"2024-09-12T18:14:28.984199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:36.374765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":102,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.239202+0000","last_change":"2024-09-12T18:14:50.155186+0000","last_active":"2024-09-12T18:15:05.239202+0000","last_peered":"2024-09-12T18:15:05.239202+0000","last_clean":"2024-09-12T18:15:05.239202+0000","last_became_active":"2024-09-12T18:14:50.153703+0000","last_became_peered":"2024-09-12T18:14:50.153703+0000","last_unstale":"2024-09-12T18:15:05.239202+0000","last_undegraded":"2024-09-12T18:15:05.239202+0000","last_fullsized":"2024-09-12T18:15:05.239202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:06.740394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.236951+0000","last_change":"2024-09-12T18:14:50.171605+0000","last_active":"2024-09-12T18:15:05.236951+0000","last_peered":"2024-09-12T18:15:05.236951+0000","last_clean":"2024-09-12T18:15:05.236951+0000","last_became_active":"2024-09-12T18:14:50.170490+0000","last_became_peered":"2024-09-12T18:14:50.170490+0000","last_unstale":"2024-09-12T18:15:05.236951+0000","last_undegraded":"2024-09-12T18:15:05.236951+0000","last_fullsized":"2024-09-12T18:15:05.236951+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:10.324029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.235606+0000","last_change":"2024-09-12T18:14:50.153622+0000","last_active":"2024-09-12T18:15:05.235606+0000","last_peered":"2024-09-12T18:15:05.235606+0000","last_clean":"2024-09-12T18:15:05.235606+0000","last_became_active":"2024-09-12T18:14:50.147796+0000","last_became_peered":"2024-09-12T18:14:50.147796+0000","last_unstale":"2024-09-12T18:15:05.235606+0000","last_undegraded":"2024-09-12T18:15:05.235606+0000","last_fullsized":"2024-09-12T18:15:05.235606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:37.067296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.237937+0000","last_change":"2024-09-12T18:14:28.990330+0000","last_active":"2024-09-12T18:15:05.237937+0000","last_peered":"2024-09-12T18:15:05.237937+0000","last_clean":"2024-09-12T18:13:21.360759+0000","last_became_active":"2024-09-12T18:14:28.990330+0000","last_became_peered":"2024-09-12T18:14:28.990330+0000","last_unstale":"2024-09-12T18:15:05.237937+0000","last_undegraded":"2024-09-12T18:15:05.237937+0000","last_fullsized":"2024-09-12T18:14:28.982433+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:22.211651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.239014+0000","last_change":"2024-09-12T18:14:28.989659+0000","last_active":"2024-09-12T18:15:05.239014+0000","last_peered":"2024-09-12T18:15:05.239014+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.989659+0000","last_became_peered":"2024-09-12T18:14:28.989659+0000","last_unstale":"2024-09-12T18:15:05.239014+0000","last_undegraded":"2024-09-12T18:15:05.239014+0000","last_fullsized":"2024-09-12T18:14:28.982978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:55.630721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":26,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.237679+0000","last_change":"2024-09-12T18:14:50.156844+0000","last_active":"2024-09-12T18:15:05.237679+0000","last_peered":"2024-09-12T18:15:05.237679+0000","last_clean":"2024-09-12T18:15:05.237679+0000","last_became_active":"2024-09-12T18:14:50.153553+0000","last_became_peered":"2024-09-12T18:14:50.153553+0000","last_unstale":"2024-09-12T18:15:05.237679+0000","last_undegraded":"2024-09-12T18:15:05.237679+0000","last_fullsized":"2024-09-12T18:15:05.237679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:46.553852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.238107+0000","last_change":"2024-09-12T18:14:50.157369+0000","last_active":"2024-09-12T18:15:05.238107+0000","last_peered":"2024-09-12T18:15:05.238107+0000","last_clean":"2024-09-12T18:15:05.238107+0000","last_became_active":"2024-09-12T18:14:50.154078+0000","last_became_peered":"2024-09-12T18:14:50.154078+0000","last_unstale":"2024-09-12T18:15:05.238107+0000","last_undegraded":"2024-09-12T18:15:05.238107+0000","last_fullsized":"2024-09-12T18:15:05.238107+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:11.592827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":50,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.240386+0000","last_change":"2024-09-12T18:14:50.150354+0000","last_active":"2024-09-12T18:15:05.240386+0000","last_peered":"2024-09-12T18:15:05.240386+0000","last_clean":"2024-09-12T18:15:05.240386+0000","last_became_active":"2024-09-12T18:14:50.149911+0000","last_became_peered":"2024-09-12T18:14:50.149911+0000","last_unstale":"2024-09-12T18:15:05.240386+0000","last_undegraded":"2024-09-12T18:15:05.240386+0000","last_fullsized":"2024-09-12T18:15:05.240386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:41.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.238325+0000","last_change":"2024-09-12T18:14:50.152272+0000","last_active":"2024-09-12T18:15:05.238325+0000","last_peered":"2024-09-12T18:15:05.238325+0000","last_clean":"2024-09-12T18:15:05.238325+0000","last_became_active":"2024-09-12T18:14:50.149458+0000","last_became_peered":"2024-09-12T18:14:50.149458+0000","last_unstale":"2024-09-12T18:15:05.238325+0000","last_undegraded":"2024-09-12T18:15:05.238325+0000","last_fullsized":"2024-09-12T18:15:05.238325+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:21.551945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":54,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-12T18:15:05.240070+0000","last_change":"2024-09-12T18:14:29.006685+0000","last_active":"2024-09-12T18:15:05.240070+0000","last_peered":"2024-09-12T18:15:05.240070+0000","last_clean":"2024-09-12T18:13:23.412529+0000","last_became_active":"2024-09-12T18:14:29.006685+0000","last_became_peered":"2024-09-12T18:14:29.006685+0000","last_unstale":"2024-09-12T18:15:05.240070+0000","last_undegraded":"2024-09-12T18:14:28.985391+0000","last_fullsized":"2024-09-12T18:14:28.985309+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:58.770044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":43,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.236581+0000","last_change":"2024-09-12T18:14:28.986499+0000","last_active":"2024-09-12T18:15:05.236581+0000","last_peered":"2024-09-12T18:15:05.236581+0000","last_clean":"2024-09-12T18:13:22.369601+0000","last_became_active":"2024-09-12T18:14:28.986499+0000","last_became_peered":"2024-09-12T18:14:28.986499+0000","last_unstale":"2024-09-12T18:15:05.236581+0000","last_undegraded":"2024-09-12T18:15:05.236581+0000","last_fullsized":"2024-09-12T18:14:28.982656+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:06.535112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":103,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-12T18:15:05.240343+0000","last_change":"2024-09-12T18:14:29.001920+0000","last_active":"2024-09-12T18:15:05.240343+0000","last_peered":"2024-09-12T18:15:05.240343+0000","last_clean":"2024-09-12T18:14:26.966241+0000","last_became_active":"2024-09-12T18:14:29.001920+0000","last_became_peered":"2024-09-12T18:14:29.001920+0000","last_unstale":"2024-09-12T18:15:05.240343+0000","last_undegraded":"2024-09-12T18:15:05.240343+0000","last_fullsized":"2024-09-12T18:14:28.984447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:15.033970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:15:05.233525+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:15:05.233525+0000","last_peered":"2024-09-12T18:15:05.233525+0000","last_clean":"2024-09-12T18:15:05.233525+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:15:05.233525+0000","last_undegraded":"2024-09-12T18:15:05.233525+0000","last_fullsized":"2024-09-12T18:15:05.233525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":108,"reported_epoch":61,"state":"active+clean+remapped","last_fresh":"2024-09-12T18:15:05.238009+0000","last_change":"2024-09-12T18:14:50.184231+0000","last_active":"2024-09-12T18:15:05.238009+0000","last_peered":"2024-09-12T18:15:05.238009+0000","last_clean":"2024-09-12T18:15:05.238009+0000","last_became_active":"2024-09-12T18:14:50.182469+0000","last_became_peered":"2024-09-12T18:14:50.182469+0000","last_unstale":"2024-09-12T18:15:05.238009+0000","last_undegraded":"2024-09-12T18:15:05.238009+0000","last_fullsized":"2024-09-12T18:15:05.238009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:25.972741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":5370150936,"num_objects":81943,"num_object_clones":0,"num_object_copies":163886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":44409,"num_objects_misplaced":25638,"num_objects_unfound":0,"num_objects_dirty":81943,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188271,"num_write_kb":8646785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2203,"num_bytes_recovered":144113664,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":733171712,"data_stored":11730681880,"data_compressed":10077570,"data_compressed_allocated":733167616,"data_compressed_original":11730681856,"omap_allocated":0,"internal_metadata":0},"log_size":50717,"ondisk_log_size":50717,"up":20,"acting":23,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":7,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":38,"acting":51,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":21223,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":1,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738394,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426992,"kb_used_data":207004,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93944848,"statfs":{"total":96636764160,"available":96199524352,"internally_reserved":0,"allocated":211972096,"data_stored":3380217164,"data_compressed":2916211,"data_compressed_allocated":211247104,"data_compressed_original":3379937280,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738394,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563748,"kb_used_data":275696,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93808092,"statfs":{"total":96636764160,"available":96059486208,"internally_reserved":0,"allocated":282312704,"data_stored":4506129616,"data_compressed":3886724,"data_compressed_allocated":281616384,"data_compressed_original":4505862144,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348268,"kb_used_data":236568,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94023572,"statfs":{"total":96636764160,"available":96280137728,"internally_reserved":0,"allocated":242245632,"data_stored":3868490993,"data_compressed":3313892,"data_compressed_allocated":241770496,"data_compressed_original":3868311552,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":243748864,"data_stored":3899981824,"data_compressed":3335136,"data_compressed_allocated":243748864,"data_compressed_original":3899981824,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":279982080,"data_stored":4479713280,"data_compressed":3857271,"data_compressed_allocated":279982080,"data_compressed_original":4479713280,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":209440768,"data_stored":3350986776,"data_compressed":2885163,"data_compressed_allocated":209436672,"data_compressed_original":3350986752,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:15:11.068 INFO:tasks.thrashosds.thrasher:Setting 3.17 to [1, 2] 2024-09-12T18:15:11.068 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.17', '1', '2'] 2024-09-12T18:15:11.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.17 1 2 2024-09-12T18:15:11.132 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.128+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:11.182 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:11.182 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202318 5.3 e62/53 5:c8cf31c5:::benchmark_data_smithi062_23645_object67209:head v 62'12790, mlcod=62'12788)", 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.176119+0000", 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0065667929999999996, 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0065883729999999998, 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176119+0000", 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176119+0000", 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176120+0000", 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176125+0000", 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.519e-06 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176134+0000", 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7169999999999997e-06 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176140+0000", 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176203+0000", 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3075000000000002e-05 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176216+0000", 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3077e-05 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.186 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202319 5.5 e62/21 5:ab257af3:::benchmark_data_smithi062_23645_object67210:head v 62'12820, mlcod=62'12818)", 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.176399+0000", 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0062865109999999998, 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0063500120000000004, 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176399+0000", 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176399+0000", 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176400+0000", 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:15:11.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176404+0000", 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176415+0000", 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0518e-05 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176421+0000", 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0440000000000001e-06 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176456+0000", 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5401999999999997e-05 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176468+0000", 2024-09-12T18:15:11.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.182e-05 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:202323 5.f 5:f505cbb7:::benchmark_data_smithi062_23645_object67214:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.176616+0000", 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0060700399999999996, 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0061778349999999996, 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.191 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 202323 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176616+0000", 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176616+0000", 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176617+0000", 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9800000000000002e-07 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176620+0000", 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6349999999999999e-06 2024-09-12T18:15:11.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176631+0000", 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0496000000000001e-05 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176638+0000", 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4329999999999998e-06 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.194 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176693+0000", 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4786e-05 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176825+0000", 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013182600000000001 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.176953+0000", 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012779999999999999 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180675+0000", 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0037218889999999999 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202324 5.6 e62/53 5:61d5704e:::benchmark_data_smithi062_23645_object67215:head v 62'12583, mlcod=62'12580)", 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.178611+0000", 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004075146, 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042256960000000001, 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.196 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178611+0000", 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178611+0000", 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178611+0000", 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9000000000000002e-07 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178615+0000", 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5499999999999996e-06 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178625+0000", 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4159999999999993e-06 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178630+0000", 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2100000000000001e-06 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178676+0000", 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5552e-05 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178696+0000", 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0270000000000001e-05 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202325 5.c e62/53 5:325ec5bb:::benchmark_data_smithi062_23645_object67216:head v 62'12469, mlcod=62'12467)", 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.178652+0000", 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0040334890000000003, 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042191390000000002, 2024-09-12T18:15:11.200 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178652+0000", 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178652+0000", 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178652+0000", 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6299999999999999e-07 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178654+0000", 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.03e-06 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178657+0000", 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.0690000000000002e-06 2024-09-12T18:15:11.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178660+0000", 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5840000000000002e-06 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178701+0000", 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0664999999999998e-05 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.178715+0000", 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4082e-05 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202326 5.2 e62/49 5:4d4b6bf6:::benchmark_data_smithi062_23645_object67217:head v 62'12679, mlcod=62'12677)", 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.179192+0000", 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0034941579999999998, 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0037350679999999998, 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.204 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179192+0000", 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179192+0000", 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179192+0000", 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179198+0000", 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.716e-06 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179212+0000", 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3484e-05 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179219+0000", 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4449999999999999e-06 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179267+0000", 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8355e-05 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.179280+0000", 2024-09-12T18:15:11.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2679e-05 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:202332 5.7 5:eb74df5c:::benchmark_data_smithi062_23645_object67223:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.180542+0000", 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002143603, 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024404359999999998, 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:11.208 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 202332 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180542+0000", 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180542+0000", 2024-09-12T18:15:11.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180543+0000", 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.28e-06 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180548+0000", 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5900000000000001e-06 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.210 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180562+0000", 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4105e-05 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180571+0000", 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.67e-06 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.211 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180621+0000", 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0643999999999998e-05 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180703+0000", 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1973999999999998e-05 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180769+0000", 2024-09-12T18:15:11.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5419000000000005e-05 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202329 5.3 e62/53 5:c0e8e8fb:::benchmark_data_smithi062_23645_object67220:head v 62'12791, mlcod=62'12788)", 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.180768+0000", 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0019177599999999999, 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022867999999999999, 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.213 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180768+0000", 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180768+0000", 2024-09-12T18:15:11.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180769+0000", 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180782+0000", 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2978e-05 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180798+0000", 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6401000000000001e-05 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180805+0000", 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9070000000000001e-06 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180862+0000", 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7433999999999999e-05 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180883+0000", 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0177e-05 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:202328 5.2 e62/49 5:4578a100:::benchmark_data_smithi062_23645_object67219:head v 62'12680, mlcod=62'12677)", 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.180826+0000", 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0018598340000000001, 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002284463, 2024-09-12T18:15:11.217 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180826+0000", 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180826+0000", 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180826+0000", 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2e-07 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180830+0000", 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8419999999999998e-06 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180837+0000", 2024-09-12T18:15:11.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2660000000000004e-06 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180843+0000", 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1950000000000002e-06 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180883+0000", 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0224e-05 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.180894+0000", 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1418e-05 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:202335 5.f 5:fd3c88fb:::benchmark_data_smithi062_23645_object67226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.181778+0000", 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00090785099999999999, 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0013621079999999999, 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.221 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 202335 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181778+0000", 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181778+0000", 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181778+0000", 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5300000000000004e-07 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181782+0000", 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.411e-06 2024-09-12T18:15:11.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181792+0000", 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9399999999999997e-06 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181800+0000", 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4479999999999994e-06 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181844+0000", 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4027999999999999e-05 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.181959+0000", 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000114974 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182078+0000", 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000118563 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.225 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:202336 5.f 5.3f9e401f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.182103+0000", 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00058253500000000002, 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011310479999999999, 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:11.226 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 202336 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182103+0000", 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182103+0000", 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182104+0000", 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.16e-07 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182109+0000", 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6179999999999997e-06 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.228 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182116+0000", 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4889999999999998e-06 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182121+0000", 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9010000000000002e-06 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:202337 5.7 5.32515957 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:11.229 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.182281+0000", 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00040485400000000001, 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001018698, 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 202337 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182281+0000", 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182281+0000", 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182281+0000", 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.34e-07 2024-09-12T18:15:11.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182284+0000", 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4899999999999999e-06 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182291+0000", 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7209999999999994e-06 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.182295+0000", 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8600000000000003e-06 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:202339 5.d 5:b13c0901:::benchmark_data_smithi062_23645_object67230:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:11.183126+0000", 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9995594, 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00023462, 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:11.233 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 202339 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183126+0000", 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183126+0000", 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183127+0000", 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7000000000000004e-07 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183130+0000", 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.382e-06 2024-09-12T18:15:11.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183139+0000", 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3890000000000005e-06 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183144+0000", 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2009999999999998e-06 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183196+0000", 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2271999999999997e-05 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:11.183306+0000", 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000110226 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 13 2024-09-12T18:15:11.237 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:11.239 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:11.239 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.236+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.267 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:15:11.293 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:11.313 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:11.340 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:11.334+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:11.345 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:11.345 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:11.349 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:11.349 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:11.431 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:11.431 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:11.440 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.436+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.453 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:11.544 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.540+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.643 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.640+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.651 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:11.651 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:11.672 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:11.744 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.740+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.825 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:11.825 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:11.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:11.846 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.840+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.947 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:11.944+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:11.997 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:11.997 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:12.017 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:12.061 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.058+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.148 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:12.144+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:12.170 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:12.170 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:12.188 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:12.250 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:12.244+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:12.277 INFO:teuthology.orchestra.run.smithi062.stderr:set 3.17 pg_upmap mapping to [1,2] 2024-09-12T18:15:12.342 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:12.342 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:12.350 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.346+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:12.451 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.446+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.549 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:12.549 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:12.552 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.546+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:12.654 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.650+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.717 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:12.717 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:12.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:12.786 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.782+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.855 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.850+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:12.902 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:12.902 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:12.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:12.965 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:12.962+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:13.057 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:13.054+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:13.114 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:13.114 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:13.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:13.160 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:13.156+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:13.259 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:13.256+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:13.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:15:13.334 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:13.334 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:13.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:13.353 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:13.360 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:13.354+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:13.463 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:13.460+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:13.486 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:13.505 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:13.505 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:13.509 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:13.509 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:13.523 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:13.524 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:13.526 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:13.527 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:13.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:13.562 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:13.558+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:13.663 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:13.660+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:13.725 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:13.725 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:13.725 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:13.725 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:13.725 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:13.745 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:13.787 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:13.784+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:13.865 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:13.860+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 121.649466143, 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:13.945 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.946 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:13.947 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.948 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:13.949 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:13.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.952 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 110.54916871499999, 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:13.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:13.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.958 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 110.549105665, 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:13.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:13.964 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 110.548167089, 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.966 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:13.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 110.547513378, 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:13.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:13.975 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 46.688348230999999, 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:13.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 46.680325854000003, 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.982 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:13.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:13.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 46.668740567999997, 2024-09-12T18:15:13.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:13.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:13.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:13.994 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 16.781388583999998, 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:13.995 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:13.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:13.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:14.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 16.776414615, 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.003 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:14.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:14.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.007 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:14.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 16.775945686, 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.011 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:14.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:14.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:14.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.017 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 16.773904362, 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:14.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.022 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 16.772996592999998, 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:14.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:14.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 16.77256839, 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.1120382430000006, 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.033 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:14.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.039 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.1097936219999998, 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.040 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.041 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.041 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:14.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.041 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:14.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:14.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:14.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:14.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:14.047 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.1072603809999997, 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:14.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.049 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:14.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:14.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:14.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:14.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:14.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.1068023910000004, 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.055 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:14.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:14.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:14.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.061 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.8823049090000001, 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:14.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:14.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:14.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.8822713790000005, 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:14.071 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:14.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:14.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:14.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:14.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:14.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:14.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:14.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:14.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:14.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:14.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:14.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:14.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:14.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:14.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:14.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:14.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:14.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:14.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:14.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:14.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:14.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:14.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:14.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:14.083 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.083 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.083 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.083 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:14.083 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:14.084 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:14.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:14.086 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:14.078+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:14.188 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:14.184+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:14.250 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:14.250 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:14.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.250 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209678 5.6 5:61cc61ab:::benchmark_data_smithi062_23645_object74569:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.251 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.242693+0000", 2024-09-12T18:15:14.251 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0059435290000000003, 2024-09-12T18:15:14.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059671259999999997, 2024-09-12T18:15:14.251 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.251 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.251 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:14.252 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.252 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.252 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.252 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209678 2024-09-12T18:15:14.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.252 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242693+0000", 2024-09-12T18:15:14.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242693+0000", 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242693+0000", 2024-09-12T18:15:14.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.32e-07 2024-09-12T18:15:14.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242696+0000", 2024-09-12T18:15:14.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7810000000000001e-06 2024-09-12T18:15:14.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242704+0000", 2024-09-12T18:15:14.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6850000000000001e-06 2024-09-12T18:15:14.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242709+0000", 2024-09-12T18:15:14.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0220000000000004e-06 2024-09-12T18:15:14.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242745+0000", 2024-09-12T18:15:14.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6291999999999997e-05 2024-09-12T18:15:14.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242853+0000", 2024-09-12T18:15:14.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107363 2024-09-12T18:15:14.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242950+0000", 2024-09-12T18:15:14.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7804000000000001e-05 2024-09-12T18:15:14.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.246894+0000", 2024-09-12T18:15:14.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039439619999999996 2024-09-12T18:15:14.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248627+0000", 2024-09-12T18:15:14.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001732915 2024-09-12T18:15:14.262 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.262 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.262 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.263 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209679 5.a 5:5a9f1f2b:::benchmark_data_smithi062_23645_object74570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.263 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.243724+0000", 2024-09-12T18:15:14.263 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.004912217, 2024-09-12T18:15:14.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050147220000000001, 2024-09-12T18:15:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209679 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243724+0000", 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243724+0000", 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243725+0000", 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243730+0000", 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3699999999999997e-06 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243739+0000", 2024-09-12T18:15:14.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9639999999999992e-06 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243746+0000", 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.08e-06 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244574+0000", 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00082820500000000004 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244681+0000", 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106566 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209680 5.b 5:dd73777e:::benchmark_data_smithi062_23645_object74571:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.269 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.243966+0000", 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.004671021, 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048293800000000003, 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209680 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.270 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243966+0000", 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243966+0000", 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243966+0000", 2024-09-12T18:15:14.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243970+0000", 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.27e-06 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243979+0000", 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243988+0000", 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6419999999999996e-06 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244403+0000", 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415764 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.246589+0000", 2024-09-12T18:15:14.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021855640000000001 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209681 5.b 5:d50e644c:::benchmark_data_smithi062_23645_object74572:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.244111+0000", 2024-09-12T18:15:14.274 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0045259899999999997, 2024-09-12T18:15:14.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047374410000000002, 2024-09-12T18:15:14.275 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.275 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.275 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:14.275 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.275 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.276 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.276 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209681 2024-09-12T18:15:14.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.276 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244111+0000", 2024-09-12T18:15:14.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244111+0000", 2024-09-12T18:15:14.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244111+0000", 2024-09-12T18:15:14.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6899999999999997e-07 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244114+0000", 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8210000000000002e-06 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244122+0000", 2024-09-12T18:15:14.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7870000000000002e-06 2024-09-12T18:15:14.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244127+0000", 2024-09-12T18:15:14.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:14.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248056+0000", 2024-09-12T18:15:14.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039288040000000002 2024-09-12T18:15:14.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248154+0000", 2024-09-12T18:15:14.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-09-12T18:15:14.283 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.283 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.283 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.284 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209682 5.6 5:69fca97f:::benchmark_data_smithi062_23645_object74573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.284 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.245073+0000", 2024-09-12T18:15:14.284 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003563283, 2024-09-12T18:15:14.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038296900000000002, 2024-09-12T18:15:14.284 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.284 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.285 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:14.285 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.285 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.285 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.285 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209682 2024-09-12T18:15:14.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.286 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245073+0000", 2024-09-12T18:15:14.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245073+0000", 2024-09-12T18:15:14.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245074+0000", 2024-09-12T18:15:14.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.64e-07 2024-09-12T18:15:14.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245078+0000", 2024-09-12T18:15:14.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1400000000000002e-06 2024-09-12T18:15:14.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245089+0000", 2024-09-12T18:15:14.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0156999999999999e-05 2024-09-12T18:15:14.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245095+0000", 2024-09-12T18:15:14.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:14.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245143+0000", 2024-09-12T18:15:14.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8265e-05 2024-09-12T18:15:14.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245269+0000", 2024-09-12T18:15:14.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125718 2024-09-12T18:15:14.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245367+0000", 2024-09-12T18:15:14.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7744999999999993e-05 2024-09-12T18:15:14.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.247160+0000", 2024-09-12T18:15:14.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001793544 2024-09-12T18:15:14.294 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.294 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.295 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.295 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:209683 5.9 e65/53 5:962f13e4:::benchmark_data_smithi062_23645_object74574:head v 65'13078, mlcod=65'13075)", 2024-09-12T18:15:14.295 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.245981+0000", 2024-09-12T18:15:14.295 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0026560640000000001, 2024-09-12T18:15:14.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002984422, 2024-09-12T18:15:14.296 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.296 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.296 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.296 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245981+0000", 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245981+0000", 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245981+0000", 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245985+0000", 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9090000000000002e-06 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245992+0000", 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4359999999999996e-06 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245998+0000", 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2039999999999996e-06 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.246622+0000", 2024-09-12T18:15:14.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00062468400000000002 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.246640+0000", 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7564999999999999e-05 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248471+0000", 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018314290000000001 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209685 5.8 5:175e3a9b:::benchmark_data_smithi062_23645_object74576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.302 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248093+0000", 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000544062, 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092518400000000001, 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.303 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209685 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248093+0000", 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248093+0000", 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248094+0000", 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0419999999999999e-06 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248098+0000", 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2169999999999996e-06 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248106+0000", 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5120000000000008e-06 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248111+0000", 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8269999999999997e-06 2024-09-12T18:15:14.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248218+0000", 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010643500000000001 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248357+0000", 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139577 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209686 5.8 5.977d1998 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.309 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248136+0000", 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00050035300000000004, 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093453199999999996, 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.310 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209686 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248136+0000", 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248136+0000", 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248137+0000", 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248139+0000", 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.03e-06 2024-09-12T18:15:14.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248146+0000", 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1269999999999997e-06 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248153+0000", 2024-09-12T18:15:14.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6449999999999999e-06 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209689 5.5 5:a0e593c8:::benchmark_data_smithi062_23645_object74580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248325+0000", 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00031119299999999997, 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078991200000000004, 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:14.314 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209689 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248325+0000", 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248325+0000", 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248326+0000", 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4200000000000005e-07 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248330+0000", 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0670000000000002e-06 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248340+0000", 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248348+0000", 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9780000000000005e-06 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248410+0000", 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2031000000000003e-05 2024-09-12T18:15:14.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248520+0000", 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110877 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248603+0000", 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2442999999999997e-05 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209690 5.b 5.ade87c0b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248366+0000", 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00027048399999999998, 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00080470200000000002, 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209690 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248366+0000", 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248366+0000", 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248367+0000", 2024-09-12T18:15:14.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1099999999999996e-07 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248369+0000", 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1619999999999998e-06 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248376+0000", 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5179999999999998e-06 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248381+0000", 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8359999999999999e-06 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209691 5.1 5:898ddd06:::benchmark_data_smithi062_23645_object74582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248424+0000", 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000212967, 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079166100000000004, 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.323 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209691 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248424+0000", 2024-09-12T18:15:14.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248424+0000", 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248424+0000", 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3900000000000004e-07 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248427+0000", 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.914e-06 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248435+0000", 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3989999999999998e-06 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248440+0000", 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0599999999999998e-06 2024-09-12T18:15:14.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248481+0000", 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1303000000000001e-05 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248597+0000", 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116039 2024-09-12T18:15:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248706+0000", 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010856700000000001 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:209677 5.3 e65/53 ondisk, result = 0)", 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248583+0000", 2024-09-12T18:15:14.328 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.3866000000000002e-05, 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068696999999999996, 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248583+0000", 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248583+0000", 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248583+0000", 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5100000000000001e-07 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248585+0000", 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0109999999999999e-06 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248591+0000", 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9900000000000002e-06 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248596+0000", 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2469999999999999e-06 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.249236+0000", 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063931399999999998 2024-09-12T18:15:14.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.249240+0000", 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9269999999999998e-06 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:209687 5.f e65/53 5:f9128c38:::benchmark_data_smithi062_23645_object74578:head v 65'13270, mlcod=65'13267)", 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.248604+0000", 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.3056000000000003e-05, 2024-09-12T18:15:14.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071370299999999999, 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248604+0000", 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248604+0000", 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248604+0000", 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6600000000000003e-07 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248607+0000", 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6229999999999999e-06 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248625+0000", 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8062000000000001e-05 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248630+0000", 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7720000000000002e-06 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248698+0000", 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7854999999999993e-05 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248728+0000", 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9638999999999999e-05 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209672 5.1 5:830e27fd:::benchmark_data_smithi062_23645_object74563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.242087+0000", 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0065499140000000004, 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072800390000000003, 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.336 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209672 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242087+0000", 2024-09-12T18:15:14.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242087+0000", 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242087+0000", 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9299999999999997e-07 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242091+0000", 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2049999999999998e-06 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242098+0000", 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2860000000000002e-06 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242102+0000", 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5379999999999996e-06 2024-09-12T18:15:14.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.243980+0000", 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018777500000000001 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244087+0000", 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010639100000000001 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.244184+0000", 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7938999999999999e-05 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.248352+0000", 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041670889999999997 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:209674 5.2 5:4ab60734:::benchmark_data_smithi062_23645_object74565:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T18:15:14.341 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:14.242451+0000", 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0061859189999999998, 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069830359999999998, 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 209674 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242451+0000", 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242451+0000", 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242451+0000", 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9500000000000002e-07 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242454+0000", 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-06 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242461+0000", 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242467+0000", 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5480000000000001e-06 2024-09-12T18:15:14.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242511+0000", 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3778e-05 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242592+0000", 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1755999999999994e-05 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.242723+0000", 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013055400000000001 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.245573+0000", 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028497639999999999 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:14.246457+0000", 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088419200000000001 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.346 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.347 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.347 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:14.347 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 15 2024-09-12T18:15:14.347 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:15:14.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:14.349 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:14.342+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:14.448 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:14.444+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:14.549 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:14.544+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:14.552 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:14.552 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:14.552 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:14.552 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:14.552 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:14.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:14.650 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:14.646+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:14.737 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.619219118, 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.605818011, 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.599244329000001, 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.599132414, 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.593243468000001, 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.591633866999999, 2024-09-12T18:15:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.570306166000002, 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186998 5.5 5:abc1ca4a:::benchmark_data_smithi062_23645_object51889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9050266770000004, 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068453476999999999, 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186998 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830447+0000", 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830451+0000", 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830462+0000", 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0825000000000001e-05 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830473+0000", 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830518+0000", 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4987000000000001e-05 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830623+0000", 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010490899999999999 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830685+0000", 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1198999999999995e-05 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898706+0000", 2024-09-12T18:15:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068020924999999996 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898763+0000", 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7914999999999997e-05 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898857+0000", 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3558000000000001e-05 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898899+0000", 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.21e-05 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186999 5.5 5:a5be6d45:::benchmark_data_smithi062_23645_object51890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9049173960000001, 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068700116000000006, 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186999 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830556+0000", 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830558+0000", 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-09-12T18:15:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830567+0000", 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830572+0000", 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.271e-06 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832086+0000", 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015141309999999999 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832189+0000", 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010328299999999999 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832299+0000", 2024-09-12T18:15:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109885 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898720+0000", 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066420542999999999 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899137+0000", 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041740499999999998 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899203+0000", 2024-09-12T18:15:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5494999999999995e-05 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899255+0000", 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2405999999999999e-05 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187000 5.5 5:ad951543:::benchmark_data_smithi062_23645_object51891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9048100669999997, 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068743992000000004, 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187000 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830663+0000", 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830666+0000", 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9050000000000001e-06 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830677+0000", 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0988000000000001e-05 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830682+0000", 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833659+0000", 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029767460000000002 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833755+0000", 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5978999999999997e-05 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833872+0000", 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116779 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898726+0000", 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064854262999999995 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899306+0000", 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057974299999999997 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899362+0000", 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6567999999999998e-05 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899406+0000", 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4081e-05 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187004 5.3 5:c7ad184c:::benchmark_data_smithi062_23645_object51895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9038885319999999, 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067576516000000003, 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187004 2024-09-12T18:15:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831587+0000", 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0000000000000001e-06 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831597+0000", 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3919999999999992e-06 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831601+0000", 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.211e-06 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832123+0000", 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052220999999999995 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832228+0000", 2024-09-12T18:15:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104901 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832332+0000", 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104298 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834361+0000", 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020281549999999998 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898978+0000", 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064617544999999998 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899052+0000", 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4402999999999999e-05 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899160+0000", 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010777600000000001 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187006 5.5 5:ab27be23:::benchmark_data_smithi062_23645_object51897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9028564180000007, 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070397003999999999, 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187006 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832617+0000", 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832620+0000", 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999999e-06 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832630+0000", 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2529999999999993e-06 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832637+0000", 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.866e-06 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835192+0000", 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025558999999999998 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835290+0000", 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7355000000000006e-05 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835381+0000", 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1231999999999997e-05 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899455+0000", 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064073781999999996 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902827+0000", 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003372103 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902954+0000", 2024-09-12T18:15:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012695 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903013+0000", 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8956999999999998e-05 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187002 5.f e60/53 5:f316353f:::benchmark_data_smithi062_23645_object51893:head v 60'11800, mlcod=60'11795)", 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9015350709999996, 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067384802999999993, 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833938+0000", 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9200000000000002e-07 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833958+0000", 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833964+0000", 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8480000000000003e-06 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833969+0000", 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5009999999999998e-06 2024-09-12T18:15:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834034+0000", 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4665999999999994e-05 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834053+0000", 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9221000000000001e-05 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901272+0000", 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067219152000000004 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901322+0000", 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.011e-05 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187008 5.0 5:09c03dc0:::benchmark_data_smithi062_23645_object51899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.901474919, 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067136113999999997, 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187008 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833998+0000", 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834002+0000", 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834028+0000", 2024-09-12T18:15:14.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5894e-05 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834037+0000", 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834094+0000", 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6916000000000002e-05 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834215+0000", 2024-09-12T18:15:14.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121709 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.900976+0000", 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066761176000000005 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901041+0000", 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4304e-05 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901133+0000", 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.268e-05 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187011 5.6 5:6422621a:::benchmark_data_smithi062_23645_object51902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9009246730000005, 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067142944999999996, 2024-09-12T18:15:14.819 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187011 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834553+0000", 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834562+0000", 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834570+0000", 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834630+0000", 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9957000000000002e-05 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834731+0000", 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100751 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834834+0000", 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010338199999999999 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899126+0000", 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064291736000000002 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901333+0000", 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022070890000000002 2024-09-12T18:15:14.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901538+0000", 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020443600000000001 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901691+0000", 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152817 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187014 5.2 5:45b0919f:::benchmark_data_smithi062_23645_object51905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8996032300000003, 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067748596999999994, 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187014 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835870+0000", 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.285e-06 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835883+0000", 2024-09-12T18:15:14.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2276000000000001e-05 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835893+0000", 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835900+0000", 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835956+0000", 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6276000000000001e-05 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898671+0000", 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.062715530000000005 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898855+0000", 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183284 2024-09-12T18:15:14.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903145+0000", 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042906580000000001 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903556+0000", 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041042800000000001 2024-09-12T18:15:14.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903590+0000", 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4440000000000002e-05 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903618+0000", 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7521999999999998e-05 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6811670129999996, 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070729645999999993, 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.833 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124936+0000", 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064320978000000001 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124991+0000", 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5550999999999997e-05 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125035+0000", 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3859999999999997e-05 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6747152839999995, 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068614100999999997, 2024-09-12T18:15:14.839 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:14.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:14.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126682+0000", 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.065744891 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129287+0000", 2024-09-12T18:15:14.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026049409999999999 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129333+0000", 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016999999999997e-05 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129371+0000", 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7796000000000002e-05 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5:4781a562:::benchmark_data_smithi062_23645_object52283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6746713179999997, 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.073009940999999995, 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124774+0000", 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.063958509999999996 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124908+0000", 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013461199999999999 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125013+0000", 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104153 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129380+0000", 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043676100000000001 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133738+0000", 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043580950000000002 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133769+0000", 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1032999999999999e-05 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133811+0000", 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187395 5.a 5:58aaa639:::benchmark_data_smithi062_23645_object52286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6740935910000001, 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068114076999999995, 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187395 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061383+0000", 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.72e-06 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122886+0000", 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.061503331000000001 2024-09-12T18:15:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122905+0000", 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029e-05 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126609+0000", 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037042030000000001 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126714+0000", 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010544600000000001 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129385+0000", 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026710869999999999 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129433+0000", 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7567e-05 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129493+0000", 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.995e-05 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:14.857 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:14.859 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:14.859 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:14.856+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:14.959 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:14.956+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:15.020 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211565 5.d 5:b1503dd0:::benchmark_data_smithi062_23645_object76456:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.015572+0000", 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0035968390000000001, 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0036144879999999999, 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.021 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211565 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015572+0000", 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015572+0000", 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015573+0000", 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3499999999999996e-07 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015576+0000", 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.83e-06 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015583+0000", 2024-09-12T18:15:15.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3270000000000003e-06 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015587+0000", 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2889999999999999e-06 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015623+0000", 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5272999999999999e-05 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015709+0000", 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6057000000000006e-05 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:211564 5.1 e66/49 5:8b7cf3d4:::benchmark_data_smithi062_23645_object76455:head v 66'13233, mlcod=66'13230)", 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.015960+0000", 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0032090450000000002, 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003266232, 2024-09-12T18:15:15.025 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015960+0000", 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015960+0000", 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015961+0000", 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0200000000000002e-07 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015965+0000", 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:15.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015975+0000", 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0198e-05 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.015981+0000", 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.874e-06 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016172+0000", 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019047700000000001 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016195+0000", 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3655e-05 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211566 5.7 5:ef5f31d6:::benchmark_data_smithi062_23645_object76457:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.029 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.016783+0000", 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002385804, 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024733350000000001, 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211566 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016783+0000", 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016783+0000", 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016784+0000", 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.06e-06 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016789+0000", 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1230000000000002e-06 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016801+0000", 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2489e-05 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016811+0000", 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016889+0000", 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8875999999999995e-05 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017044+0000", 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015467000000000001 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017165+0000", 2024-09-12T18:15:15.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120845 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211570 5.d 5:b7c0b202:::benchmark_data_smithi062_23645_object76461:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.016857+0000", 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0023126100000000001, 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0024353220000000002, 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:15.034 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211570 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016857+0000", 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016857+0000", 2024-09-12T18:15:15.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016857+0000", 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0100000000000005e-07 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016860+0000", 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8930000000000001e-06 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016868+0000", 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.7989999999999994e-06 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016873+0000", 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2390000000000002e-06 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017788+0000", 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00091485700000000004 2024-09-12T18:15:15.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017862+0000", 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4027000000000001e-05 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:211567 5.3 e66/53 5:c1f4c5bb:::benchmark_data_smithi062_23645_object76458:head v 66'13385, mlcod=66'13381)", 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.017287+0000", 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001882664, 2024-09-12T18:15:15.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002054602, 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017287+0000", 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017287+0000", 2024-09-12T18:15:15.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017287+0000", 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2900000000000004e-07 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017294+0000", 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017304+0000", 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8900000000000002e-06 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017310+0000", 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7189999999999998e-06 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017810+0000", 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00050031399999999997 2024-09-12T18:15:15.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.017839+0000", 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9335e-05 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:211569 5.c e66/53 5:3e987fe5:::benchmark_data_smithi062_23645_object76460:head v 66'13057, mlcod=66'13054)", 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.019008+0000", 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00016165900000000001, 2024-09-12T18:15:15.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038660700000000002, 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019008+0000", 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019008+0000", 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019008+0000", 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019014+0000", 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2989999999999996e-06 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019023+0000", 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9819999999999997e-06 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019029+0000", 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.071e-06 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019072+0000", 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3911e-05 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019091+0000", 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8828e-05 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211571 5.9 5.3b74d8f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.019053+0000", 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000115993, 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00039317699999999998, 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.046 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211571 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019053+0000", 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019053+0000", 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019054+0000", 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0800000000000004e-07 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019060+0000", 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.139e-06 2024-09-12T18:15:15.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019068+0000", 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.019074+0000", 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6280000000000002e-06 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211537 5.9 5:9ed15451:::benchmark_data_smithi062_23645_object76428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.006083+0000", 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.013086125000000001, 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.013408178, 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211537 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.050 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006083+0000", 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006083+0000", 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006083+0000", 2024-09-12T18:15:15.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2399999999999999e-07 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006086+0000", 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8770000000000002e-06 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006093+0000", 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0740000000000004e-06 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006099+0000", 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.327e-06 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006137+0000", 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.8695000000000001e-05 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006241+0000", 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010327600000000001 2024-09-12T18:15:15.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.006315+0000", 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3795999999999996e-05 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.011301+0000", 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0049861849999999997 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:211552 5.1 e66/49 5:8d05934c:::benchmark_data_smithi062_23645_object76443:head v 66'13232, mlcod=66'13230)", 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.012688+0000", 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0064810120000000004, 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0068562129999999999, 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012688+0000", 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012688+0000", 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012689+0000", 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3000000000000001e-07 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012696+0000", 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.542e-06 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012706+0000", 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.4809999999999995e-06 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012711+0000", 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:15.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012748+0000", 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6903999999999998e-05 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.012761+0000", 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3033e-05 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211557 5.9 5:935f763a:::benchmark_data_smithi062_23645_object76448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.014063+0000", 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0051064329999999996, 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0055105220000000003, 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211557 2024-09-12T18:15:15.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014063+0000", 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014063+0000", 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014064+0000", 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.054e-06 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014073+0000", 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9970000000000004e-06 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014085+0000", 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1725999999999999e-05 2024-09-12T18:15:15.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014093+0000", 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.4640000000000006e-06 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016203+0000", 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021103419999999999 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016316+0000", 2024-09-12T18:15:15.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011309799999999999 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.016404+0000", 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7981999999999999e-05 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:211559 5.9 5.c9d43a29 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:15.014324+0000", 2024-09-12T18:15:15.063 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0048446959999999999, 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052862040000000001, 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 211559 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014324+0000", 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014324+0000", 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014325+0000", 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9400000000000004e-07 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014329+0000", 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1670000000000001e-06 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014338+0000", 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1680000000000004e-06 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:15.014345+0000", 2024-09-12T18:15:15.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0190000000000001e-06 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 11 2024-09-12T18:15:15.067 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:15.068 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:15.069 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:15.062+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:15.169 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:15.166+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:15.263 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:15.263 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:15.263 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:15.263 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:15.263 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:15.269 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:15.266+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:15.283 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:15.370 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:15.366+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:15.433 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:15.433 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:15.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:15.434 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:15.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.434 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 123.138263073, 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:15.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:15.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:15.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 112.037965645, 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:15.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 112.03790259500001, 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:15.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:15.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 112.036964019, 2024-09-12T18:15:15.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:15.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:15.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:15.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 112.036310308, 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:15.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:15.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.177145160999999, 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:15.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:15.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:15.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.169122784000002, 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:15.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:15.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.476 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 48.157537498000003, 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:15.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:15.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.482 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.270185514000001, 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.483 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:15.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:15.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.488 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.265211545, 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.264742615999999, 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.262701291999999, 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:15.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:15.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:15.505 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.261793523000001, 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:15.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:15.509 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.261365319999999, 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:15.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:15.514 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.600835173, 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:15.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.520 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.598590551999999, 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.521 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:15.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:15.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:15.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.526 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.596057310999999, 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.527 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:15.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.532 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:15.533 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.595599321, 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.535 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:15.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.539 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.371101839, 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:15.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:15.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 10.371068309, 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.546 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:15.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.548 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.549 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:15.550 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:15.551 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:15.552 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:15.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:15.553 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:15.548+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:15.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:15.653 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:15.650+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:15.697 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:15.711 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:15.711 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:15.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.711 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213272 5.c 5:3c2eef17:::benchmark_data_smithi062_23645_object78163:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.711 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.702014+0000", 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0083384710000000001, 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083636649999999993, 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213272 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702014+0000", 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702014+0000", 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702015+0000", 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:15.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702019+0000", 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8990000000000003e-06 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702027+0000", 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5490000000000006e-06 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702034+0000", 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4400000000000002e-06 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703372+0000", 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013381619999999999 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703525+0000", 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015356300000000001 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703647+0000", 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012210500000000001 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708175+0000", 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045274529999999999 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213274 5.3 5:cea9bd12:::benchmark_data_smithi062_23645_object78165:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.702091+0000", 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0082608869999999997, 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083633389999999991, 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213274 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.717 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702091+0000", 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702091+0000", 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702092+0000", 2024-09-12T18:15:15.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000001e-07 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702094+0000", 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3980000000000002e-06 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702102+0000", 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7440000000000007e-06 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702109+0000", 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.516e-06 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.704994+0000", 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028851829999999999 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705104+0000", 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110142 2024-09-12T18:15:15.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705208+0000", 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103819 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:213260 5.f e66/53 5:fbcc6065:::benchmark_data_smithi062_23645_object78151:head v 66'13496, mlcod=66'13493)", 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.702252+0000", 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0081000389999999999, 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082712089999999999, 2024-09-12T18:15:15.721 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702252+0000", 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702252+0000", 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702253+0000", 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8899999999999999e-07 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702258+0000", 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7999999999999998e-06 2024-09-12T18:15:15.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702268+0000", 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0428000000000001e-05 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702274+0000", 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0329999999999997e-06 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.704442+0000", 2024-09-12T18:15:15.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021679300000000002 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.704461+0000", 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8439000000000001e-05 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:213269 5.7 e66/21 5:e37b344e:::benchmark_data_smithi062_23645_object78160:head v 66'13127, mlcod=66'13124)", 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.702325+0000", 2024-09-12T18:15:15.725 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0080270519999999998, 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082546419999999995, 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702325+0000", 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702325+0000", 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702326+0000", 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8899999999999999e-07 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702330+0000", 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.749e-06 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702339+0000", 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9409999999999996e-06 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.702344+0000", 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3900000000000001e-06 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.704432+0000", 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020884340000000001 2024-09-12T18:15:15.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.704451+0000", 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.895e-05 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213276 5.5 5:a3a85ae4:::benchmark_data_smithi062_23645_object78167:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.703775+0000", 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0065778219999999997, 2024-09-12T18:15:15.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0068594980000000003, 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213276 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703775+0000", 2024-09-12T18:15:15.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703775+0000", 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703775+0000", 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703778+0000", 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8660000000000002e-06 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703794+0000", 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5886e-05 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703801+0000", 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2280000000000001e-06 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703848+0000", 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6730000000000002e-05 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703925+0000", 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6859000000000004e-05 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.704001+0000", 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6533999999999996e-05 2024-09-12T18:15:15.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705358+0000", 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013572650000000001 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213277 5.4 5:247df4e9:::benchmark_data_smithi062_23645_object78168:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.703969+0000", 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0063833029999999999, 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067234510000000001, 2024-09-12T18:15:15.734 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213277 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703969+0000", 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703969+0000", 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703970+0000", 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1500000000000003e-07 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703974+0000", 2024-09-12T18:15:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.194e-06 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703983+0000", 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6300000000000004e-06 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.703989+0000", 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6209999999999998e-06 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705621+0000", 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016318000000000001 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705724+0000", 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010314000000000001 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:213278 5.f e66/53 5:fdfcbb81:::benchmark_data_smithi062_23645_object78169:head v 66'13497, mlcod=66'13493)", 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.705255+0000", 2024-09-12T18:15:15.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050972179999999997, 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005493876, 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705255+0000", 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705255+0000", 2024-09-12T18:15:15.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705256+0000", 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0600000000000001e-07 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705259+0000", 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.755e-06 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705266+0000", 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2469999999999997e-06 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705270+0000", 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2030000000000002e-06 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706243+0000", 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097352599999999995 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706259+0000", 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6030000000000001e-05 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213279 5.3 5:c13ad3d3:::benchmark_data_smithi062_23645_object78170:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.705262+0000", 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0050904569999999996, 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055476429999999997, 2024-09-12T18:15:15.742 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213279 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705262+0000", 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705262+0000", 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705263+0000", 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0599999999999999e-07 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705267+0000", 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3640000000000001e-06 2024-09-12T18:15:15.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705276+0000", 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4610000000000008e-06 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.705282+0000", 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8340000000000001e-06 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706928+0000", 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016454250000000001 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.707035+0000", 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010744200000000001 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.707137+0000", 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101411 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.746 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213281 5.a 5:54275b96:::benchmark_data_smithi062_23645_object78172:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.706301+0000", 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0040510479999999998, 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004568351, 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.747 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213281 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706301+0000", 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706301+0000", 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706302+0000", 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2600000000000001e-07 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706306+0000", 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7230000000000002e-06 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706317+0000", 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1280999999999999e-05 2024-09-12T18:15:15.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706325+0000", 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4200000000000001e-06 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706378+0000", 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3755999999999998e-05 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706487+0000", 2024-09-12T18:15:15.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010844399999999999 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213282 5.c 5:3ed2ef82:::benchmark_data_smithi062_23645_object78173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.706440+0000", 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0039122100000000002, 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044919440000000003, 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.751 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213282 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706440+0000", 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706440+0000", 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706441+0000", 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.003e-06 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706445+0000", 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9639999999999997e-06 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706454+0000", 2024-09-12T18:15:15.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0960000000000007e-06 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706461+0000", 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3559999999999998e-06 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706503+0000", 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2879000000000001e-05 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706628+0000", 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012404000000000001 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706726+0000", 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8807000000000005e-05 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213283 5.0 5:0f58311b:::benchmark_data_smithi062_23645_object78174:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.755 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.706662+0000", 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0036899189999999998, 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043313320000000002, 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213283 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706662+0000", 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706662+0000", 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706663+0000", 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4300000000000002e-07 2024-09-12T18:15:15.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706666+0000", 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.117e-06 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706674+0000", 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1070000000000005e-06 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706680+0000", 2024-09-12T18:15:15.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9669999999999998e-06 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706728+0000", 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7979999999999998e-05 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.706835+0000", 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010707100000000001 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.759 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213285 5.5 5:a20b470c:::benchmark_data_smithi062_23645_object78176:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.708279+0000", 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020738359999999999, 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027623890000000001, 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213285 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708279+0000", 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708279+0000", 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708279+0000", 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4399999999999999e-07 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708283+0000", 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9020000000000001e-06 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708292+0000", 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3019999999999995e-06 2024-09-12T18:15:15.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708298+0000", 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6460000000000004e-06 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708348+0000", 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0157000000000001e-05 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708440+0000", 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1533000000000006e-05 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708521+0000", 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0988000000000005e-05 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:213286 5.e 5:743839b2:::benchmark_data_smithi062_23645_object78177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.708440+0000", 2024-09-12T18:15:15.764 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001911891, 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026586589999999998, 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 213286 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708440+0000", 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708440+0000", 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708441+0000", 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.54e-07 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708445+0000", 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6679999999999999e-06 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708456+0000", 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0730999999999999e-05 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708463+0000", 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5279999999999998e-06 2024-09-12T18:15:15.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708518+0000", 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4811000000000001e-05 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.708661+0000", 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000142865 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:213284 5.f e66/53 5:f58c245d:::benchmark_data_smithi062_23645_object78175:head v 66'13498, mlcod=66'13494)", 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.709968+0000", 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00038471399999999998, 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001195181, 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709968+0000", 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709968+0000", 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709968+0000", 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.51e-07 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709972+0000", 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8469999999999998e-06 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709980+0000", 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0900000000000005e-06 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709985+0000", 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6500000000000004e-06 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710025+0000", 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0472999999999997e-05 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710046+0000", 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0891e-05 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:213287 5.9 e66/53 5:9dd5e382:::benchmark_data_smithi062_23645_object78178:head v 66'13295, mlcod=66'13293)", 2024-09-12T18:15:15.772 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:15.709998+0000", 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00035485699999999998, 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012208709999999999, 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709998+0000", 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709998+0000", 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.709998+0000", 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4299999999999999e-07 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710001+0000", 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9960000000000002e-06 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710007+0000", 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9460000000000003e-06 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710011+0000", 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4499999999999997e-06 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710049+0000", 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7388999999999997e-05 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:15.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:15.710066+0000", 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6886000000000001e-05 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 15 2024-09-12T18:15:15.776 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:15.777 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:15.778 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:15.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:15.779 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:15.774+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:15.780 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:15.780 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:15.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-09-12T18:15:15.879 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:15.876+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:15.980 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:15.976+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:15.983 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:15.983 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:16.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:16.081 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:16.078+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:16.164 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:16.164 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:16.182 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:16.176+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:16.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:16.283 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:16.280+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:16.328 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:16.329 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:16.347 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:16.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:15:16.391 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:16.388+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:16.485 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:16.482+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:16.536 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:16.536 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:16.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:16.598 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:16.596+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:16.688 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:16.684+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:16.707 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:16.707 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:16.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:16.789 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:16.786+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:16.876 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:16.876 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:16.890 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:16.886+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:16.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:16.992 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:16.988+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:17.093 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.090+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.095 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:17.095 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:17.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:17.206 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.202+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.294 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.290+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.304 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T18:15:17.305 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-12T18:15:17.305 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:15:17.305 INFO:teuthology.orchestra.console.smithi129:Power on 2024-09-12T18:15:17.305 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T18:15:17.321 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:17.321 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:17.329 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-09-12T18:15:17.333 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:15:17.339 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:17.395 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.390+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.496 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.490+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.497 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:17.497 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:17.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:17.597 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.594+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.667 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:17.667 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:17.689 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:17.698 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.694+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:17.800 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:17.794+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:17.842 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:17.900 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:17.901 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:17.896+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:17.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:17.940 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:17.940 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:17.958 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:17.958 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:17.962 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:17.963 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:18.002 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:18.000+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:18.063 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:218850 5.9 e67/53 5:9a20f357:::benchmark_data_smithi062_23645_object83741:head v 67'13644, mlcod=67'13639)", 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.057138+0000", 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049417050000000002, 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049619590000000002, 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057138+0000", 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057138+0000", 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057138+0000", 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6300000000000001e-07 2024-09-12T18:15:18.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057141+0000", 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.134e-06 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057146+0000", 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2290000000000002e-06 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057151+0000", 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2570000000000001e-06 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057827+0000", 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067669500000000005 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057847+0000", 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9425000000000001e-05 2024-09-12T18:15:18.067 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218859 5.b 5:d13e43be:::benchmark_data_smithi062_23645_object83750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.057800+0000", 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0042789849999999999, 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043560029999999998, 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.068 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218859 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057800+0000", 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057800+0000", 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057801+0000", 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9500000000000001e-07 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057805+0000", 2024-09-12T18:15:18.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7189999999999999e-06 2024-09-12T18:15:18.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057811+0000", 2024-09-12T18:15:18.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5019999999999998e-06 2024-09-12T18:15:18.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057816+0000", 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3980000000000001e-06 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057854+0000", 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8025999999999998e-05 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057954+0000", 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9876000000000004e-05 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.073 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218860 5.c 5:3cb40c1c:::benchmark_data_smithi062_23645_object83751:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.058368+0000", 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0037112130000000001, 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003845004, 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218860 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058368+0000", 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058368+0000", 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058369+0000", 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0079999999999999e-06 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058374+0000", 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7949999999999998e-06 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058387+0000", 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3156000000000001e-05 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058395+0000", 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3930000000000002e-06 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059483+0000", 2024-09-12T18:15:18.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010882660000000001 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059612+0000", 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012927699999999999 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059685+0000", 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:218854 5.9 e67/53 5:90358497:::benchmark_data_smithi062_23645_object83745:head v 67'13645, mlcod=67'13639)", 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.058576+0000", 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035036889999999999, 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036961979999999999, 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058576+0000", 2024-09-12T18:15:18.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058576+0000", 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058576+0000", 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6599999999999996e-07 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058581+0000", 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1899999999999997e-06 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058597+0000", 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6305000000000001e-05 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058603+0000", 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9220000000000002e-06 2024-09-12T18:15:18.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059583+0000", 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098021099999999993 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059602+0000", 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8879999999999999e-05 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218863 5.a 5:50048eaf:::benchmark_data_smithi062_23645_object83754:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.059839+0000", 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0022402189999999999, 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024821069999999999, 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218863 2024-09-12T18:15:18.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059839+0000", 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059839+0000", 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059840+0000", 2024-09-12T18:15:18.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8500000000000001e-07 2024-09-12T18:15:18.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059842+0000", 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6929999999999999e-06 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059851+0000", 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3110000000000006e-06 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059857+0000", 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5749999999999997e-06 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059918+0000", 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0676e-05 2024-09-12T18:15:18.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060058+0000", 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014047300000000001 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218864 5.0 5:0067b19d:::benchmark_data_smithi062_23645_object83755:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.060004+0000", 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020757359999999999, 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023708599999999998, 2024-09-12T18:15:18.090 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218864 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060004+0000", 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060004+0000", 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060004+0000", 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7800000000000002e-07 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060006+0000", 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1009999999999999e-06 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060014+0000", 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9589999999999995e-06 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060018+0000", 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.631e-06 2024-09-12T18:15:18.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060072+0000", 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4357999999999997e-05 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060190+0000", 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117955 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218865 5.c 5:3ac451f1:::benchmark_data_smithi062_23645_object83756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.060029+0000", 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020506610000000001, 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023984649999999998, 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218865 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.095 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060029+0000", 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060029+0000", 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060029+0000", 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.22e-07 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060031+0000", 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5260000000000001e-06 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060041+0000", 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0752e-05 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060044+0000", 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9510000000000002e-06 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061851+0000", 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00180649 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061973+0000", 2024-09-12T18:15:18.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012224999999999999 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.062055+0000", 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1709e-05 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:218862 5.f e67/53 5:ff1bf9c5:::benchmark_data_smithi062_23645_object83753:head v 67'13842, mlcod=67'13840)", 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.060135+0000", 2024-09-12T18:15:18.099 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0019441980000000001, 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023510739999999999, 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060135+0000", 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060135+0000", 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060136+0000", 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.51e-07 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060140+0000", 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689999999999997e-06 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060158+0000", 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8547999999999999e-05 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060168+0000", 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4720000000000001e-06 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060213+0000", 2024-09-12T18:15:18.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5300000000000003e-05 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060225+0000", 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2179e-05 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:218847 5.1 e67/49)", 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.061092+0000", 2024-09-12T18:15:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00098717199999999992, 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014374450000000001, 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061092+0000", 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061092+0000", 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061093+0000", 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3000000000000001e-07 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061096+0000", 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.886e-06 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061103+0000", 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8129999999999996e-06 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061108+0000", 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9060000000000001e-06 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218866 5.3 5:ce7613a9:::benchmark_data_smithi062_23645_object83757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.061166+0000", 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00091310199999999995, 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014025559999999999, 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218866 2024-09-12T18:15:18.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061166+0000", 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061166+0000", 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061167+0000", 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3099999999999997e-07 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061170+0000", 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3720000000000001e-06 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061178+0000", 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9470000000000003e-06 2024-09-12T18:15:18.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061184+0000", 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3900000000000001e-06 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061286+0000", 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010192300000000001 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061443+0000", 2024-09-12T18:15:18.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015712500000000001 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061541+0000", 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7743000000000003e-05 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218867 5.b 5:d9a75662:::benchmark_data_smithi062_23645_object83758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.061206+0000", 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00087294200000000003, 2024-09-12T18:15:18.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014203880000000001, 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218867 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061206+0000", 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061206+0000", 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061207+0000", 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7300000000000001e-07 2024-09-12T18:15:18.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061216+0000", 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2580000000000001e-06 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061223+0000", 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6719999999999998e-06 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061228+0000", 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2390000000000002e-06 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061907+0000", 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067912500000000004 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.062023+0000", 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115816 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218868 5.4 5:2524839a:::benchmark_data_smithi062_23645_object83759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.061389+0000", 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00069077400000000001, 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00129082, 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.116 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218868 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061389+0000", 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061389+0000", 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061389+0000", 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061393+0000", 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5039999999999998e-06 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061404+0000", 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1433e-05 2024-09-12T18:15:18.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061410+0000", 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8699999999999997e-06 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061451+0000", 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0620000000000001e-05 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061551+0000", 2024-09-12T18:15:18.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100116 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:218849 5.1 e67/49)", 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.061433+0000", 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00064675099999999999, 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012951060000000001, 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.120 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061433+0000", 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061433+0000", 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061433+0000", 2024-09-12T18:15:18.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3e-07 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061436+0000", 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9960000000000002e-06 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061445+0000", 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5909999999999996e-06 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061451+0000", 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9039999999999997e-06 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218847 5.1 5:81c9690d:::benchmark_data_smithi062_23645_object83738:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.052449+0000", 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0096300329999999996, 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01032137, 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.123 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218847 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052449+0000", 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052449+0000", 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052450+0000", 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000002e-07 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052455+0000", 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.33e-06 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052461+0000", 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.708e-06 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052467+0000", 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5199999999999997e-06 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052509+0000", 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2036999999999997e-05 2024-09-12T18:15:18.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052599+0000", 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0260000000000007e-05 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.052657+0000", 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7528999999999998e-05 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.059445+0000", 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067884540000000002 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:218860 5.c e67/53)", 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.061728+0000", 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00035162399999999998, 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001106566, 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.128 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061728+0000", 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061728+0000", 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061728+0000", 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0100000000000005e-07 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061731+0000", 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.554e-06 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061739+0000", 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9160000000000001e-06 2024-09-12T18:15:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061744+0000", 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1499999999999998e-06 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:218846 5.9 e67/53 5:978026a1:::benchmark_data_smithi062_23645_object83737:head v 67'13642, mlcod=67'13639)", 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.053220+0000", 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0088592710000000002, 2024-09-12T18:15:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096539369999999996, 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053220+0000", 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053220+0000", 2024-09-12T18:15:18.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053220+0000", 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4699999999999998e-07 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053224+0000", 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2969999999999999e-06 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053229+0000", 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1919999999999996e-06 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053233+0000", 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6e-06 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053409+0000", 2024-09-12T18:15:18.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000175291 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053429+0000", 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0486999999999999e-05 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218849 5.1 5:8df7128f:::benchmark_data_smithi062_23645_object83740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.053311+0000", 2024-09-12T18:15:18.135 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0087684370000000005, 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096129590000000008, 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218849 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053311+0000", 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053311+0000", 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053312+0000", 2024-09-12T18:15:18.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053316+0000", 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1509999999999997e-06 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053325+0000", 2024-09-12T18:15:18.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053331+0000", 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8260000000000004e-06 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057814+0000", 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004482598 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.057953+0000", 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013923900000000001 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.058075+0000", 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012217099999999999 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.140 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:218851 5.1 5:867ce2ec:::benchmark_data_smithi062_23645_object83742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.053675+0000", 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0084048209999999998, 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0093079749999999996, 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 218851 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053675+0000", 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053675+0000", 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053676+0000", 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3399999999999997e-07 2024-09-12T18:15:18.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053681+0000", 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1619999999999999e-06 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053691+0000", 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0087e-05 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.053698+0000", 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6070000000000002e-06 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.060951+0000", 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0072530219999999996 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061080+0000", 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012832300000000001 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.061214+0000", 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134022 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:218848 5.9 e67/53 5:9d68378e:::benchmark_data_smithi062_23645_object83739:head v 67'13643, mlcod=67'13639)", 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:18.055339+0000", 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.006740846, 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0077038599999999999, 2024-09-12T18:15:18.145 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055339+0000", 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055339+0000", 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055339+0000", 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055348+0000", 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1600000000000004e-06 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055356+0000", 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9349999999999994e-06 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055362+0000", 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1720000000000004e-06 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.055993+0000", 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063087799999999997 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:18.056016+0000", 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2714999999999999e-05 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 19 2024-09-12T18:15:18.149 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:18.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:18.151 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:18.146+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:18.252 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:18.246+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:18.353 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:18.346+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:18.357 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:18.357 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:18.357 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:18.357 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:18.357 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:18.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:18.454 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:18.448+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:18.554 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:18.552+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:18.586 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.468315445999998, 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.454914338999998, 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.448340656999999, 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.448228742000001, 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.442339795999999, 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.440730195, 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.419402494, 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186998 5.5 5:abc1ca4a:::benchmark_data_smithi062_23645_object51889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.754123005, 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068453476999999999, 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186998 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830447+0000", 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830451+0000", 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830462+0000", 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0825000000000001e-05 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830473+0000", 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830518+0000", 2024-09-12T18:15:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4987000000000001e-05 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830623+0000", 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010490899999999999 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830685+0000", 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1198999999999995e-05 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898706+0000", 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068020924999999996 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898763+0000", 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7914999999999997e-05 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898857+0000", 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3558000000000001e-05 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898899+0000", 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.21e-05 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186999 5.5 5:a5be6d45:::benchmark_data_smithi062_23645_object51890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.754013724, 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068700116000000006, 2024-09-12T18:15:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186999 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830556+0000", 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830558+0000", 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830567+0000", 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830572+0000", 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.271e-06 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832086+0000", 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015141309999999999 2024-09-12T18:15:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832189+0000", 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010328299999999999 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832299+0000", 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109885 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898720+0000", 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066420542999999999 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899137+0000", 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041740499999999998 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899203+0000", 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5494999999999995e-05 2024-09-12T18:15:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899255+0000", 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2405999999999999e-05 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187000 5.5 5:ad951543:::benchmark_data_smithi062_23645_object51891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.753906395, 2024-09-12T18:15:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068743992000000004, 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187000 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830663+0000", 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830666+0000", 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9050000000000001e-06 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830677+0000", 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0988000000000001e-05 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830682+0000", 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833659+0000", 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029767460000000002 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833755+0000", 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5978999999999997e-05 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833872+0000", 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116779 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898726+0000", 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064854262999999995 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899306+0000", 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057974299999999997 2024-09-12T18:15:18.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899362+0000", 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6567999999999998e-05 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899406+0000", 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4081e-05 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.643 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187004 5.3 5:c7ad184c:::benchmark_data_smithi062_23645_object51895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.75298486, 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067576516000000003, 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.644 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187004 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831587+0000", 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0000000000000001e-06 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831597+0000", 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3919999999999992e-06 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831601+0000", 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.211e-06 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832123+0000", 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052220999999999995 2024-09-12T18:15:18.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832228+0000", 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104901 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832332+0000", 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104298 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834361+0000", 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020281549999999998 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898978+0000", 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064617544999999998 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899052+0000", 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4402999999999999e-05 2024-09-12T18:15:18.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899160+0000", 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010777600000000001 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187006 5.5 5:ab27be23:::benchmark_data_smithi062_23645_object51897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:18.650 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.751952746000001, 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070397003999999999, 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187006 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832617+0000", 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:15:18.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832620+0000", 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999999e-06 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832630+0000", 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2529999999999993e-06 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832637+0000", 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.866e-06 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835192+0000", 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025558999999999998 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835290+0000", 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7355000000000006e-05 2024-09-12T18:15:18.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835381+0000", 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1231999999999997e-05 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899455+0000", 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064073781999999996 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902827+0000", 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003372103 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902954+0000", 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012695 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903013+0000", 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8956999999999998e-05 2024-09-12T18:15:18.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187002 5.f e60/53 5:f316353f:::benchmark_data_smithi062_23645_object51893:head v 60'11800, mlcod=60'11795)", 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.750631399, 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067384802999999993, 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833938+0000", 2024-09-12T18:15:18.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9200000000000002e-07 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833958+0000", 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833964+0000", 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8480000000000003e-06 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833969+0000", 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5009999999999998e-06 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834034+0000", 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4665999999999994e-05 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834053+0000", 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9221000000000001e-05 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901272+0000", 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067219152000000004 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901322+0000", 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.011e-05 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187008 5.0 5:09c03dc0:::benchmark_data_smithi062_23645_object51899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.750571247, 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067136113999999997, 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187008 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.662 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833998+0000", 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834002+0000", 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834028+0000", 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5894e-05 2024-09-12T18:15:18.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834037+0000", 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834094+0000", 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6916000000000002e-05 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834215+0000", 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121709 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.900976+0000", 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066761176000000005 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901041+0000", 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4304e-05 2024-09-12T18:15:18.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901133+0000", 2024-09-12T18:15:18.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.268e-05 2024-09-12T18:15:18.667 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.667 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187011 5.6 5:6422621a:::benchmark_data_smithi062_23645_object51902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.750021001, 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067142944999999996, 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.668 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187011 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:18.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834553+0000", 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834562+0000", 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834570+0000", 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834630+0000", 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9957000000000002e-05 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834731+0000", 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100751 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834834+0000", 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010338199999999999 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899126+0000", 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064291736000000002 2024-09-12T18:15:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901333+0000", 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022070890000000002 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901538+0000", 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020443600000000001 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901691+0000", 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152817 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187014 5.2 5:45b0919f:::benchmark_data_smithi062_23645_object51905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.748699558, 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067748596999999994, 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.675 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187014 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835870+0000", 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.285e-06 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835883+0000", 2024-09-12T18:15:18.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2276000000000001e-05 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835893+0000", 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835900+0000", 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835956+0000", 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6276000000000001e-05 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898671+0000", 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.062715530000000005 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898855+0000", 2024-09-12T18:15:18.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183284 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903145+0000", 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042906580000000001 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903556+0000", 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041042800000000001 2024-09-12T18:15:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903590+0000", 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4440000000000002e-05 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903618+0000", 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7521999999999998e-05 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.530263340999999, 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070729645999999993, 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.682 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124936+0000", 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064320978000000001 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124991+0000", 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5550999999999997e-05 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125035+0000", 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3859999999999997e-05 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.523811611999999, 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068614100999999997, 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.688 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:18.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:18.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126682+0000", 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.065744891 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129287+0000", 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026049409999999999 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129333+0000", 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016999999999997e-05 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129371+0000", 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7796000000000002e-05 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5:4781a562:::benchmark_data_smithi062_23645_object52283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.694 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.523767646, 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.073009940999999995, 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:18.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124774+0000", 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.063958509999999996 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124908+0000", 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013461199999999999 2024-09-12T18:15:18.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125013+0000", 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104153 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129380+0000", 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043676100000000001 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133738+0000", 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043580950000000002 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133769+0000", 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1032999999999999e-05 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133811+0000", 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.700 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187395 5.a 5:58aaa639:::benchmark_data_smithi062_23645_object52286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.523189919, 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068114076999999995, 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:18.701 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187395 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:18.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061383+0000", 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.72e-06 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122886+0000", 2024-09-12T18:15:18.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.061503331000000001 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122905+0000", 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029e-05 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126609+0000", 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037042030000000001 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126714+0000", 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010544600000000001 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129385+0000", 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026710869999999999 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129433+0000", 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7567e-05 2024-09-12T18:15:18.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129493+0000", 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.995e-05 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:18.706 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:18.708 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:18.708 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:18.704+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:18.808 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:18.802+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:18.860 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:220843 5.6 e67/53 5:6890b03c:::benchmark_data_smithi062_23645_object85734:head v 67'13705, mlcod=67'13702)", 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.859932+0000", 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00022680399999999999, 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000242756, 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859932+0000", 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859932+0000", 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859932+0000", 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-07 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859936+0000", 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2909999999999999e-06 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859941+0000", 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2440000000000001e-06 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859946+0000", 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2059999999999998e-06 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859992+0000", 2024-09-12T18:15:18.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5812000000000001e-05 2024-09-12T18:15:18.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860010+0000", 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8193e-05 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:220844 5.c e67/53 5:3c8c5b5d:::benchmark_data_smithi062_23645_object85735:head v 67'13657, mlcod=67'13654)", 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.859957+0000", 2024-09-12T18:15:18.866 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00020203300000000001, 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000252, 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859957+0000", 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859957+0000", 2024-09-12T18:15:18.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859957+0000", 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.8599999999999999e-07 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859960+0000", 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.915e-06 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859966+0000", 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9440000000000002e-06 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859971+0000", 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2839999999999997e-06 2024-09-12T18:15:18.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860013+0000", 2024-09-12T18:15:18.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1287e-05 2024-09-12T18:15:18.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860032+0000", 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.946e-05 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220845 5.f 5:fa4527d9:::benchmark_data_smithi062_23645_object85736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.872 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.860027+0000", 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00013159700000000001, 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021535200000000001, 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "reached pg", 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.873 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220845 2024-09-12T18:15:18.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.874 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860027+0000", 2024-09-12T18:15:18.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860027+0000", 2024-09-12T18:15:18.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860029+0000", 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4869999999999999e-06 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860033+0000", 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6899999999999998e-06 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.877 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.877 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860041+0000", 2024-09-12T18:15:18.877 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8650000000000007e-06 2024-09-12T18:15:18.877 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.877 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.881 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.881 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860048+0000", 2024-09-12T18:15:18.882 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1299999999999998e-06 2024-09-12T18:15:18.882 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.882 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.882 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.882 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860212+0000", 2024-09-12T18:15:18.883 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000164885 2024-09-12T18:15:18.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.883 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.883 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.883 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.884 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.884 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220846 5.d 5.59a7f8ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.884 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.860059+0000", 2024-09-12T18:15:18.884 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 9.9899e-05, 2024-09-12T18:15:18.884 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021484400000000001, 2024-09-12T18:15:18.885 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.885 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.885 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.885 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.885 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.886 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.886 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220846 2024-09-12T18:15:18.886 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.886 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.886 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860059+0000", 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.887 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860059+0000", 2024-09-12T18:15:18.888 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.888 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.888 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.888 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.888 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860060+0000", 2024-09-12T18:15:18.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4499999999999997e-07 2024-09-12T18:15:18.889 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.889 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.889 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.889 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860062+0000", 2024-09-12T18:15:18.889 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5610000000000001e-06 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860069+0000", 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6579999999999996e-06 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860074+0000", 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4140000000000002e-06 2024-09-12T18:15:18.890 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220847 5.9 5.4e307b59 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.860089+0000", 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 6.9973000000000002e-05, 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021120500000000001, 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.891 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220847 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860089+0000", 2024-09-12T18:15:18.892 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860089+0000", 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860089+0000", 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6600000000000002e-07 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.893 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860092+0000", 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.5100000000000001e-06 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860099+0000", 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6220000000000003e-06 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860104+0000", 2024-09-12T18:15:18.894 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220848 5.f 5.6b37cb8f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.860112+0000", 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.7129000000000002e-05, 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00021257599999999999, 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.895 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220848 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860112+0000", 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.896 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860112+0000", 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860112+0000", 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.89e-07 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860114+0000", 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.903e-06 2024-09-12T18:15:18.897 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860120+0000", 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0379999999999996e-06 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860125+0000", 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4989999999999996e-06 2024-09-12T18:15:18.898 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:220849 5.1 e67/49)", 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.860267+0000", 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9998918, 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1452000000000006e-05, 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860267+0000", 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860267+0000", 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.900 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860268+0000", 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1699999999999999e-07 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860272+0000", 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1810000000000003e-06 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.901 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860282+0000", 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0628000000000001e-05 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860288+0000", 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5899999999999998e-06 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.902 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220851 5.d 5.d23808fd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.860352+0000", 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4294967295.9998069, 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9468000000000001e-05, 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.903 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220851 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860352+0000", 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860352+0000", 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.904 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860353+0000", 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0800000000000004e-07 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860356+0000", 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2569999999999999e-06 2024-09-12T18:15:18.905 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860364+0000", 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5399999999999996e-06 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860370+0000", 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7039999999999999e-06 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.906 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220828 5.9 5:9f1d77cc:::benchmark_data_smithi062_23645_object85719:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.850287+0000", 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0098718499999999997, 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.010110925999999999, 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.907 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220828 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.850287+0000", 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.908 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.850287+0000", 2024-09-12T18:15:18.909 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.909 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.909 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.909 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.909 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.850288+0000", 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7800000000000002e-07 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.850290+0000", 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3740000000000001e-06 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.850296+0000", 2024-09-12T18:15:18.910 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2219999999999999e-06 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.850301+0000", 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4499999999999997e-06 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852160+0000", 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001859646 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.911 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852308+0000", 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014820999999999999 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852454+0000", 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000145938 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858429+0000", 2024-09-12T18:15:18.912 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0059747740000000004 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859879+0000", 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0014501 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859937+0000", 2024-09-12T18:15:18.913 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7277000000000001e-05 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220832 5.9 5:9deb83c8:::benchmark_data_smithi062_23645_object85723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.852260+0000", 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0078988410000000002, 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0081822430000000005, 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.914 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220832 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852260+0000", 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.915 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852260+0000", 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852261+0000", 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0160000000000001e-06 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852265+0000", 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.916 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852273+0000", 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6359999999999994e-06 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852278+0000", 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0019999999999997e-06 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.917 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.854621+0000", 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023424980000000001 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.854770+0000", 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149133 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.918 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:18.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.854896+0000", 2024-09-12T18:15:18.919 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012601999999999999 2024-09-12T18:15:18.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.919 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.919 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:18.919 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858436+0000", 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0035399099999999998 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220833 5.9 5:9f72dba9:::benchmark_data_smithi062_23645_object85724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.852441+0000", 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0077184089999999999, 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080377439999999994, 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.920 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220833 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.921 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852441+0000", 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.922 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852441+0000", 2024-09-12T18:15:18.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.923 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.923 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.923 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.923 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852441+0000", 2024-09-12T18:15:18.923 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852446+0000", 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5410000000000002e-06 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852455+0000", 2024-09-12T18:15:18.924 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7069999999999998e-06 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.852461+0000", 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6660000000000002e-06 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.856664+0000", 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042024999999999996 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.925 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.856787+0000", 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123325 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.856911+0000", 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123807 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.926 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:220838 5.7 5:e73b11bf:::benchmark_data_smithi062_23645_object85729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.855551+0000", 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0046084239999999999, 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00496132, 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.927 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.928 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:18.928 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:18.928 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:18.928 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:18.928 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 220838 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.855551+0000", 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.855551+0000", 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.929 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.855552+0000", 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3090000000000001e-06 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.855556+0000", 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7400000000000002e-06 2024-09-12T18:15:18.930 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.855568+0000", 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2024e-05 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.855575+0000", 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.199e-06 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.931 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.856660+0000", 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001085529 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.932 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.856780+0000", 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119392 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.856896+0000", 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000116204 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.933 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:18.934 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.860233+0000", 2024-09-12T18:15:18.934 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003337123 2024-09-12T18:15:18.934 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.934 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.934 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.934 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:220840 5.6 e67/53 5:6ab995f3:::benchmark_data_smithi062_23645_object85731:head v 67'13704, mlcod=67'13702)", 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.858362+0000", 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0017965259999999999, 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021855310000000001, 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858362+0000", 2024-09-12T18:15:18.935 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858362+0000", 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858363+0000", 2024-09-12T18:15:18.936 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3499999999999995e-07 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858369+0000", 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.806e-06 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.937 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858377+0000", 2024-09-12T18:15:18.938 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2630000000000003e-06 2024-09-12T18:15:18.938 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.938 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.938 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.938 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858385+0000", 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.4170000000000003e-06 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858443+0000", 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7961999999999998e-05 2024-09-12T18:15:18.939 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858465+0000", 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2702e-05 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:220842 5.c e67/53 5:344a9692:::benchmark_data_smithi062_23645_object85733:head v 67'13656, mlcod=67'13654)", 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.858417+0000", 2024-09-12T18:15:18.940 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001742024, 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002158274, 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858417+0000", 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.941 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858417+0000", 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858417+0000", 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1800000000000001e-07 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.942 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858421+0000", 2024-09-12T18:15:18.943 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9920000000000001e-06 2024-09-12T18:15:18.943 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.943 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.943 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.943 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858428+0000", 2024-09-12T18:15:18.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7100000000000001e-06 2024-09-12T18:15:18.944 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.944 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.944 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.944 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858433+0000", 2024-09-12T18:15:18.944 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1490000000000002e-06 2024-09-12T18:15:18.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.945 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.945 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.945 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858483+0000", 2024-09-12T18:15:18.945 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0044999999999999e-05 2024-09-12T18:15:18.945 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.946 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.946 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.946 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858500+0000", 2024-09-12T18:15:18.946 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6744000000000001e-05 2024-09-12T18:15:18.946 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.947 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.947 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.947 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.947 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:220828 5.9 e67/53 ondisk, result = 0)", 2024-09-12T18:15:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.858813+0000", 2024-09-12T18:15:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001346037, 2024-09-12T18:15:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001788541, 2024-09-12T18:15:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:18.949 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.949 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.949 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.949 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858813+0000", 2024-09-12T18:15:18.949 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.950 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.950 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.950 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858813+0000", 2024-09-12T18:15:18.950 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.950 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.951 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.951 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.951 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858814+0000", 2024-09-12T18:15:18.951 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:18.951 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.952 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.952 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.952 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858816+0000", 2024-09-12T18:15:18.952 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.3429999999999998e-06 2024-09-12T18:15:18.952 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.953 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.953 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.953 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858826+0000", 2024-09-12T18:15:18.953 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0601999999999999e-05 2024-09-12T18:15:18.953 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.954 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.954 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.858831+0000", 2024-09-12T18:15:18.954 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3059999999999999e-06 2024-09-12T18:15:18.954 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.954 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.955 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:18.955 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859865+0000", 2024-09-12T18:15:18.955 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0010340550000000001 2024-09-12T18:15:18.955 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.955 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.956 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:18.956 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859873+0000", 2024-09-12T18:15:18.956 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1459999999999996e-06 2024-09-12T18:15:18.956 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.956 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.957 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.957 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.957 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.957 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:220832 5.9 e67/53)", 2024-09-12T18:15:18.957 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.859812+0000", 2024-09-12T18:15:18.957 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00034673800000000003, 2024-09-12T18:15:18.958 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00081813299999999997, 2024-09-12T18:15:18.958 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.958 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.958 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.958 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.959 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.959 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859812+0000", 2024-09-12T18:15:18.959 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.959 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.959 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.960 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859812+0000", 2024-09-12T18:15:18.960 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.960 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.960 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.960 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859813+0000", 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3599999999999999e-07 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859815+0000", 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4499999999999998e-06 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859822+0000", 2024-09-12T18:15:18.961 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2259999999999999e-06 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859829+0000", 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6819999999999997e-06 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "MOSDPGPushReply(5.9 67/53 [PushReplyOp(5:9dcd5888:::benchmark_data_smithi062_23645_object129248:head)])", 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.859839+0000", 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00032041799999999999, 2024-09-12T18:15:18.962 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00081298600000000003, 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859839+0000", 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.963 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859839+0000", 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859839+0000", 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9900000000000002e-07 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.964 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859849+0000", 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9539999999999999e-06 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859856+0000", 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859863+0000", 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5479999999999998e-06 2024-09-12T18:15:18.965 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop_reply(client.4581.0:220833 5.9 e67/53)", 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:18.859887+0000", 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00027179299999999999, 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00078393400000000002, 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:18.966 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859887+0000", 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859887+0000", 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859887+0000", 2024-09-12T18:15:18.967 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2800000000000003e-07 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859890+0000", 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4619999999999999e-06 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.968 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859897+0000", 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5540000000000003e-06 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:18.859901+0000", 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7010000000000004e-06 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.969 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:18.970 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:18.970 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 18 2024-09-12T18:15:18.970 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:18.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:18.973 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:18.968+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:19.072 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:19.068+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:19.161 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:19.161 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:19.161 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:19.162 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:19.162 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:19.173 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:19.168+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:19.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:19.274 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:19.268+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:19.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:15:19.375 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:19.370+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:19.384 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 127.088965167, 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.386 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.387 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:19.388 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:19.388 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.388 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.389 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.389 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:19.389 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:19.389 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.389 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.390 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:19.390 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:19.390 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.390 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.390 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:19.391 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.392 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:19.393 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.394 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.395 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:19.396 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:19.396 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 115.98866773899999, 2024-09-12T18:15:19.396 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:19.396 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.396 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.397 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.398 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.399 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:19.400 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.401 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.402 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 115.988604689, 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.403 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.404 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:19.405 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.406 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.407 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.408 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.409 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:19.409 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:19.409 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 115.987666113, 2024-09-12T18:15:19.409 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:19.409 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.409 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.410 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.411 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:19.414 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:19.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.415 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.415 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.415 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:19.415 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:19.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.416 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.416 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.416 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:19.416 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:19.416 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.416 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 115.987012402, 2024-09-12T18:15:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:19.418 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:19.419 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.420 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:19.421 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.422 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.422 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.422 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:19.422 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:19.422 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.422 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.423 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.423 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:19.423 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:19.423 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.423 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.424 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.424 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:19.424 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:19.424 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.424 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.425 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:19.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:19.425 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.425 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:19.426 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:19.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:19.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:19.427 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.427 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.427 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.428 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:19.428 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:19.428 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.127847254999999, 2024-09-12T18:15:19.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:19.429 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.429 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.429 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.429 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.429 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.430 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.430 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:19.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.430 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:19.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.432 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:19.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.432 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:19.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:19.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:19.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:19.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:19.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:19.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:19.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:19.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.119824878000003, 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:19.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:19.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:19.445 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 52.108239591999997, 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.446 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:19.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.220887608000002, 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.452 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:19.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.215913639, 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:19.458 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.460 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:19.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:19.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:19.464 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.21544471, 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.465 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:19.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.213403386, 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:19.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.473 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:19.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.212495616999998, 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:19.475 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:19.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.212067414, 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.480 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:19.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.551537267, 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.485 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:19.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:19.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:19.490 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.549292646, 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.491 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:19.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:19.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:19.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:19.497 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.546759405, 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:19.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:19.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.501 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.503 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.546301415, 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.504 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:19.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.509 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.321803933, 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.510 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:19.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:19.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 14.321770403, 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:19.516 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:19.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:19.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:19.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.525 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:19.525 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:19.525 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:19.526 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:19.520+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:19.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:19.627 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:19.622+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:19.685 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:19.685 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222874 5.b 5:de7bae2d:::benchmark_data_smithi062_23645_object87765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.677390+0000", 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0070948280000000001, 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071174710000000002, 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222874 2024-09-12T18:15:19.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677390+0000", 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677390+0000", 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677390+0000", 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3200000000000005e-07 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677393+0000", 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3489999999999999e-06 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677399+0000", 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9780000000000002e-06 2024-09-12T18:15:19.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677403+0000", 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9239999999999998e-06 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681262+0000", 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038586559999999998 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681373+0000", 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110772 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222876 5.b 5:d2d244c1:::benchmark_data_smithi062_23645_object87767:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.677507+0000", 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0069774729999999997, 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070498829999999998, 2024-09-12T18:15:19.690 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222876 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677507+0000", 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677507+0000", 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677508+0000", 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2699999999999998e-07 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677512+0000", 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8500000000000004e-06 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677520+0000", 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7639999999999994e-06 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677527+0000", 2024-09-12T18:15:19.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1829999999999999e-06 2024-09-12T18:15:19.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682775+0000", 2024-09-12T18:15:19.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005248061 2024-09-12T18:15:19.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682882+0000", 2024-09-12T18:15:19.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010766499999999999 2024-09-12T18:15:19.695 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.695 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.696 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.696 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222855 5.b 5:df1b3d56:::benchmark_data_smithi062_23645_object87746:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.696 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.669836+0000", 2024-09-12T18:15:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.014648718999999999, 2024-09-12T18:15:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014771767999999999, 2024-09-12T18:15:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.698 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.698 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.698 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222855 2024-09-12T18:15:19.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.698 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.669836+0000", 2024-09-12T18:15:19.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.669836+0000", 2024-09-12T18:15:19.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.669836+0000", 2024-09-12T18:15:19.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:19.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.669840+0000", 2024-09-12T18:15:19.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.721e-06 2024-09-12T18:15:19.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.669846+0000", 2024-09-12T18:15:19.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9830000000000001e-06 2024-09-12T18:15:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.669851+0000", 2024-09-12T18:15:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7790000000000003e-06 2024-09-12T18:15:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677261+0000", 2024-09-12T18:15:19.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074098810000000001 2024-09-12T18:15:19.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677970+0000", 2024-09-12T18:15:19.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00070907800000000003 2024-09-12T18:15:19.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.705 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.706 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222877 5.b 5:d0f777a0:::benchmark_data_smithi062_23645_object87768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.706 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.677694+0000", 2024-09-12T18:15:19.706 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0067903629999999998, 2024-09-12T18:15:19.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069747749999999999, 2024-09-12T18:15:19.707 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.707 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.707 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:19.707 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.707 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.707 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.708 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222877 2024-09-12T18:15:19.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.708 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677694+0000", 2024-09-12T18:15:19.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677694+0000", 2024-09-12T18:15:19.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677695+0000", 2024-09-12T18:15:19.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:15:19.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677698+0000", 2024-09-12T18:15:19.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3579999999999999e-06 2024-09-12T18:15:19.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677706+0000", 2024-09-12T18:15:19.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1380000000000007e-06 2024-09-12T18:15:19.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.677712+0000", 2024-09-12T18:15:19.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.161e-06 2024-09-12T18:15:19.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684628+0000", 2024-09-12T18:15:19.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069158329999999997 2024-09-12T18:15:19.714 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.714 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.714 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.715 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222880 5.a 5:514b982b:::benchmark_data_smithi062_23645_object87771:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.715 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.681527+0000", 2024-09-12T18:15:19.715 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0029569209999999999, 2024-09-12T18:15:19.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003204293, 2024-09-12T18:15:19.716 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.716 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.716 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.716 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.717 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222880 2024-09-12T18:15:19.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.718 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681527+0000", 2024-09-12T18:15:19.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681527+0000", 2024-09-12T18:15:19.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681528+0000", 2024-09-12T18:15:19.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:19.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681532+0000", 2024-09-12T18:15:19.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5860000000000001e-06 2024-09-12T18:15:19.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681539+0000", 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0690000000000004e-06 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681546+0000", 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9580000000000001e-06 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681600+0000", 2024-09-12T18:15:19.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4250999999999999e-05 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681716+0000", 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115659 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222884 5.2 5:418ad42d:::benchmark_data_smithi062_23645_object87775:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.727 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.681828+0000", 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002656739, 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029691890000000001, 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222884 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681828+0000", 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681828+0000", 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681828+0000", 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681832+0000", 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681839+0000", 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7100000000000001e-06 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681842+0000", 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7960000000000002e-06 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681870+0000", 2024-09-12T18:15:19.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8014e-05 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.681940+0000", 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9560000000000005e-05 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682056+0000", 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115627 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.732 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222886 5.2 5:4003a576:::benchmark_data_smithi062_23645_object87777:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.682437+0000", 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020469780000000001, 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024215679999999998, 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.734 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222886 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682437+0000", 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682437+0000", 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682438+0000", 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.54e-07 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682442+0000", 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.019e-06 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682452+0000", 2024-09-12T18:15:19.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682460+0000", 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2320000000000004e-06 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683419+0000", 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00095974000000000005 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683539+0000", 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119697 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683649+0000", 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010972 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.739 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222887 5.a 5:5fe4aedb:::benchmark_data_smithi062_23645_object87778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.682473+0000", 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0020116750000000001, 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024557540000000001, 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.740 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222887 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682473+0000", 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682473+0000", 2024-09-12T18:15:19.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682473+0000", 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.06e-07 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682476+0000", 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682483+0000", 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4669999999999998e-06 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682488+0000", 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1909999999999999e-06 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683407+0000", 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091907800000000004 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683504+0000", 2024-09-12T18:15:19.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6281999999999997e-05 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:222883 5.9 e67/53 5:9fbaf542:::benchmark_data_smithi062_23645_object87774:head v 67'13911, mlcod=67'13909)", 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.682612+0000", 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0018725020000000001, 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023755809999999999, 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.745 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682612+0000", 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682612+0000", 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682613+0000", 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0500000000000003e-07 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682621+0000", 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9889999999999992e-06 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682631+0000", 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0645999999999999e-05 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682639+0000", 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1519999999999992e-06 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682684+0000", 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4131000000000001e-05 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.682704+0000", 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0890000000000002e-05 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.749 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:222869 5.2 e67/49 ondisk, result = 0)", 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.683879+0000", 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00060578300000000004, 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011546869999999999, 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683879+0000", 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683879+0000", 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683879+0000", 2024-09-12T18:15:19.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683883+0000", 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6720000000000002e-06 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683895+0000", 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1799e-05 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.683901+0000", 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9939999999999997e-06 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684935+0000", 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010338070000000001 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684941+0000", 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.742e-06 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.685033+0000", 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1992999999999998e-05 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.754 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222862 5.b 5:da76e0dd:::benchmark_data_smithi062_23645_object87753:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.673693+0000", 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010791022000000001, 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01140735, 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222862 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.673693+0000", 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.673693+0000", 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.673694+0000", 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.097e-06 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.673698+0000", 2024-09-12T18:15:19.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9060000000000004e-06 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.673709+0000", 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0325e-05 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.673716+0000", 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8349999999999998e-06 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.679874+0000", 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006158714 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.679979+0000", 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104893 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222889 5.3 5:ca3dc3a5:::benchmark_data_smithi062_23645_object87780:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.684684+0000", 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998002, 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047723500000000001, 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222889 2024-09-12T18:15:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.761 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684684+0000", 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684684+0000", 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684686+0000", 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684690+0000", 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7450000000000003e-06 2024-09-12T18:15:19.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684700+0000", 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0013000000000001e-05 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684707+0000", 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9670000000000004e-06 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684761+0000", 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3903000000000002e-05 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684877+0000", 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011615700000000001 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684983+0000", 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010600299999999999 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:222890 5.8 5:1a4f22d7:::benchmark_data_smithi062_23645_object87781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.684759+0000", 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997253, 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000466255, 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:19.766 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 222890 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684759+0000", 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684759+0000", 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684760+0000", 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4300000000000002e-07 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684763+0000", 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5429999999999998e-06 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684772+0000", 2024-09-12T18:15:19.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.884e-06 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684779+0000", 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7939999999999997e-06 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684832+0000", 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3180000000000002e-05 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684944+0000", 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011150999999999999 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:222884 5.2 e67/49 ondisk, result = 0)", 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:19.684912+0000", 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9995728, 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037097399999999999, 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:19.770 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684912+0000", 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684912+0000", 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:19.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684912+0000", 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1500000000000004e-07 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684916+0000", 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9349999999999996e-06 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684924+0000", 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1049999999999995e-06 2024-09-12T18:15:19.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.684931+0000", 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3040000000000001e-06 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.685068+0000", 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013740599999999999 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:19.685076+0000", 2024-09-12T18:15:19.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8890000000000002e-06 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2024-09-12T18:15:19.774 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:19.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:19.776 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:19.770+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:19.876 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:19.870+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:19.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:19.970 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:19.970 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:19.976 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:19.972+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:19.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:20.078 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:20.074+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:20.113 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:20.132 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:20.132 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:20.150 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:20.153 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:20.153 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:20.178 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:20.174+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:20.186 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:20.186 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:20.206 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:20.280 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:20.276+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:20.333 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:15:20.364 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:20.365 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:20.380 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:20.376+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:20.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:20.481 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:20.478+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:20.578 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:20.578 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:20.581 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:20.576+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:20.597 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:20.682 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:20.678+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:20.783 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:20.780+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:20.795 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:20.795 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:20.816 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:20.884 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:20.878+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:20.976 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:20.976 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:20.986 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:20.980+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:20.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:21.086 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:21.084+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:21.188 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:21.182+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:21.189 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:21.189 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:21.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:21.297 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:21.294+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:21.330 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T18:15:21.390 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:21.384+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:21.411 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:21.411 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:21.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:21.442 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-09-12T18:15:21.491 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:21.486+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:21.582 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:21.583 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:21.592 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:21.586+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:21.602 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:21.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-09-12T18:15:21.693 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:21.688+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:21.755 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:21.755 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:21.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:21.794 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:21.790+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:21.895 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:21.892+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:21.966 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:21.966 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:21.986 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:22.029 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:22.026+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:22.096 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:22.092+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:22.145 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:22.145 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:22.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:22.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:22.197 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:22.192+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:22.293 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:22.297 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:22.292+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:22.313 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:22.313 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:22.332 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:22.332 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:22.335 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:22.336 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:22.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:15:22.366 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:22.366 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:22.366 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:22.366 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:22.366 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:22.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:22.398 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:22.396+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:22.499 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:22.496+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:22.527 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:22.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:22.527 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:22.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.409769093999998, 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:22.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:22.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.396367986999998, 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:22.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:22.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:22.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:22.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:22.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:22.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:22.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:22.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:22.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:22.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:22.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:22.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:22.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:22.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:22.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.389794305000002, 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.389682389999997, 2024-09-12T18:15:22.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:22.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:22.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151574 5.f 5.ab437acf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.383793443999998, 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0001034870000001, 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151574 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142229+0000", 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142230+0000", 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142233+0000", 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8399999999999997e-06 2024-09-12T18:15:22.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142242+0000", 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1040000000000007e-06 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142246+0000", 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7269999999999998e-06 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142287+0000", 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0423000000000002e-05 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.142291+0000", 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4050000000000002e-06 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142325+0000", 2024-09-12T18:15:22.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000033693 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142332+0000", 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5349999999999999e-06 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151577 5.f 5.f9b612f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:22.561 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.382183843, 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.998523202, 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151577 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:22.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143838+0000", 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143839+0000", 2024-09-12T18:15:22.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8800000000000003e-07 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143841+0000", 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2350000000000002e-06 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143846+0000", 2024-09-12T18:15:22.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2959999999999998e-06 2024-09-12T18:15:22.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143850+0000", 2024-09-12T18:15:22.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8650000000000003e-06 2024-09-12T18:15:22.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143883+0000", 2024-09-12T18:15:22.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2789000000000001e-05 2024-09-12T18:15:22.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.143887+0000", 2024-09-12T18:15:22.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9879999999999998e-06 2024-09-12T18:15:22.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142354+0000", 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99846711600000004 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142362+0000", 2024-09-12T18:15:22.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4250000000000001e-06 2024-09-12T18:15:22.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.569 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.569 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151599 5.9 5.1b7ee829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 34.360856142000003, 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97844558599999998, 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151599 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.570 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165166+0000", 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165167+0000", 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.139e-06 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165172+0000", 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1420000000000001e-06 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165189+0000", 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6790999999999999e-05 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165198+0000", 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1060000000000006e-06 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165237+0000", 2024-09-12T18:15:22.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8340999999999998e-05 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.165241+0000", 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4000000000000002e-06 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143603+0000", 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97836149400000005 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143612+0000", 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186998 5.5 5:abc1ca4a:::benchmark_data_smithi062_23645_object51889:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.575 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.695576653, 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068453476999999999, 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186998 2024-09-12T18:15:22.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830446+0000", 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830447+0000", 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830451+0000", 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1389999999999997e-06 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830462+0000", 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0825000000000001e-05 2024-09-12T18:15:22.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830473+0000", 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1953999999999999e-05 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830518+0000", 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4987000000000001e-05 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830623+0000", 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010490899999999999 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830685+0000", 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1198999999999995e-05 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898706+0000", 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068020924999999996 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898763+0000", 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7914999999999997e-05 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898857+0000", 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3558000000000001e-05 2024-09-12T18:15:22.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898899+0000", 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.21e-05 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.583 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:186999 5.5 5:a5be6d45:::benchmark_data_smithi062_23645_object51890:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.583 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:22.583 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.695467372, 2024-09-12T18:15:22.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068700116000000006, 2024-09-12T18:15:22.584 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.584 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 186999 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:22.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830555+0000", 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830556+0000", 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830558+0000", 2024-09-12T18:15:22.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-09-12T18:15:22.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830567+0000", 2024-09-12T18:15:22.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:22.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830572+0000", 2024-09-12T18:15:22.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.271e-06 2024-09-12T18:15:22.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832086+0000", 2024-09-12T18:15:22.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015141309999999999 2024-09-12T18:15:22.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832189+0000", 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010328299999999999 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832299+0000", 2024-09-12T18:15:22.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109885 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898720+0000", 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066420542999999999 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899137+0000", 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041740499999999998 2024-09-12T18:15:22.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899203+0000", 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5494999999999995e-05 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899255+0000", 2024-09-12T18:15:22.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2405999999999999e-05 2024-09-12T18:15:22.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.594 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187000 5.5 5:ad951543:::benchmark_data_smithi062_23645_object51891:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.695360043000001, 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068743992000000004, 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187000 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830662+0000", 2024-09-12T18:15:22.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830663+0000", 2024-09-12T18:15:22.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6300000000000005e-07 2024-09-12T18:15:22.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830666+0000", 2024-09-12T18:15:22.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9050000000000001e-06 2024-09-12T18:15:22.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830677+0000", 2024-09-12T18:15:22.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0988000000000001e-05 2024-09-12T18:15:22.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.830682+0000", 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3770000000000004e-06 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833659+0000", 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029767460000000002 2024-09-12T18:15:22.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833755+0000", 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5978999999999997e-05 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833872+0000", 2024-09-12T18:15:22.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116779 2024-09-12T18:15:22.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898726+0000", 2024-09-12T18:15:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064854262999999995 2024-09-12T18:15:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899306+0000", 2024-09-12T18:15:22.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057974299999999997 2024-09-12T18:15:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899362+0000", 2024-09-12T18:15:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6567999999999998e-05 2024-09-12T18:15:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899406+0000", 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4081e-05 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.607 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187004 5.3 5:c7ad184c:::benchmark_data_smithi062_23645_object51895:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.694438508000001, 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067576516000000003, 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187004 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.608 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831584+0000", 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2500000000000005e-07 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831587+0000", 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0000000000000001e-06 2024-09-12T18:15:22.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831597+0000", 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3919999999999992e-06 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.831601+0000", 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.211e-06 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832123+0000", 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052220999999999995 2024-09-12T18:15:22.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832228+0000", 2024-09-12T18:15:22.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104901 2024-09-12T18:15:22.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832332+0000", 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104298 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834361+0000", 2024-09-12T18:15:22.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020281549999999998 2024-09-12T18:15:22.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898978+0000", 2024-09-12T18:15:22.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064617544999999998 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899052+0000", 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4402999999999999e-05 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899160+0000", 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010777600000000001 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187006 5.5 5:ab27be23:::benchmark_data_smithi062_23645_object51897:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.693406394, 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070397003999999999, 2024-09-12T18:15:22.617 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.618 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.618 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.618 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.618 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187006 2024-09-12T18:15:22.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.619 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:22.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832616+0000", 2024-09-12T18:15:22.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832617+0000", 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9599999999999998e-07 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832620+0000", 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8099999999999999e-06 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832630+0000", 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2529999999999993e-06 2024-09-12T18:15:22.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.832637+0000", 2024-09-12T18:15:22.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.866e-06 2024-09-12T18:15:22.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835192+0000", 2024-09-12T18:15:22.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025558999999999998 2024-09-12T18:15:22.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835290+0000", 2024-09-12T18:15:22.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7355000000000006e-05 2024-09-12T18:15:22.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835381+0000", 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1231999999999997e-05 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899455+0000", 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064073781999999996 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902827+0000", 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003372103 2024-09-12T18:15:22.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.902954+0000", 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012695 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903013+0000", 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8956999999999998e-05 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:187002 5.f e60/53 5:f316353f:::benchmark_data_smithi062_23645_object51893:head v 60'11800, mlcod=60'11795)", 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.692085046999999, 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067384802999999993, 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.628 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833937+0000", 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833938+0000", 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9200000000000002e-07 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833958+0000", 2024-09-12T18:15:22.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0013e-05 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833964+0000", 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8480000000000003e-06 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833969+0000", 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5009999999999998e-06 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834034+0000", 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4665999999999994e-05 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834053+0000", 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9221000000000001e-05 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901272+0000", 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067219152000000004 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901322+0000", 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.011e-05 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187008 5.0 5:09c03dc0:::benchmark_data_smithi062_23645_object51899:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.633 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.692024894999999, 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067136113999999997, 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187008 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833997+0000", 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.833998+0000", 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834002+0000", 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834028+0000", 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5894e-05 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834037+0000", 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1290000000000002e-06 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834094+0000", 2024-09-12T18:15:22.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6916000000000002e-05 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834215+0000", 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121709 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.900976+0000", 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.066761176000000005 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901041+0000", 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4304e-05 2024-09-12T18:15:22.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901133+0000", 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.268e-05 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187011 5.6 5:6422621a:::benchmark_data_smithi062_23645_object51902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.691474649, 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067142944999999996, 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.642 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187011 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834548+0000", 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834553+0000", 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:22.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834562+0000", 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4630000000000007e-06 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834570+0000", 2024-09-12T18:15:22.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834630+0000", 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9957000000000002e-05 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834731+0000", 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100751 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.834834+0000", 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010338199999999999 2024-09-12T18:15:22.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.899126+0000", 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064291736000000002 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901333+0000", 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022070890000000002 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901538+0000", 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020443600000000001 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.901691+0000", 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152817 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187014 5.2 5:45b0919f:::benchmark_data_smithi062_23645_object51905:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.690153206000002, 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.067748596999999994, 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187014 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835869+0000", 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835870+0000", 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.285e-06 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835883+0000", 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2276000000000001e-05 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835893+0000", 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0431999999999999e-05 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835900+0000", 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4659999999999996e-06 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.835956+0000", 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6276000000000001e-05 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898671+0000", 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.062715530000000005 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.898855+0000", 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183284 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903145+0000", 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042906580000000001 2024-09-12T18:15:22.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903556+0000", 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041042800000000001 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903590+0000", 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4440000000000002e-05 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:04.903618+0000", 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7521999999999998e-05 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187379 5.1 5:8498c34a:::benchmark_data_smithi062_23645_object52270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.471716989000001, 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.070729645999999993, 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187379 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054305+0000", 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054306+0000", 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000001e-07 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054309+0000", 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054318+0000", 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6610000000000006e-06 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.054324+0000", 2024-09-12T18:15:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3419999999999996e-06 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058853+0000", 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045287610000000001 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.058946+0000", 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2666999999999999e-05 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.059035+0000", 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8741999999999998e-05 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060615+0000", 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001579942 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124936+0000", 2024-09-12T18:15:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.064320978000000001 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124991+0000", 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5550999999999997e-05 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125035+0000", 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3859999999999997e-05 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187391 5.2 5:4ed2b475:::benchmark_data_smithi062_23645_object52282:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.465265259999999, 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068614100999999997, 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187391 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060757+0000", 2024-09-12T18:15:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060758+0000", 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6799999999999999e-07 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060762+0000", 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.675e-06 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060771+0000", 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060777+0000", 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:15:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060814+0000", 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6397999999999999e-05 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060881+0000", 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7156999999999994e-05 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060937+0000", 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6560000000000001e-05 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126682+0000", 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.065744891 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129287+0000", 2024-09-12T18:15:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026049409999999999 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129333+0000", 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6016999999999997e-05 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129371+0000", 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7796000000000002e-05 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187392 5.2 5:4781a562:::benchmark_data_smithi062_23645_object52283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.465221293999999, 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.073009940999999995, 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187392 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060801+0000", 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7199999999999999e-07 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060804+0000", 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4710000000000001e-06 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060811+0000", 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6540000000000002e-06 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.060815+0000", 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.758e-06 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124774+0000", 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.063958509999999996 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.124908+0000", 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013461199999999999 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.125013+0000", 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104153 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129380+0000", 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043676100000000001 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133738+0000", 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043580950000000002 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133769+0000", 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1032999999999999e-05 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.133811+0000", 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1573000000000003e-05 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:187395 5.a 5:58aaa639:::benchmark_data_smithi062_23645_object52286:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.464643567, 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.068114076999999995, 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 187395 2024-09-12T18:15:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061379+0000", 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4399999999999999e-07 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.061383+0000", 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.72e-06 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122886+0000", 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.061503331000000001 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.122905+0000", 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8029e-05 2024-09-12T18:15:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126609+0000", 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037042030000000001 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.126714+0000", 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010544600000000001 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129385+0000", 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026710869999999999 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129433+0000", 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7567e-05 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:05.129493+0000", 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.995e-05 2024-09-12T18:15:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:22.687 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:22.689 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:22.689 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:22.682+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:22.789 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:22.784+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:22.822 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:22.822 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:22.822 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 0 2024-09-12T18:15:22.822 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:22.837 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:22.890 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:22.886+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:22.993 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:22.986+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:23.013 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:23.013 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:23.013 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:23.013 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:23.013 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:23.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:23.092 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:23.088+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:23.162 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:23.162 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:23.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:23.162 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:23.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.162 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 130.86609137100001, 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.163 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:23.164 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.165 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:23.166 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.167 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.168 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.169 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 119.76579394300001, 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033272283, 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.170 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394458+0000", 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394460+0000", 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.677e-06 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.171 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394467+0000", 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1629999999999999e-06 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394485+0000", 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7694e-05 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394502+0000", 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7323e-05 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.172 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413275+0000", 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018773387999999998 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413392+0000", 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117166 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413572+0000", 2024-09-12T18:15:23.173 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000179252 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.417811+0000", 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0042390839999999997 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427473+0000", 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0096623779999999992 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.174 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427622+0000", 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000148539 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427730+0000", 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000108619 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:23.175 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 119.765730893, 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.176 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:23.177 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.178 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:23.179 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.180 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.181 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 119.764792317, 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.182 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:23.183 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.184 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.185 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.186 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:23.187 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 119.764138606, 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033299213000000001, 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.188 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396113+0000", 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.189 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396115+0000", 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.544e-06 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396139+0000", 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4396000000000002e-05 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396160+0000", 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.092e-05 2024-09-12T18:15:23.190 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.396177+0000", 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6419999999999999e-05 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.403748+0000", 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.007571642 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.191 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405011+0000", 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001262364 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.405362+0000", 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00035113700000000001 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.411149+0000", 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005787515 2024-09-12T18:15:23.192 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429169+0000", 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018019954000000001 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429309+0000", 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014002900000000001 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429413+0000", 2024-09-12T18:15:23.193 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000103292 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 55.904973458999997, 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.194 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.195 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.196 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.197 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:23.198 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.199 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 55.896951082000001, 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.200 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.201 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:23.202 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.203 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:23.204 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.205 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.206 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 55.885365796000002, 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.207 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:23.208 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.209 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:23.212 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.213 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.214 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.998013812, 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.215 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.216 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:23.217 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.218 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.220 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:23.221 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.993039842999998, 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.222 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:23.223 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:23.224 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.225 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:23.226 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:23.227 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.992570914000002, 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.228 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.229 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:23.230 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.231 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:23.232 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.233 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.234 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.990529590000001, 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.235 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:23.236 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.237 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:23.238 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.989621821, 2024-09-12T18:15:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 25.989193618000002, 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.248 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.328663470999999, 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.249 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:23.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:23.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.32641885, 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.255 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:23.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:23.261 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.323885609000001, 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:23.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:23.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.267 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.323427619, 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:23.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:23.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.273 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.098930137, 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.274 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:23.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.280 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 18.098896607, 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:23.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:23.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.283 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:23.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:23.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.286 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.287 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:23.287 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:23.287 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:23.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:23.289 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:23.284+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:23.380 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:15:23.389 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:23.384+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:23.432 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:23.433 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:23.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.433 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5.e7c60819 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.433 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:23.433 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.998717101, 2024-09-12T18:15:23.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99874150900000003, 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:23.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5.c93370d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:23.439 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.0058869189999999, 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059770450000001, 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.440 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:23.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:23.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:23.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:23.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.446 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5.62988519 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.97723998199999995, 2024-09-12T18:15:23.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97736720799999999, 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.448 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:23.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:23.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:23.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5.378990e9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:23.454 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.96274089200000001, 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96290228899999997, 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.455 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5.cd8419d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.97524110200000003, 2024-09-12T18:15:23.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97543696000000002, 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.461 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:23.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:23.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:23.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:23.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.467 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.467 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.467 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5.6512fc9 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.467 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.0673018700000001, 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0675313959999999, 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:23.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.474 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5.a28b4f99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.475 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:23.475 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.054228414, 2024-09-12T18:15:23.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.054498632, 2024-09-12T18:15:23.475 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.475 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.475 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.476 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:23.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.476 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:23.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:23.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:23.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:23.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:23.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:23.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:23.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:23.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:23.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:23.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:23.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:23.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5.aa606d19 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.485 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:23.485 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.96140699399999996, 2024-09-12T18:15:23.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96172593100000003, 2024-09-12T18:15:23.485 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.485 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.485 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.486 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:23.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.487 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:23.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:23.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:23.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:23.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:23.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:23.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:23.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:23.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:23.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:23.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:23.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:23.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:23.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:23.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5.2a8a2589 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.0672669889999999, 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.067628636, 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.494 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5.bf4b5279 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.96103963800000003, 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96143637900000001, 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:23.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:23.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5.8c7ad2b9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:23.502 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94337325800000005, 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.94380354300000002, 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:23.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:23.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5.628535a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.94095328300000003, 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.94141667200000001, 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5.79b63d39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.0114984739999999, 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011995022, 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:23.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5.8458bf49 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.0422302999999999, 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0427755969999999, 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.515 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:23.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5.50594f79 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.95391465799999997, 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.95451387600000004, 2024-09-12T18:15:23.519 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:23.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5.19b5f1d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:23.523 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.95337223199999999, 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.95401805399999995, 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for peered", 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:23.527 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 16 2024-09-12T18:15:23.528 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:23.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:23.529 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:23.522+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:23.631 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:23.626+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:23.732 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:23.726+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:23.743 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:23.743 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:23.743 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:23.743 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:23.743 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:23.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:23.833 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:23.828+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:23.933 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:23.930+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:23.978 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:23.978 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 35.860277754000002, 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:23.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 35.846876647000002, 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.985 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:23.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:23.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 35.840302964999999, 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.990 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:23.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:23.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:23.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 35.840191050000001, 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:23.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:23.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:23.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:23.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:23.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:24.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.612536916, 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:24.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:24.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.6125020349999999, 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.007 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:24.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:24.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:24.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:24.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5994634599999999, 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.014 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:24.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:24.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:24.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5874653460000001, 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.021 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:24.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5567335199999999, 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.028 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:24.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:24.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:24.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:24.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.037 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5511219650000001, 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.038 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:24.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:24.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5439521470000002, 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.045 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:24.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:24.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:24.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5224750280000001, 2024-09-12T18:15:24.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:24.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.059 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.520476148, 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:24.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.066 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.507975938, 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:24.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:24.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:24.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.073 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.50664204, 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:24.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.080 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.5062746840000001, 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:24.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.4991497040000001, 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.088 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:24.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.4986072779999999, 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:24.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:24.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.101 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.488608304, 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.102 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:24.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:24.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.486188329, 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:24.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:24.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:24.115 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:24.117 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:24.117 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:24.110+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:24.218 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:24.216+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 0 2024-09-12T18:15:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:24.287 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:24.336 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:24.332+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:24.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:24.418 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:24.416+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:24.482 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:24.482 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:24.482 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:24.482 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:24.482 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:24.497 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:24.502 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:24.514 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:24.518 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:24.518 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:24.519 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:24.514+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:24.620 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:24.614+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:24.694 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:24.695 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:24.716 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:24.761 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:24.758+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:24.823 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:24.820+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:24.870 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:24.871 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:24.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:24.933 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:24.930+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:25.025 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:25.020+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:25.084 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:25.084 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:25.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:25.125 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:25.120+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:25.226 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:25.220+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:25.273 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:25.273 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:25.293 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:25.327 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:25.322+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:25.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:15:25.428 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:25.422+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:25.443 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T18:15:25.453 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:25.453 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:25.468 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:25.529 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:25.524+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:25.554 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-09-12T18:15:25.555 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-09-12T18:15:25.613 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:25.613 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:25.630 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:25.624+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:25.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:25.655 DEBUG:teuthology.orchestra.console.smithi129:Waiting for login prompt 2024-09-12T18:15:25.656 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi129 2024-09-12T18:15:25.732 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:25.726+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:25.825 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:25.825 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:25.831 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:25.826+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:25.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:25.932 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:25.926+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:26.000 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:26.000 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:26.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:26.033 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:26.028+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:26.134 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:26.128+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:26.235 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:26.232+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:26.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:26.336 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:26.330+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:26.392 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:26.392 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:26.395 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:15:26.413 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:26.458 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:26.454+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:26.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:26.538 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:26.536+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:26.576 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:26.576 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:26.594 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:26.638 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:26.634+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:26.659 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:26.679 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:26.697 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:26.697 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:26.700 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:26.701 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:26.739 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:26.736+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:26.788 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:26.788 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:26.788 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:26.788 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:26.788 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:26.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:26.840 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:26.834+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:26.942 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:26.936+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:27.006 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 134.710559499, 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:27.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:27.012 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.013 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 123.610199021, 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:27.014 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.015 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.016 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:27.017 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:27.018 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.019 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 123.609260445, 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:27.020 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:27.021 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.022 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:27.023 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.024 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:27.025 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 59.749441587, 2024-09-12T18:15:27.026 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.027 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:27.028 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.029 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:27.030 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.031 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:27.032 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 59.741419209999997, 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.033 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.034 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:27.035 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:27.036 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 59.729833923999998, 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.039 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:27.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.842481939999999, 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.045 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:27.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:27.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:27.051 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.837507971000001, 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:27.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:27.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.057 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.837039042000001, 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.058 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.834997718, 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:27.064 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:27.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.834089948999999, 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.069 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:27.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:27.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:27.074 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 29.833661746000001, 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:27.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:27.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:27.079 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.173131599000001, 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:27.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:27.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.085 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.170886977999999, 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.086 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:27.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:27.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.092 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.168353737, 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.093 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:27.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:27.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:27.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 22.167895746999999, 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.099 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:27.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:27.107 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.943398264999999, 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.108 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:27.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.943364734999999, 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:27.114 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:27.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:27.120 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.550410748, 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229435 5.9 e70/69 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head v 70'14348, mlcod=0'0)", 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 3.5493508170000001, 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033464307999999998, 2024-09-12T18:15:27.125 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455371+0000", 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.074e-06 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455383+0000", 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1579e-05 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455411+0000", 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7682999999999999e-05 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455424+0000", 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3186999999999999e-05 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474182+0000", 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018758200999999999 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474239+0000", 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6784999999999999e-05 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488781+0000", 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014541973 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488834+0000", 2024-09-12T18:15:27.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2825999999999999e-05 2024-09-12T18:15:27.130 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.130 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.130 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.130 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.130 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.130 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:27.132 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:27.132 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:27.126+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:27.232 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:27.228+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:27.290 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238172 5.1 5:81bb2ad6:::benchmark_data_smithi062_23645_object103063:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.279500+0000", 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010565560999999999, 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010589252, 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238172 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.279500+0000", 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.279500+0000", 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.279500+0000", 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4300000000000002e-07 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.279504+0000", 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.162e-06 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.279513+0000", 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5680000000000005e-06 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.279519+0000", 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9479999999999996e-06 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282690+0000", 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003171274 2024-09-12T18:15:27.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282801+0000", 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110562 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282923+0000", 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012244 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238176 5.1 5:8cd85f02:::benchmark_data_smithi062_23645_object103067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.282435+0000", 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0076301779999999996, 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.007709718, 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238176 2024-09-12T18:15:27.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282435+0000", 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282435+0000", 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282436+0000", 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8400000000000002e-07 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282440+0000", 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.138e-06 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282449+0000", 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2820000000000002e-06 2024-09-12T18:15:27.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282456+0000", 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9689999999999997e-06 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284533+0000", 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00207683 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284646+0000", 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112685 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284867+0000", 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221346 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238182 5.6 5:62d39b81:::benchmark_data_smithi062_23645_object103073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.300 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.284794+0000", 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0052710129999999997, 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053870790000000003, 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238182 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284794+0000", 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284794+0000", 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284795+0000", 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.23e-07 2024-09-12T18:15:27.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284799+0000", 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1300000000000003e-06 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284809+0000", 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5589999999999994e-06 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284815+0000", 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2940000000000002e-06 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284872+0000", 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6747999999999999e-05 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.284988+0000", 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115961 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.285085+0000", 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7163999999999993e-05 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288836+0000", 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037511179999999999 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238185 5.6 5:68af3bc1:::benchmark_data_smithi062_23645_object103076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.287218+0000", 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028467520000000001, 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029999599999999999, 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238185 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.306 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287218+0000", 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287218+0000", 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287220+0000", 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287225+0000", 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6160000000000004e-06 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287234+0000", 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5780000000000005e-06 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287242+0000", 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3379999999999999e-06 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287295+0000", 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3009e-05 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287398+0000", 2024-09-12T18:15:27.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103156 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287496+0000", 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8072000000000006e-05 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.289114+0000", 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001618286 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.310 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238186 5.9 5:97fd5525:::benchmark_data_smithi062_23645_object103077:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.287514+0000", 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0025508869999999999, 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027694680000000002, 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.311 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238186 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287514+0000", 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287514+0000", 2024-09-12T18:15:27.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287515+0000", 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4099999999999997e-07 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287519+0000", 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.647e-06 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287527+0000", 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6449999999999994e-06 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287533+0000", 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.592e-06 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287568+0000", 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4845000000000003e-05 2024-09-12T18:15:27.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287636+0000", 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8248000000000001e-05 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287705+0000", 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8524999999999999e-05 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238169 5.9 5:92544714:::benchmark_data_smithi062_23645_object103060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.278481+0000", 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.011584351999999999, 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011868221999999999, 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238169 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.278481+0000", 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.278481+0000", 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.278481+0000", 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4200000000000001e-07 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.278484+0000", 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2309999999999999e-06 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.278491+0000", 2024-09-12T18:15:27.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0099999999999998e-06 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.278496+0000", 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1089999999999997e-06 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282556+0000", 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040607519999999999 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282670+0000", 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113632 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.282779+0000", 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010844399999999999 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287403+0000", 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046242109999999996 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.320 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238188 5.9 5:9a86fb2d:::benchmark_data_smithi062_23645_object103079:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.287564+0000", 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002500763, 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028617920000000002, 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.321 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238188 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287564+0000", 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287564+0000", 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287565+0000", 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8999999999999998e-07 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287567+0000", 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.875e-06 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287573+0000", 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1539999999999999e-06 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.287577+0000", 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.155e-06 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.289982+0000", 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024052919999999998 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.290070+0000", 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7695999999999995e-05 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.290153+0000", 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.352e-05 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:238189 5.1 5:88ddd17e:::benchmark_data_smithi062_23645_object103080:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:27.288940+0000", 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0011257179999999999, 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015518629999999999, 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 238189 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.326 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288940+0000", 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288940+0000", 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288941+0000", 2024-09-12T18:15:27.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.032e-06 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288945+0000", 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1160000000000001e-06 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288955+0000", 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0421000000000001e-05 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.288962+0000", 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0380000000000002e-06 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.289046+0000", 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3732000000000004e-05 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.289154+0000", 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107835 2024-09-12T18:15:27.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:27.289238+0000", 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4699999999999999e-05 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 8 2024-09-12T18:15:27.330 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:27.331 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:27.333 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:27.326+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:27.434 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:27.428+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:27.498 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:27.499 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:27.499 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:27.499 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:27.499 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:27.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:27.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2024-09-12T18:15:27.534 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:27.532+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:27.635 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:27.632+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:27.684 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.565294940999998, 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:27.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:27.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:27.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:27.689 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.551893833999998, 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:27.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:27.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:27.694 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.545320152000002, 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:27.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:27.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.699 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.545208236999997, 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.700 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:27.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:27.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:27.705 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.317554103, 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.710 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.3175192219999996, 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:27.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.3044806470000001, 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.719 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:27.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2924825330000003, 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:27.726 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:27.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:27.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.261750707, 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.733 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:27.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:27.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2561391520000003, 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.740 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:27.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:27.747 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2489693339999999, 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:27.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:27.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2274922149999998, 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:27.755 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:27.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:27.762 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2254933350000004, 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:27.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:27.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2129931249999997, 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.770 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:27.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:27.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2116592270000002, 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.777 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:27.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:27.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.783 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2112918710000002, 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.784 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:27.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:27.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.790 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2041668909999999, 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.791 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:27.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:27.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.797 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.2036244649999999, 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.798 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.805 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.1936254909999997, 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:27.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.812 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.1912055160000001, 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.813 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:27.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:27.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:27.819 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:27.820 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:27.821 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:27.822 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:27.814+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:27.921 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:27.916+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239822 5.5 e71/21 5:a081fd5b:::benchmark_data_smithi062_23645_object104713:head v 71'15180, mlcod=71'15178)", 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.968915+0000", 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000496825, 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00051756700000000003, 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968915+0000", 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968915+0000", 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.970 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968915+0000", 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968918+0000", 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.796e-06 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.971 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968923+0000", 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2009999999999998e-06 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968928+0000", 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0950000000000003e-06 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968967+0000", 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9144999999999999e-05 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.972 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968981+0000", 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3123e-05 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239823 5.3 e71/53 5:c33909b7:::benchmark_data_smithi062_23645_object104714:head v 71'15154, mlcod=71'15152)", 2024-09-12T18:15:27.973 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.968940+0000", 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00047213099999999998, 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00052638100000000003, 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968940+0000", 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.974 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968940+0000", 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968940+0000", 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6800000000000002e-07 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968953+0000", 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.361e-05 2024-09-12T18:15:27.975 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968962+0000", 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3610000000000001e-06 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968967+0000", 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.976 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969012+0000", 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5571999999999997e-05 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969032+0000", 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9780999999999999e-05 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.977 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239826 5.1 e71/49 5:88ec5cca:::benchmark_data_smithi062_23645_object104717:head v 71'14976, mlcod=71'14973)", 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.968979+0000", 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000432686, 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00051706199999999999, 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.978 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968979+0000", 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968979+0000", 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968979+0000", 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2599999999999998e-07 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.979 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968983+0000", 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2820000000000001e-06 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968989+0000", 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2670000000000003e-06 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968993+0000", 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6280000000000004e-06 2024-09-12T18:15:27.980 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969029+0000", 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6019999999999997e-05 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969045+0000", 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5727999999999999e-05 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.981 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239827 5.3 e71/53)", 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.969189+0000", 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000222909, 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033202600000000002, 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969189+0000", 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.982 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969189+0000", 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969189+0000", 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.58e-07 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.983 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969192+0000", 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.157e-06 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969199+0000", 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2139999999999999e-06 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969205+0000", 2024-09-12T18:15:27.984 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3469999999999998e-06 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239825 5.5 e71/21)", 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.969243+0000", 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00016895500000000001, 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00029920499999999998, 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.985 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969243+0000", 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969243+0000", 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.986 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969243+0000", 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9900000000000002e-07 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969246+0000", 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9689999999999999e-06 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969253+0000", 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:15:27.987 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969258+0000", 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6809999999999997e-06 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.988 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:239813 5.d 5:b2bafe57:::benchmark_data_smithi062_23645_object104704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.964236+0000", 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0051757039999999997, 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053313249999999996, 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.989 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 239813 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964236+0000", 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964236+0000", 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.990 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964237+0000", 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3799999999999997e-07 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964240+0000", 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3919999999999999e-06 2024-09-12T18:15:27.991 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964250+0000", 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.815e-06 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964255+0000", 2024-09-12T18:15:27.992 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964306+0000", 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.109e-05 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964442+0000", 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013647 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.993 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:239816 5.7 5:e3ca0a5d:::benchmark_data_smithi062_23645_object104707:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.964583+0000", 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004828649, 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0050178260000000004, 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:27.994 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 239816 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964583+0000", 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964583+0000", 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.995 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964584+0000", 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1399999999999997e-07 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964586+0000", 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.469e-06 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964592+0000", 2024-09-12T18:15:27.996 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9909999999999999e-06 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964596+0000", 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964628+0000", 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2042999999999998e-05 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:27.997 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964704+0000", 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5937000000000002e-05 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964764+0000", 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0587000000000001e-05 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.998 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.969427+0000", 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0046623929999999999 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239817 5.1 e71/49 5:8cc9f44c:::benchmark_data_smithi062_23645_object104708:head v 71'14975, mlcod=71'14971)", 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.964906+0000", 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.004505355, 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.004730148, 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:27.999 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964906+0000", 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964906+0000", 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.000 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964907+0000", 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0200000000000002e-07 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964910+0000", 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3009999999999998e-06 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964919+0000", 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.473e-06 2024-09-12T18:15:28.001 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964924+0000", 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6810000000000003e-06 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964979+0000", 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4598999999999997e-05 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.965004+0000", 2024-09-12T18:15:28.002 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4960000000000002e-05 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239818 5.c e71/53 5:33781c7b:::benchmark_data_smithi062_23645_object104709:head v 71'14836, mlcod=71'14833)", 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.964960+0000", 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0044520200000000001, 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0047061079999999996, 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.003 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964960+0000", 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964960+0000", 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964960+0000", 2024-09-12T18:15:28.004 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.82e-07 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964963+0000", 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2169999999999999e-06 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964971+0000", 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8320000000000006e-06 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.005 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.964976+0000", 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7500000000000003e-06 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.965018+0000", 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1814999999999999e-05 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.965039+0000", 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.1297999999999998e-05 2024-09-12T18:15:28.006 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:239819 5.c e71/53 5:394b71a8:::benchmark_data_smithi062_23645_object104710:head v 71'14837, mlcod=71'14834)", 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:27.968864+0000", 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00054730999999999996, 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00082784199999999997, 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.007 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968864+0000", 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968864+0000", 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.008 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968865+0000", 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5999999999999999e-07 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968882+0000", 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7053000000000001e-05 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.009 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968891+0000", 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7050000000000005e-06 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968897+0000", 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1850000000000001e-06 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968937+0000", 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0643999999999999e-05 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.010 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:27.968960+0000", 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2643999999999999e-05 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 10 2024-09-12T18:15:28.011 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:28.012 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:28.055 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:28.052+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:28.125 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:28.122+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:28.206 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:28.206 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:28.206 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:28.206 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:28.206 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:28.227 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:28.228 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:28.224+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:28.328 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:28.322+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:28.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 136.13019896099999, 2024-09-12T18:15:28.425 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.426 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.427 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.428 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.428 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:28.428 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:28.428 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.428 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.429 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.430 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:28.431 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:28.432 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.433 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 125.02983848300001, 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.434 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.435 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:28.436 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.437 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:28.438 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:28.439 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.439 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.439 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.439 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:28.439 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:28.440 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 125.028899907, 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.441 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:28.442 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.443 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.444 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:28.445 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.446 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.169081048999999, 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:28.447 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.448 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.449 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:28.450 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:28.451 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.452 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.453 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.161058672000003, 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:28.454 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.455 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.456 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.457 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.458 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.459 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 61.149473385999997, 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.460 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.461 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:28.462 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.463 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:28.464 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.466 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.262121401999998, 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.467 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.468 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:28.469 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.470 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.471 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:28.472 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.257147433, 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.473 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.475 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:28.476 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.477 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.478 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.256678504, 2024-09-12T18:15:28.479 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:28.480 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.481 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:28.482 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:28.483 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:28.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.485 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.25463718, 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.486 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.487 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:28.488 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.489 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.253729410999998, 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.491 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.492 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.493 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.494 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.495 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.253301208, 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.496 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.497 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:28.498 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.499 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.500 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.592771061000001, 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:28.502 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.503 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:28.504 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.505 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.506 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.590526440000001, 2024-09-12T18:15:28.507 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:28.508 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.509 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.510 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:28.511 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.512 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:28.513 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.587993199, 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.514 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.515 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:28.516 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.517 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:28.518 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.519 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.587535208999999, 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.520 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.521 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.522 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:28.523 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.524 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:28.525 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.363037726999998, 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.526 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.527 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:28.528 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.529 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:28.530 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.531 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 23.363004196999999, 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.532 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.533 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.534 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.536 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.537 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:28.538 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.539 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.9700502100000001, 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.540 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:28.542 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.543 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.544 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229435 5.9 e70/69 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head v 70'14348, mlcod=0'0)", 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 4.9689902789999998, 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033464307999999998, 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.545 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455371+0000", 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.074e-06 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455383+0000", 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1579e-05 2024-09-12T18:15:28.546 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455411+0000", 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7682999999999999e-05 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455424+0000", 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3186999999999999e-05 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:28.547 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474182+0000", 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018758200999999999 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474239+0000", 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6784999999999999e-05 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488781+0000", 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014541973 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:28.548 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488834+0000", 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2825999999999999e-05 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:28.549 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:28.551 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:28.548+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:28.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:28.651 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:28.648+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:28.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:28.716 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:28.716 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:28.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.716 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241659 5.2 5:4e58d055:::benchmark_data_smithi062_23645_object106550:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.716 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.712224+0000", 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0034057250000000001, 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003427107, 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241659 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712224+0000", 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712224+0000", 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712225+0000", 2024-09-12T18:15:28.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9500000000000001e-07 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712229+0000", 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.427e-06 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712239+0000", 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0635999999999999e-05 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712247+0000", 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3119999999999996e-06 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712299+0000", 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2744000000000002e-05 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712403+0000", 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104003 2024-09-12T18:15:28.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712510+0000", 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010632 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714348+0000", 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018383220000000001 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.721 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241660 5.5 5:af93c711:::benchmark_data_smithi062_23645_object106551:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.713066+0000", 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0025643419999999998, 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026600439999999999, 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.722 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241660 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713066+0000", 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713066+0000", 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713067+0000", 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3600000000000002e-07 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713073+0000", 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1210000000000003e-06 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713085+0000", 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1909000000000001e-05 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713091+0000", 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6019999999999996e-06 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713151+0000", 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9562000000000003e-05 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713269+0000", 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118476 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713376+0000", 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010636700000000001 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241662 5.c 5:351dcd88:::benchmark_data_smithi062_23645_object106553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.713489+0000", 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0021407269999999998, 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022977050000000001, 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241662 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.727 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713489+0000", 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713489+0000", 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713490+0000", 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2200000000000003e-07 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713494+0000", 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5329999999999999e-06 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713503+0000", 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7649999999999999e-06 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713508+0000", 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8889999999999999e-06 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713590+0000", 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1425000000000001e-05 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713693+0000", 2024-09-12T18:15:28.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010272600000000001 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713794+0000", 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101884 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241663 5.0 5:0c730bf4:::benchmark_data_smithi062_23645_object106554:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.713874+0000", 2024-09-12T18:15:28.731 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001756332, 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019745090000000002, 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241663 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713874+0000", 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713874+0000", 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713875+0000", 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3e-07 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713878+0000", 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4089999999999999e-06 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713886+0000", 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0730000000000005e-06 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713891+0000", 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5669999999999996e-06 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715464+0000", 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001572899 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715737+0000", 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027357400000000001 2024-09-12T18:15:28.735 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241665 5.9 5:98ee275b:::benchmark_data_smithi062_23645_object106556:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.714418+0000", 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0012126190000000001, 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001484427, 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241665 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714418+0000", 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714418+0000", 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714418+0000", 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5000000000000002e-07 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714422+0000", 2024-09-12T18:15:28.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3400000000000002e-06 2024-09-12T18:15:28.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714428+0000", 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714433+0000", 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6079999999999998e-06 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714470+0000", 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7521000000000002e-05 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714557+0000", 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6508999999999995e-05 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714632+0000", 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4977999999999999e-05 2024-09-12T18:15:28.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241666 5.0 5.9393ce50 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.714668+0000", 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00096179200000000005, 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00129306, 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.742 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241666 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714668+0000", 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714668+0000", 2024-09-12T18:15:28.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714669+0000", 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.09e-07 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714673+0000", 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714681+0000", 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5809999999999997e-06 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714688+0000", 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5130000000000002e-06 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.745 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:241664 5.7 e71/21 5:e1166aae:::benchmark_data_smithi062_23645_object106555:head v 71'14892, mlcod=71'14889)", 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.714929+0000", 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00070148300000000003, 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010826309999999999, 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714929+0000", 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714929+0000", 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714929+0000", 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7700000000000004e-07 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714933+0000", 2024-09-12T18:15:28.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8199999999999998e-06 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714942+0000", 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2730000000000002e-06 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714947+0000", 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4770000000000002e-06 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.714988+0000", 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1010000000000002e-05 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715004+0000", 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6353000000000001e-05 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241667 5.3 5:c3e854d7:::benchmark_data_smithi062_23645_object106558:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.715430+0000", 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000199839, 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000625619, 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241667 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.750 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715430+0000", 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715430+0000", 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715431+0000", 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3200000000000004e-07 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715435+0000", 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4580000000000002e-06 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715443+0000", 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5399999999999996e-06 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715449+0000", 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6550000000000001e-06 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715496+0000", 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7685000000000002e-05 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715633+0000", 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013642999999999999 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.715728+0000", 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5056000000000006e-05 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241647 5.0 5:01132648:::benchmark_data_smithi062_23645_object106538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.754 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.707641+0000", 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0079895039999999997, 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084507109999999996, 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241647 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707641+0000", 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707641+0000", 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707641+0000", 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7000000000000005e-07 2024-09-12T18:15:28.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707644+0000", 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6479999999999999e-06 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707658+0000", 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3967e-05 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707662+0000", 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2289999999999997e-06 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707694+0000", 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2098000000000003e-05 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.707776+0000", 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2089000000000006e-05 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.758 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241649 5.0 5:03551405:::benchmark_data_smithi062_23645_object106540:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.708118+0000", 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0075119849999999997, 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080038639999999994, 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241649 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.708118+0000", 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.708118+0000", 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.708119+0000", 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5900000000000005e-07 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.708123+0000", 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9910000000000004e-06 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.708132+0000", 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6780000000000006e-06 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.708138+0000", 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4180000000000002e-06 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709250+0000", 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001111281 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709364+0000", 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114201 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241651 5.c 5:3efda048:::benchmark_data_smithi062_23645_object106542:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.709674+0000", 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0059561909999999996, 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064788670000000001, 2024-09-12T18:15:28.763 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241651 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709674+0000", 2024-09-12T18:15:28.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709674+0000", 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709675+0000", 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709680+0000", 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.896e-06 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709687+0000", 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0369999999999997e-06 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709693+0000", 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8719999999999999e-06 2024-09-12T18:15:28.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709793+0000", 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9437000000000004e-05 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.711817+0000", 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020245770000000001 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:28.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.711948+0000", 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130992 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241652 5.0 5:093790be:::benchmark_data_smithi062_23645_object106543:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.709708+0000", 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0059219229999999999, 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064772060000000001, 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.768 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241652 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709708+0000", 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709708+0000", 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709709+0000", 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8100000000000003e-07 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709711+0000", 2024-09-12T18:15:28.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5000000000000002e-06 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709718+0000", 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0430000000000002e-06 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709723+0000", 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713798+0000", 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040743990000000002 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.713917+0000", 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118789 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:241654 5.8 5:1af850c5:::benchmark_data_smithi062_23645_object106545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:28.709837+0000", 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0057932030000000002, 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063784169999999999, 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 241654 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:28.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709837+0000", 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709837+0000", 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709838+0000", 2024-09-12T18:15:28.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8899999999999998e-07 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709841+0000", 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5389999999999999e-06 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709849+0000", 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4220000000000003e-06 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.709856+0000", 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.25e-06 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712303+0000", 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024471390000000001 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:28.712371+0000", 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7786000000000005e-05 2024-09-12T18:15:28.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.777 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:28.777 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.777 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:28.777 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:28.777 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 13 2024-09-12T18:15:28.777 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:28.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:28.779 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:28.774+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:28.852 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:28.852 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:28.872 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:28.877 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:28.878 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:28.879 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:28.874+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:28.980 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:28.976+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:28.981 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:28.981 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:29.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:29.089 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:29.086+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:29.182 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.176+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.204 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:29.205 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:29.226 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:29.282 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.280+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.383 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:29.383 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:29.383 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.380+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.402 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:29.410 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:15:29.495 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.492+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.587 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.580+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.601 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:29.601 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:29.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:29.715 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.712+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.787 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.784+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.812 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:29.812 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:29.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:29.887 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.884+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:29.985 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:29.985 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:29.988 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:29.984+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:30.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:30.090 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:30.086+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:30.163 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:30.163 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:30.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:30.190 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:30.188+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:30.292 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:30.288+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:30.387 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:30.387 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:30.392 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:30.388+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:30.408 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:30.493 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:30.490+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:30.559 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:30.560 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:30.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:30.596 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:30.590+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:30.696 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:30.690+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:30.722 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:30.723 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:30.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:30.797 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:30.792+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:30.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:30.896 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:30.896 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:30.897 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:30.894+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:30.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:30.998 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:30.992+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:31.039 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:31.040 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:31.057 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:31.061 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:31.061 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:31.079 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:31.079 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:31.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.079 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "pg_backfill(progress 5.f e 72/72 lb 5:fbc4f3ea:::benchmark_data_smithi062_23645_object130134:head)", 2024-09-12T18:15:31.079 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.075740+0000", 2024-09-12T18:15:31.079 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0023722230000000001, 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023908699999999998, 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075740+0000", 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075740+0000", 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075740+0000", 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2899999999999999e-07 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075747+0000", 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7510000000000002e-06 2024-09-12T18:15:31.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075754+0000", 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3089999999999998e-06 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075759+0000", 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247330 5.9 5:9cdc9205:::benchmark_data_smithi062_23645_object112221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.076142+0000", 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0019701129999999999, 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020373879999999998, 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247330 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.083 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076142+0000", 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076142+0000", 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076143+0000", 2024-09-12T18:15:31.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076146+0000", 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8430000000000003e-06 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076158+0000", 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1653e-05 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076165+0000", 2024-09-12T18:15:31.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.472e-06 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077435+0000", 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012706130000000001 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077544+0000", 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010907400000000001 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077684+0000", 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013990699999999999 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:247331 5.f e72/53 5:f46bd9a9:::benchmark_data_smithi062_23645_object112222:head v 72'15611, mlcod=72'15607)", 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.076598+0000", 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001514271, 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016449959999999999, 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076598+0000", 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076598+0000", 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076598+0000", 2024-09-12T18:15:31.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5499999999999998e-07 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076606+0000", 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6159999999999996e-06 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076614+0000", 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4319999999999999e-06 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076620+0000", 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6869999999999999e-06 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077165+0000", 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054527799999999995 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077183+0000", 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7999000000000002e-05 2024-09-12T18:15:31.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247332 5.b 5:d18331ea:::benchmark_data_smithi062_23645_object112223:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.076726+0000", 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0013855510000000001, 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015661869999999999, 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247332 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076726+0000", 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076726+0000", 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076727+0000", 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076731+0000", 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7740000000000002e-06 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076740+0000", 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2609999999999999e-06 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076747+0000", 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2320000000000004e-06 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076796+0000", 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8908e-05 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076923+0000", 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012644300000000001 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247333 5.2 5:4930ecf7:::benchmark_data_smithi062_23645_object112224:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.077424+0000", 2024-09-12T18:15:31.095 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00068773800000000002, 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092705900000000004, 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247333 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077424+0000", 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077424+0000", 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077425+0000", 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.23e-07 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077429+0000", 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.721e-06 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077436+0000", 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8879999999999997e-06 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077443+0000", 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.207e-06 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077515+0000", 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2113000000000006e-05 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077676+0000", 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016081600000000001 2024-09-12T18:15:31.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077800+0000", 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124757 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247334 5.0 5.36637f70 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.077569+0000", 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00054269500000000005, 2024-09-12T18:15:31.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084473199999999995, 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247334 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077569+0000", 2024-09-12T18:15:31.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077569+0000", 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077570+0000", 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077573+0000", 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6689999999999999e-06 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077580+0000", 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9460000000000001e-06 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.077586+0000", 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2530000000000004e-06 2024-09-12T18:15:31.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078416+0000", 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00083028300000000002 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247336 5.b 5.6871ce1b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.078025+0000", 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7254000000000002e-05, 2024-09-12T18:15:31.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00044200799999999997, 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247336 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078025+0000", 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078025+0000", 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078026+0000", 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7499999999999998e-07 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078029+0000", 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8160000000000004e-06 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078038+0000", 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7730000000000005e-06 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078044+0000", 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2450000000000003e-06 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247337 5.2 5.a36f6052 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.078221+0000", 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998908, 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029477300000000002, 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.108 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247337 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078221+0000", 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078221+0000", 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078222+0000", 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078225+0000", 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9330000000000001e-06 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078233+0000", 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4989999999999994e-06 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078239+0000", 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5210000000000002e-06 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.111 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247338 5.3 5:cf226801:::benchmark_data_smithi062_23645_object112229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.078258+0000", 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998536, 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000311787, 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247338 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.112 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078258+0000", 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078258+0000", 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078259+0000", 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3399999999999998e-07 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078261+0000", 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1670000000000002e-06 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078267+0000", 2024-09-12T18:15:31.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3679999999999998e-06 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078272+0000", 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6720000000000003e-06 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078484+0000", 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021253999999999999 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:247335 5.7 e72/21)", 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.078308+0000", 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998035, 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031704600000000003, 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078308+0000", 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078308+0000", 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078309+0000", 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6899999999999997e-07 2024-09-12T18:15:31.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078318+0000", 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4989999999999994e-06 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078326+0000", 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0620000000000001e-06 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078332+0000", 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.925e-06 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247340 5.1 5.b699dc1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.078432+0000", 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.99968, 2024-09-12T18:15:31.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023679699999999999, 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247340 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.120 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078432+0000", 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078432+0000", 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078432+0000", 2024-09-12T18:15:31.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2799999999999995e-07 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078435+0000", 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9229999999999998e-06 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078443+0000", 2024-09-12T18:15:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7680000000000008e-06 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.078448+0000", 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4840000000000003e-06 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:247310 5.f e72/53 5:f49cbcd0:::benchmark_data_smithi062_23645_object112201:head v 72'15609, mlcod=72'15606)", 2024-09-12T18:15:31.123 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.070892+0000", 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0072199839999999996, 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078287110000000004, 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.070892+0000", 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.070892+0000", 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.070892+0000", 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4000000000000001e-07 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.070897+0000", 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9010000000000002e-06 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.070907+0000", 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6709999999999994e-06 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.070913+0000", 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4180000000000002e-06 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.071081+0000", 2024-09-12T18:15:31.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000167706 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.071092+0000", 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1204e-05 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247327 5.0 5:0ccb82b7:::benchmark_data_smithi062_23645_object112218:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.127 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.072924+0000", 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0051876730000000003, 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058519640000000003, 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247327 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.072924+0000", 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.072924+0000", 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.072925+0000", 2024-09-12T18:15:31.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0599999999999999e-07 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.072929+0000", 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9700000000000001e-06 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.072943+0000", 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3512999999999999e-05 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.072949+0000", 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7800000000000003e-06 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074967+0000", 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020179199999999999 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.075095+0000", 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012734000000000001 2024-09-12T18:15:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:247312 5.f e72/53 5:faa7c661:::benchmark_data_smithi062_23645_object112203:head v 72'15610, mlcod=72'15607)", 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.073136+0000", 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0049761090000000003, 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056991689999999996, 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073136+0000", 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073136+0000", 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073136+0000", 2024-09-12T18:15:31.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3300000000000001e-07 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073142+0000", 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073156+0000", 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4491999999999999e-05 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073163+0000", 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5880000000000003e-06 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073208+0000", 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5278999999999998e-05 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.073227+0000", 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9094999999999999e-05 2024-09-12T18:15:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:247329 5.0 5:0d908a4e:::benchmark_data_smithi062_23645_object112220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.074507+0000", 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.003604356, 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043826769999999998, 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.136 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 247329 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074507+0000", 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074507+0000", 2024-09-12T18:15:31.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074508+0000", 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9399999999999993e-07 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074512+0000", 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4460000000000001e-06 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074522+0000", 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0254999999999999e-05 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074528+0000", 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6250000000000004e-06 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076575+0000", 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020471360000000002 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.076684+0000", 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109052 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:247328 5.7 e72/21 5:ef96e0ed:::benchmark_data_smithi062_23645_object112219:head v 72'15263, mlcod=72'15261)", 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:31.074592+0000", 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0035199710000000002, 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043589400000000004, 2024-09-12T18:15:31.140 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074592+0000", 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074592+0000", 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074592+0000", 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0900000000000002e-07 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074596+0000", 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0629999999999999e-06 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074605+0000", 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5390000000000007e-06 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074610+0000", 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7870000000000001e-06 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074890+0000", 2024-09-12T18:15:31.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028032099999999999 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:31.074901+0000", 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0862e-05 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 16 2024-09-12T18:15:31.144 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:31.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:31.146 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:31.140+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:31.246 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:31.242+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:31.313 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:31.313 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:31.313 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:31.313 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:31.313 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:31.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:31.347 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:31.344+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:31.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:15:31.448 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:31.442+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 43.429141721000001, 2024-09-12T18:15:31.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:31.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.552 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 43.415740614000001, 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:31.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:31.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 43.409166931999998, 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:31.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:31.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.562 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 43.409055017, 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:31.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:31.567 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1814008830000002, 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:31.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:31.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.574 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:31.582 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1813660020000007, 2024-09-12T18:15:31.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:31.582 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:31.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:31.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:31.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:31.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:31.590 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1683274269999995, 2024-09-12T18:15:31.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:31.592 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.592 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.592 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:31.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:31.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:31.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1563293130000005, 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:31.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:31.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:31.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:31.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:31.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:31.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:31.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1255974870000003, 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:31.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:31.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1199859320000005, 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:31.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:31.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:31.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:31.622 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1128161139999992, 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:31.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:31.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0913389949999992, 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:31.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:31.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0893401150000006, 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:31.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:31.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.643 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0768399049999999, 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:31.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:31.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:31.650 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0755060069999995, 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:31.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:31.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0751386509999996, 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:31.657 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:31.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:31.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:31.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0680136709999992, 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:31.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:31.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:31.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0674712450000001, 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:31.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:31.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.677 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.057472271, 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:31.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:31.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:31.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.684 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0550522959999995, 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:31.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:31.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:31.693 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:31.693 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:31.686+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:31.793 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:31.788+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:31.844 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:249190 5.d 5:b61f4be6:::benchmark_data_smithi062_23645_object114081:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.842000+0000", 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0029712649999999998, 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029953890000000002, 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.845 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 249190 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842000+0000", 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842000+0000", 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842001+0000", 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5659999999999999e-06 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842006+0000", 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6e-06 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842016+0000", 2024-09-12T18:15:31.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0251999999999999e-05 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842023+0000", 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8800000000000002e-06 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842075+0000", 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2422000000000001e-05 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842188+0000", 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000113162 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:249191 5.2 e72/49 5:4870865d:::benchmark_data_smithi062_23645_object114082:head v 72'15630, mlcod=72'15628)", 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.842965+0000", 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020056509999999998, 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020973760000000002, 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.849 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842965+0000", 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842965+0000", 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842966+0000", 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1200000000000003e-07 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842970+0000", 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4850000000000003e-06 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842980+0000", 2024-09-12T18:15:31.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3090000000000001e-06 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842986+0000", 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1120000000000001e-06 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843043+0000", 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7333999999999997e-05 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.852 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843063+0000", 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9947999999999999e-05 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:249193 5.1 e72/49 5:819dd742:::benchmark_data_smithi062_23645_object114084:head v 72'15532, mlcod=72'15530)", 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.843101+0000", 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0018701950000000001, 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020169680000000001, 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.853 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843101+0000", 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843101+0000", 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843101+0000", 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.51e-07 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843105+0000", 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1559999999999997e-06 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843113+0000", 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.994e-06 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843118+0000", 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2000000000000002e-06 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843181+0000", 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2884000000000003e-05 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.856 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843199+0000", 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7221999999999999e-05 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:249196 5.5 e72/21 5:abaea787:::benchmark_data_smithi062_23645_object114087:head v 72'15769, mlcod=72'15766)", 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.844673+0000", 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000298311, 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00048524000000000001, 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:31.857 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844673+0000", 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844673+0000", 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844673+0000", 2024-09-12T18:15:31.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6899999999999997e-07 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844677+0000", 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.2470000000000002e-06 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844702+0000", 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4479000000000001e-05 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844708+0000", 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4849999999999997e-06 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844742+0000", 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3717999999999998e-05 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.844754+0000", 2024-09-12T18:15:31.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1783000000000001e-05 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:249183 5.7 5:e20344a6:::benchmark_data_smithi062_23645_object114074:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.839324+0000", 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0056463950000000002, 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0058651290000000002, 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:31.861 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 249183 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839324+0000", 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839324+0000", 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839326+0000", 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.155e-06 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839330+0000", 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.036e-06 2024-09-12T18:15:31.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839341+0000", 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1561e-05 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839348+0000", 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9210000000000003e-06 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839398+0000", 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9883999999999999e-05 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839528+0000", 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013018200000000001 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839634+0000", 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000106079 2024-09-12T18:15:31.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.843629+0000", 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0039948409999999998 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:249184 5.f 5:f4ebd38b:::benchmark_data_smithi062_23645_object114075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.839361+0000", 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0056097070000000002, 2024-09-12T18:15:31.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0058680060000000003, 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 249184 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839361+0000", 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839361+0000", 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839362+0000", 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4099999999999999e-07 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839364+0000", 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.232e-06 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839372+0000", 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0450000000000001e-06 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839377+0000", 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3870000000000003e-06 2024-09-12T18:15:31.869 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839425+0000", 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7738000000000003e-05 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839554+0000", 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908700000000001 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:31.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839667+0000", 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011246100000000001 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.842002+0000", 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002335195 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:249186 5.7 5:e64af7a3:::benchmark_data_smithi062_23645_object114077:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T18:15:31.871 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:31.839407+0000", 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0055643510000000004, 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.005860779, 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 249186 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:31.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839407+0000", 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839407+0000", 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839407+0000", 2024-09-12T18:15:31.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4299999999999998e-07 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839409+0000", 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.469e-06 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839416+0000", 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7340000000000002e-06 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.839421+0000", 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0089999999999998e-06 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.841801+0000", 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002380095 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.841914+0000", 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000112256 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.841997+0000", 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.3645000000000003e-05 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:31.845204+0000", 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003207073 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:31.876 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:31.877 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:15:31.877 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:31.878 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:31.894 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:31.890+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:31.995 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:31.990+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:32.074 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:32.075 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:32.075 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:32.075 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:32.075 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:32.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:32.095 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.092+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.196 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.192+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:32.244 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 139.94891356799999, 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.245 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.246 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.247 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.248 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:32.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.250 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.251 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 128.84855309, 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.252 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:32.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:32.257 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 128.84761451399999, 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.258 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:32.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:32.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:32.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.263 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 64.987795656000003, 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.264 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:32.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.267 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:32.268 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.269 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:32.270 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 64.979773279, 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.271 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:32.272 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:32.273 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.274 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:32.275 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.276 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 64.968187993000001, 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.278 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.279 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.280 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.281 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:32.282 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.080836009000002, 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.283 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.284 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:32.285 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.286 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.287 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.288 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:32.289 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.075862039999997, 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.290 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:32.291 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:32.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.293 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.294 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.295 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.075393110999997, 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.296 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.297 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:32.298 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.299 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:32.300 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.301 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:32.302 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.073351787, 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.303 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:32.305 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.072444017999999, 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.307 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.308 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:32.309 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:32.310 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.311 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.072015815, 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.312 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.313 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:32.314 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.315 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:32.316 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.411485668000001, 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.317 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:32.318 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.319 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:32.321 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.322 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.409241046999998, 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.323 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:32.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.406707806, 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.329 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:32.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.406249815999999, 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:32.335 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:32.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.341 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.181752333999999, 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.342 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:32.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:32.347 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 27.181718803999999, 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.350 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:32.351 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.352 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:32.353 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.7887648170000006, 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.354 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:32.356 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.357 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229435 5.9 e70/69 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head v 70'14348, mlcod=0'0)", 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 8.7877048860000002, 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033464307999999998, 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.358 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:32.359 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455371+0000", 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.074e-06 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455383+0000", 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1579e-05 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455411+0000", 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7682999999999999e-05 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.360 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455424+0000", 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3186999999999999e-05 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474182+0000", 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018758200999999999 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474239+0000", 2024-09-12T18:15:32.361 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6784999999999999e-05 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488781+0000", 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014541973 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488834+0000", 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2825999999999999e-05 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.362 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:32.363 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:32.363 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:32.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:32.365 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:32.358+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:32.427 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:15:32.464 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.460+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.539 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:32.539 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:32.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.539 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250884 5.1 5:83e3fd09:::benchmark_data_smithi062_23645_object115775:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.539 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.533827+0000", 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0045642479999999999, 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004582572, 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250884 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.540 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533827+0000", 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533827+0000", 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533828+0000", 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.035e-06 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533834+0000", 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2569999999999998e-06 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533845+0000", 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1864e-05 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533854+0000", 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1429999999999998e-06 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534751+0000", 2024-09-12T18:15:32.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00089718800000000004 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534855+0000", 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103954 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534953+0000", 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7888999999999997e-05 2024-09-12T18:15:32.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536741+0000", 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017883129999999999 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250885 5.2 5:4e6df7b4:::benchmark_data_smithi062_23645_object115776:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.533881+0000", 2024-09-12T18:15:32.545 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0045105199999999996, 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045784839999999999, 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.546 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250885 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533881+0000", 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533881+0000", 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533881+0000", 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9999999999999998e-07 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533884+0000", 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5440000000000001e-06 2024-09-12T18:15:32.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533892+0000", 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8590000000000005e-06 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533898+0000", 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535282+0000", 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001384543 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535381+0000", 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8702999999999993e-05 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535474+0000", 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3115999999999994e-05 2024-09-12T18:15:32.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:250883 5.7 e73/21 5:e29bcd03:::benchmark_data_smithi062_23645_object115774:head v 73'15489, mlcod=73'15487)", 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.534417+0000", 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0039744919999999996, 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040792909999999996, 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534417+0000", 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534417+0000", 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534417+0000", 2024-09-12T18:15:32.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.77e-07 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534422+0000", 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7670000000000003e-06 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534431+0000", 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6389999999999998e-06 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534436+0000", 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0869999999999997e-06 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534482+0000", 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6085999999999999e-05 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.534499+0000", 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7170999999999999e-05 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.554 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250886 5.2 5:41784783:::benchmark_data_smithi062_23645_object115777:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.535520+0000", 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028710150000000002, 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030038, 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250886 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535520+0000", 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535520+0000", 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535521+0000", 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8299999999999995e-07 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535526+0000", 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2969999999999997e-06 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535535+0000", 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8769999999999999e-06 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.535541+0000", 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2040000000000002e-06 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537006+0000", 2024-09-12T18:15:32.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001465601 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537112+0000", 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001052 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537216+0000", 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104158 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.559 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250888 5.9 5:98f68fba:::benchmark_data_smithi062_23645_object115779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.536948+0000", 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014432430000000001, 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001611632, 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.560 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250888 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536948+0000", 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536948+0000", 2024-09-12T18:15:32.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536949+0000", 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.850000000000001e-07 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536953+0000", 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0060000000000003e-06 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536962+0000", 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1900000000000001e-06 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536978+0000", 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5804999999999999e-05 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537037+0000", 2024-09-12T18:15:32.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8998e-05 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537108+0000", 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1190000000000001e-05 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537213+0000", 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010478499999999999 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:250887 5.f e73/53 5:f10f831f:::benchmark_data_smithi062_23645_object115778:head v 73'15837, mlcod=73'15835)", 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.536984+0000", 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0014070930000000001, 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001608695, 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536984+0000", 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536984+0000", 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536985+0000", 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9999999999999997e-07 2024-09-12T18:15:32.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536991+0000", 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9549999999999997e-06 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.536997+0000", 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4350000000000002e-06 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537003+0000", 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537046+0000", 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3429e-05 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537067+0000", 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1180999999999999e-05 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.568 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250889 5.b 5:d53faf5a:::benchmark_data_smithi062_23645_object115780:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.537005+0000", 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001386572, 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016243939999999999, 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.569 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250889 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537005+0000", 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537005+0000", 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537005+0000", 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2499999999999995e-07 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537008+0000", 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5799999999999999e-06 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537015+0000", 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1130000000000003e-06 2024-09-12T18:15:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537021+0000", 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2049999999999999e-06 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537121+0000", 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9406000000000003e-05 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537234+0000", 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011328900000000001 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250891 5.3 5.f9ee963 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.537063+0000", 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0013285409999999999, 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015975970000000001, 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250891 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537063+0000", 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537063+0000", 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537064+0000", 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9299999999999997e-07 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537067+0000", 2024-09-12T18:15:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0350000000000002e-06 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537074+0000", 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9040000000000003e-06 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537079+0000", 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5199999999999997e-06 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250892 5.0 5:07397be6:::benchmark_data_smithi062_23645_object115783:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.537088+0000", 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0013031469999999999, 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001597993, 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250892 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537088+0000", 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537088+0000", 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537089+0000", 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8800000000000002e-07 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537091+0000", 2024-09-12T18:15:32.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.069e-06 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537097+0000", 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9030000000000001e-06 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537103+0000", 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4649999999999999e-06 2024-09-12T18:15:32.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537145+0000", 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1841000000000001e-05 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537291+0000", 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014587700000000001 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250893 5.9 5.4686e4b9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.537162+0000", 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001229681, 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001563886, 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250893 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537162+0000", 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537162+0000", 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537163+0000", 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8800000000000002e-07 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537166+0000", 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0299999999999998e-06 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537174+0000", 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5890000000000003e-06 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537180+0000", 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6409999999999999e-06 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250894 5.0 5.19035750 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.537320+0000", 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0010716860000000001, 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001453186, 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250894 2024-09-12T18:15:32.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537320+0000", 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537320+0000", 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537320+0000", 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2399999999999998e-07 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537324+0000", 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1719999999999999e-06 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537332+0000", 2024-09-12T18:15:32.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9880000000000004e-06 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.537337+0000", 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8690000000000001e-06 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250875 5.b 5:d2f2aa93:::benchmark_data_smithi062_23645_object115766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.531471+0000", 2024-09-12T18:15:32.589 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0069208780000000001, 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073548870000000001, 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250875 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531471+0000", 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531471+0000", 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531471+0000", 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4099999999999999e-07 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531474+0000", 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5459999999999998e-06 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531483+0000", 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531489+0000", 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8850000000000004e-06 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531622+0000", 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013318800000000001 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531735+0000", 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112816 2024-09-12T18:15:32.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.538720+0000", 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069857529999999999 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.538773+0000", 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2425e-05 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:250878 5.b 5:d281d3b2:::benchmark_data_smithi062_23645_object115769:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:32.531755+0000", 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0066364809999999996, 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071437990000000002, 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 250878 2024-09-12T18:15:32.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531755+0000", 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531755+0000", 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531756+0000", 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2900000000000004e-07 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531758+0000", 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.542e-06 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531767+0000", 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8640000000000002e-06 2024-09-12T18:15:32.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.531773+0000", 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7529999999999998e-06 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533571+0000", 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001798748 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:32.533680+0000", 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010863599999999999 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 13 2024-09-12T18:15:32.599 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:32.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:32.601 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.596+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.701 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.696+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.766 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:32.766 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:32.766 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:32.766 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:32.766 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:32.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:32.802 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.796+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.903 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:32.900+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.830573676999997, 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:32.950 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:32.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.817172569999997, 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:32.957 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:32.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:32.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.810598888000001, 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:32.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.968 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.810486973000003, 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:32.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:32.974 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.582832839, 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:32.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.582797958, 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:32.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:32.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.569759382999999, 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.989 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:32.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:32.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:32.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:32.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:32.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:32.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:32.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:32.998 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.557761269, 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:32.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:33.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:33.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:33.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:33.005 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.527029443, 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:33.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.521417888, 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:33.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:33.020 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.514248070000001, 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.021 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:33.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:33.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:33.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.492770951000001, 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:33.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:33.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.490772071, 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.037 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:33.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:33.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.478271861, 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:33.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:33.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:33.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:33.051 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.476937962999999, 2024-09-12T18:15:33.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:33.052 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.052 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.052 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:33.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:33.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:33.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.476570606999999, 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:33.059 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:33.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:33.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.066 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.469445627000001, 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:33.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:33.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.073 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.468903201, 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:33.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:33.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.458904227, 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.081 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:33.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:33.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.456484251999999, 2024-09-12T18:15:33.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:33.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:33.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:33.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:33.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:33.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:33.095 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:33.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:33.097 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:33.092+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:33.098 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:33.198 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:33.194+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:252654 5.f 5:f85cf903:::benchmark_data_smithi062_23645_object117545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:33.250478+0000", 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0030278890000000002, 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030451219999999999, 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:33.253 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 252654 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250478+0000", 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:33.254 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250478+0000", 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250479+0000", 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.5000000000000001e-07 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250483+0000", 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9260000000000002e-06 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.255 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250493+0000", 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0231000000000001e-05 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250500+0000", 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9600000000000003e-06 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250647+0000", 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00014633199999999999 2024-09-12T18:15:33.256 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250732+0000", 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.5582999999999997e-05 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250801+0000", 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8981999999999998e-05 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.257 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:252655 5.f 5:f03c312c:::benchmark_data_smithi062_23645_object117546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:33.250514+0000", 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0029925300000000002, 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030518009999999998, 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 252655 2024-09-12T18:15:33.258 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250514+0000", 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250514+0000", 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.259 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250514+0000", 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.82e-07 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250517+0000", 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.537e-06 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250524+0000", 2024-09-12T18:15:33.260 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2320000000000004e-06 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.250530+0000", 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7540000000000003e-06 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.253267+0000", 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0027374090000000001 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.261 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.253367+0000", 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.9533999999999999e-05 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.253443+0000", 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5996999999999998e-05 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.262 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:252661 5.7 5:ee2b5972:::benchmark_data_smithi062_23645_object117552:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:33.251715+0000", 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00179082, 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001894588, 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 252661 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.263 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.251715+0000", 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.251715+0000", 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.251716+0000", 2024-09-12T18:15:33.264 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6099999999999999e-07 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.251721+0000", 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3460000000000004e-06 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.251734+0000", 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3451999999999999e-05 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:33.265 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.251742+0000", 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.8979999999999996e-06 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.253260+0000", 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00151779 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.253399+0000", 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013967499999999999 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:33.266 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:33.253488+0000", 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8133000000000005e-05 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 3 2024-09-12T18:15:33.267 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:33.268 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:33.274 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:33.277 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:33.280 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:33.280 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:33.301 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:33.294+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:33.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-09-12T18:15:33.400 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:33.396+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:33.425 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:33.425 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:33.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:33.501 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:33.498+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:33.601 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:33.601 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:33.602 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:33.598+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:33.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:33.703 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:33.698+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:33.734 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:33.734 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:33.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:33.804 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:33.800+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:33.906 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:33.902+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:33.907 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:33.907 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:33.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:34.007 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:34.004+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:34.079 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:34.079 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:34.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:34.107 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:34.102+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:34.208 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:34.206+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:34.224 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:34.224 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:34.238 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:34.310 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:34.310+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:34.363 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:34.363 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:34.378 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:34.410 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:34.410+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:34.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:15:34.497 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:34.497 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:34.511 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:34.512 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:34.508+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:34.612 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:34.606+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:34.675 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:34.676 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:34.697 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:34.745 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:34.742+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:34.814 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:34.808+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:34.899 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:34.899 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:34.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:34.915 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:34.912+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.015 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:35.010+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:35.069 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:35.069 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:35.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:35.135 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:35.132+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.219 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:35.216+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.242 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:35.243 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:35.260 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:35.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:35.355 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:35.352+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.420 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:35.416+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.433 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:35.448 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:15:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:35.455 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:35.458 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:35.458 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:35.474 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:35.475 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:35.476 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:35.477 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:35.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:35.523 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:35.520+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.621 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:35.614+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:35.672 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:35.672 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 143.37701549600001, 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:35.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:35.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.677 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:35.679 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 132.27665501800001, 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:35.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:35.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.685 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 132.275716442, 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.686 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.687 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:35.688 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.689 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:35.690 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.691 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.415897584000007, 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.692 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.693 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.694 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:35.695 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.696 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.697 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.407875207000004, 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.698 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.699 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:35.700 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.701 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.702 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:35.703 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:35.704 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 68.396289921000005, 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.705 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.706 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.707 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:35.708 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.709 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:35.710 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.508937936999999, 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.711 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.712 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:35.713 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.714 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:35.715 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.716 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.503963968000001, 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.717 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:35.718 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.719 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.720 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:35.721 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.722 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.503495039000001, 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.723 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.724 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.725 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:35.726 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.727 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.728 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.501453714999997, 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.729 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.730 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:35.731 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.732 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.733 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.500545946000003, 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.734 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.735 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:35.736 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.737 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:35.738 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 38.500117742999997, 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.739 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.740 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:35.741 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.742 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 30.839587596000001, 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.743 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:35.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 30.837342974999999, 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:35.749 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:35.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:35.755 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 30.834809734, 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:35.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.761 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 30.834351743999999, 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:35.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:35.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:35.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 30.609854261999999, 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:35.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.769 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:35.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.773 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 30.609820731999999, 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.774 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:35.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.216866745000001, 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.780 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.782 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.784 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229435 5.9 e70/69 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head v 70'14348, mlcod=0'0)", 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 12.215806814, 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033464307999999998, 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455371+0000", 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.074e-06 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455383+0000", 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1579e-05 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455411+0000", 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7682999999999999e-05 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455424+0000", 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3186999999999999e-05 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:35.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474182+0000", 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018758200999999999 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474239+0000", 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6784999999999999e-05 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488781+0000", 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014541973 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:35.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488834+0000", 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2825999999999999e-05 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:35.789 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:35.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:35.792 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:35.786+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:35.892 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:35.888+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:35.951 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256510 5.5 5:aa8ba1e6:::benchmark_data_smithi062_23645_object121401:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.946055+0000", 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0044620069999999996, 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044852099999999999, 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.952 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256510 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946055+0000", 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946055+0000", 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946056+0000", 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1800000000000004e-07 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946060+0000", 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0069999999999999e-06 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946068+0000", 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4659999999999999e-06 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946075+0000", 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2260000000000002e-06 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946129+0000", 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4666999999999997e-05 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946252+0000", 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122664 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:35.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.946352+0000", 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9845000000000004e-05 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948367+0000", 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020151660000000001 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256511 5.0 5:025a19f4:::benchmark_data_smithi062_23645_object121402:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.957 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.947397+0000", 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0031196629999999999, 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032173789999999998, 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256511 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947397+0000", 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947397+0000", 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947398+0000", 2024-09-12T18:15:35.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8400000000000003e-07 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947402+0000", 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4750000000000002e-06 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947411+0000", 2024-09-12T18:15:35.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4210000000000001e-06 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947424+0000", 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2525e-05 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947469+0000", 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5874999999999997e-05 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947567+0000", 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7159999999999998e-05 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256512 5.b 5:d1e333d4:::benchmark_data_smithi062_23645_object121403:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.947438+0000", 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0030793719999999999, 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032343720000000001, 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.962 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256512 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947438+0000", 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947438+0000", 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947438+0000", 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7800000000000001e-07 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947441+0000", 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8650000000000001e-06 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947449+0000", 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6410000000000002e-06 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947455+0000", 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7910000000000001e-06 2024-09-12T18:15:35.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947503+0000", 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8288000000000003e-05 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947623+0000", 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000120565 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256513 5.4 5:2d60150c:::benchmark_data_smithi062_23645_object121404:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.947774+0000", 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027428040000000002, 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029541200000000002, 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256513 2024-09-12T18:15:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947774+0000", 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947774+0000", 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947775+0000", 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3799999999999996e-07 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947779+0000", 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9920000000000001e-06 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947788+0000", 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8799999999999997e-06 2024-09-12T18:15:35.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947795+0000", 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.951e-06 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.947869+0000", 2024-09-12T18:15:35.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4085999999999995e-05 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948026+0000", 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000157038 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256515 5.0 5:039406d6:::benchmark_data_smithi062_23645_object121406:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.948092+0000", 2024-09-12T18:15:35.971 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024246939999999998, 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002693038, 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256515 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948092+0000", 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948092+0000", 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948093+0000", 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.92e-07 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948097+0000", 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9620000000000004e-06 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948106+0000", 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7150000000000004e-06 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948112+0000", 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4459999999999998e-06 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949214+0000", 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001101961 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949324+0000", 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110061 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256516 5.8 5:12285d91:::benchmark_data_smithi062_23645_object121407:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.948134+0000", 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002383498, 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027069860000000002, 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.976 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256516 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948134+0000", 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948134+0000", 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948134+0000", 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0299999999999999e-07 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948137+0000", 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9670000000000001e-06 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948145+0000", 2024-09-12T18:15:35.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0120000000000005e-06 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948153+0000", 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4909999999999999e-06 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949461+0000", 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001308254 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256518 5.5 5:ad34e0d6:::benchmark_data_smithi062_23645_object121409:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.948367+0000", 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0021504979999999998, 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025248419999999998, 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:35.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256518 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948367+0000", 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948367+0000", 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948367+0000", 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4799999999999998e-07 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948370+0000", 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0469999999999998e-06 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948378+0000", 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3080000000000002e-06 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948382+0000", 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3429999999999998e-06 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948430+0000", 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7815000000000002e-05 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948556+0000", 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012592699999999999 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948820+0000", 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026410399999999998 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:256517 5.7 e76/21 5:e431d19c:::benchmark_data_smithi062_23645_object121408:head v 76'15822, mlcod=76'15820)", 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.948514+0000", 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.002002836, 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024385489999999999, 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948514+0000", 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948514+0000", 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948515+0000", 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6499999999999999e-07 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948522+0000", 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0940000000000002e-06 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948528+0000", 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0820000000000004e-06 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948532+0000", 2024-09-12T18:15:35.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2080000000000002e-06 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948571+0000", 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8569999999999998e-05 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.948584+0000", 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2826000000000001e-05 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256519 5.b 5:d3f2fa5c:::benchmark_data_smithi062_23645_object121410:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.949533+0000", 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00098365299999999991, 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014693079999999999, 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.989 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256519 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949533+0000", 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949533+0000", 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949534+0000", 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.85e-07 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949538+0000", 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1110000000000001e-06 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949547+0000", 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2840000000000006e-06 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949555+0000", 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2449999999999998e-06 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949600+0000", 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4736e-05 2024-09-12T18:15:35.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949700+0000", 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100902 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256520 5.8 5.8a185008 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.949584+0000", 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00093276399999999999, 2024-09-12T18:15:35.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001470652, 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256520 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949584+0000", 2024-09-12T18:15:35.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949584+0000", 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949585+0000", 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6700000000000003e-07 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949588+0000", 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7970000000000001e-06 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949595+0000", 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6059999999999997e-06 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949601+0000", 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2739999999999998e-06 2024-09-12T18:15:35.996 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256522 5.1 5:82ea18b4:::benchmark_data_smithi062_23645_object121413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.949794+0000", 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00072324900000000003, 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001307101, 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:35.997 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256522 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949794+0000", 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949794+0000", 2024-09-12T18:15:35.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949794+0000", 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-07 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949797+0000", 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4509999999999999e-06 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:35.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949803+0000", 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7620000000000001e-06 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949806+0000", 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7689999999999998e-06 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949839+0000", 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2461e-05 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949906+0000", 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6833000000000002e-05 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.949972+0000", 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6019999999999995e-05 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.001 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256523 5.3 5:c90a522f:::benchmark_data_smithi062_23645_object121414:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.950304+0000", 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.000213539, 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00086148099999999999, 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.002 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256523 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950304+0000", 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950304+0000", 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950304+0000", 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2099999999999995e-07 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950308+0000", 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5920000000000001e-06 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950320+0000", 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1506e-05 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950326+0000", 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3199999999999996e-06 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950375+0000", 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9459000000000002e-05 2024-09-12T18:15:36.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950496+0000", 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012064499999999999 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.950598+0000", 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101692 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256502 5.8 5:1bf91af6:::benchmark_data_smithi062_23645_object121393:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.941091+0000", 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0094262170000000006, 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010141287000000001, 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.007 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256502 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.941091+0000", 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.941091+0000", 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.941092+0000", 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.941096+0000", 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9480000000000001e-06 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.941105+0000", 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0380000000000005e-06 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.941111+0000", 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7889999999999997e-06 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.943804+0000", 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026924029999999999 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.943918+0000", 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114472 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:256507 5.8 5:1959b967:::benchmark_data_smithi062_23645_object121398:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:35.942837+0000", 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0076802809999999997, 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084579730000000006, 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.011 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 256507 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.942837+0000", 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.942837+0000", 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.942838+0000", 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2699999999999998e-07 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.942841+0000", 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5590000000000001e-06 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.942850+0000", 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4700000000000002e-06 2024-09-12T18:15:36.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.942856+0000", 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2650000000000002e-06 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.945616+0000", 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002760598 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:35.945734+0000", 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011747999999999999 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 14 2024-09-12T18:15:36.016 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:36.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:36.018 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:36.012+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:36.119 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:36.116+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:36.186 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:36.186 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:36.186 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:36.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:36.249 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:36.246+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:36.321 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:36.314+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:36.368 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.250617536999997, 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:36.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:36.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.237216429999997, 2024-09-12T18:15:36.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:36.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:36.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:36.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.230642748000001, 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.380 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:36.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.230530833000003, 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.385 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:36.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.002876699, 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:36.390 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:36.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:36.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.002841818, 2024-09-12T18:15:36.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:36.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.989803243000001, 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.977805129, 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:36.410 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:36.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:36.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.417 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.947073303, 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:36.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:36.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:36.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.941461748, 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.426 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:36.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.934291930000001, 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:36.433 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:36.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:36.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:36.441 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.912814811000001, 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:36.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:36.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:36.448 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.910815931, 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:36.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:36.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:36.455 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.898315720999999, 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:36.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:36.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:36.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.896981823000001, 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.463 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:36.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.896614466999999, 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.470 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:36.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:36.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.889489487000001, 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.477 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:36.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:36.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.888947061, 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.484 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:36.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:36.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:36.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.878948086999999, 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.491 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:36.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:36.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:36.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:36.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.876528112000001, 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:36.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:36.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:36.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:36.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:36.505 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:36.507 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:36.507 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:36.502+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:36.607 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:36.604+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:258184 5.7 5:ea141fc9:::benchmark_data_smithi062_23645_object123075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.651829+0000", 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0033973549999999999, 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0034219350000000001, 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.655 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 258184 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651829+0000", 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.656 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651829+0000", 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651830+0000", 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.26e-06 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.657 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651835+0000", 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8010000000000003e-06 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651855+0000", 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0494999999999999e-05 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651863+0000", 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0260000000000007e-06 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.658 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.651918+0000", 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5133000000000002e-05 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652007+0000", 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8806000000000003e-05 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:36.659 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652125+0000", 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117472 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:258186 5.5 e76/21 5:a097ace6:::benchmark_data_smithi062_23645_object123077:head v 76'16344, mlcod=76'16342)", 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.652313+0000", 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0029128349999999999, 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0030009609999999999, 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.660 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652313+0000", 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652313+0000", 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.661 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652314+0000", 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2099999999999997e-07 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652329+0000", 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4912000000000001e-05 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652339+0000", 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0481e-05 2024-09-12T18:15:36.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652346+0000", 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6549999999999998e-06 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652381+0000", 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5657000000000001e-05 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.663 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652396+0000", 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.4826e-05 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:258187 5.1 e76/49 5:8ab9d97b:::benchmark_data_smithi062_23645_object123078:head v 76'16068, mlcod=76'16063)", 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.652364+0000", 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.002861803, 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003006341, 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.664 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652364+0000", 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652364+0000", 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.665 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652365+0000", 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4400000000000001e-07 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652368+0000", 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.5269999999999999e-06 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652375+0000", 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:36.666 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652381+0000", 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0719999999999996e-06 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652418+0000", 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7531999999999999e-05 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652434+0000", 2024-09-12T18:15:36.667 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6092000000000001e-05 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:258189 5.9 e76/69 5:963d4f68:::benchmark_data_smithi062_23645_object123080:head v 76'16148, mlcod=76'16146)", 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.652513+0000", 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0027127950000000001, 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0028952700000000001, 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:36.668 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652513+0000", 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652513+0000", 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.669 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652514+0000", 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0299999999999999e-07 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652518+0000", 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4379999999999997e-06 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652527+0000", 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8470000000000002e-06 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.670 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652533+0000", 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7289999999999997e-06 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652583+0000", 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0473000000000003e-05 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.652608+0000", 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.4946000000000001e-05 2024-09-12T18:15:36.671 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:258190 5.9 e76/69 5:923262b1:::benchmark_data_smithi062_23645_object123081:head v 76'16149, mlcod=76'16146)", 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.654197+0000", 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.001028724, 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001248098, 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.672 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654197+0000", 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654197+0000", 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.673 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654198+0000", 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.7999999999999995e-07 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654202+0000", 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3819999999999997e-06 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654218+0000", 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.5950000000000001e-05 2024-09-12T18:15:36.674 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654225+0000", 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5520000000000001e-06 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.675 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654326+0000", 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000101536 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654340+0000", 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3942e-05 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:258196 5.d 5:b6ccf394:::benchmark_data_smithi062_23645_object123087:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.654817+0000", 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.000408875, 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00066604299999999995, 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 258196 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.677 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654817+0000", 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654817+0000", 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654819+0000", 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.446e-06 2024-09-12T18:15:36.678 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654825+0000", 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0510000000000002e-06 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654841+0000", 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6449000000000001e-05 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.679 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654849+0000", 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1170000000000004e-06 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.654910+0000", 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1285999999999996e-05 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655036+0000", 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012532799999999999 2024-09-12T18:15:36.680 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:258194 5.3 e76/53 5:c9e5ea98:::benchmark_data_smithi062_23645_object123085:head v 76'16321, mlcod=76'16319)", 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:36.655055+0000", 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00017102900000000001, 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00047059199999999998, 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.681 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:36.682 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655055+0000", 2024-09-12T18:15:36.682 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655055+0000", 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.683 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655056+0000", 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655062+0000", 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9490000000000001e-06 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:36.684 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655071+0000", 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7880000000000001e-06 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655079+0000", 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1069999999999999e-06 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655141+0000", 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2620999999999996e-05 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:36.685 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:36.655160+0000", 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9051000000000001e-05 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 7 2024-09-12T18:15:36.686 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:36.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:36.710 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:36.702+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:36.809 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:36.806+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:36.876 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:36.876 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:36.876 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:36.876 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:36.877 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:36.896 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:36.910 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:36.906+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:37.010 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.004+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:37.038 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 144.74264173099999, 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:37.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 133.64228125299999, 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:37.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:37.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.050 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:37.051 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 133.64134267700001, 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:37.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 69.781523819, 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:37.057 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:37.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:37.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:37.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:37.063 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 69.773501441999997, 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:37.069 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 69.761916155999998, 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.070 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:37.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:37.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.874564171999999, 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:37.076 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:37.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:37.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:37.082 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.869590203000001, 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:37.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:37.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:37.087 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.869121274000001, 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:37.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:37.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:37.094 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.867079949999997, 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:37.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:37.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.099 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.866172181000003, 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:37.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.104 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.865743977999998, 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:37.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:37.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 32.205213831000002, 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.109 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:37.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.115 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 32.202969209999999, 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:37.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:37.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 32.200435968999997, 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:37.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:37.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.126 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:37.127 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 32.199977979000003, 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.128 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:37.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:37.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:37.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.975480497, 2024-09-12T18:15:37.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:37.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:37.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.139 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:37.140 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 31.975446967, 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:37.141 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:37.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:37.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 13.58249298, 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.147 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:37.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229435 5.9 e70/69 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head v 70'14348, mlcod=0'0)", 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 13.581433048999999, 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033464307999999998, 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:37.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455369+0000", 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455371+0000", 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.074e-06 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:37.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455383+0000", 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1579e-05 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455411+0000", 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7682999999999999e-05 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.455424+0000", 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3186999999999999e-05 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:37.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474182+0000", 2024-09-12T18:15:37.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018758200999999999 2024-09-12T18:15:37.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:37.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.474239+0000", 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6784999999999999e-05 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488781+0000", 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.014541973 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488834+0000", 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.2825999999999999e-05 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.157 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.158 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:37.158 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:37.158 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:37.159 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.156+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:37.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:37.260 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:37.254+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:259812 5.7 e76/21 5:e5cc1ea7:::benchmark_data_smithi062_23645_object124703:head v 76'16017, mlcod=76'16014)", 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.309755+0000", 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028499409999999999, 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002870362, 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.314 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309755+0000", 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309755+0000", 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309756+0000", 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2399999999999999e-07 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309760+0000", 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3250000000000001e-06 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309767+0000", 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8360000000000003e-06 2024-09-12T18:15:37.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309772+0000", 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.656e-06 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309808+0000", 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6779000000000001e-05 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309826+0000", 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.819e-05 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259815 5.5 5:a0a70b03:::benchmark_data_smithi062_23645_object124706:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.310048+0000", 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00255762, 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026350980000000002, 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.318 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259815 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310048+0000", 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310048+0000", 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310048+0000", 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5099999999999999e-07 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310052+0000", 2024-09-12T18:15:37.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7450000000000001e-06 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310066+0000", 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4078e-05 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310073+0000", 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310133+0000", 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0059999999999998e-05 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310283+0000", 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149837 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310397+0000", 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011387600000000001 2024-09-12T18:15:37.322 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259817 5.c 5:31e0eb99:::benchmark_data_smithi062_23645_object124708:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.310104+0000", 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0025017149999999998, 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002645171, 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.323 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259817 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310104+0000", 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310104+0000", 2024-09-12T18:15:37.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310104+0000", 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6799999999999999e-07 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310108+0000", 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310117+0000", 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0480000000000004e-06 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310123+0000", 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2190000000000001e-06 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310165+0000", 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1971999999999997e-05 2024-09-12T18:15:37.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310285+0000", 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012025 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310397+0000", 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111418 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.327 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259818 5.8 5:16f8b5db:::benchmark_data_smithi062_23645_object124709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.310891+0000", 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0017143480000000001, 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019170159999999999, 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.328 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259818 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310891+0000", 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310891+0000", 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310892+0000", 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.017e-06 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310896+0000", 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2479999999999998e-06 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310906+0000", 2024-09-12T18:15:37.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4269999999999997e-06 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310913+0000", 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9530000000000002e-06 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310957+0000", 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4277999999999999e-05 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311057+0000", 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010052600000000001 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259819 5.0 5:01c2be88:::benchmark_data_smithi062_23645_object124710:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.310930+0000", 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0016752640000000001, 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001933873, 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.332 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259819 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310930+0000", 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310930+0000", 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310930+0000", 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1799999999999995e-07 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310933+0000", 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6850000000000001e-06 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310940+0000", 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1539999999999996e-06 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310946+0000", 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0090000000000004e-06 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311079+0000", 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013241300000000001 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311196+0000", 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011694899999999999 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259820 5.5 5:a44a9114:::benchmark_data_smithi062_23645_object124711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.310955+0000", 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001649792, 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019627960000000002, 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.337 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259820 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310955+0000", 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310955+0000", 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310956+0000", 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3599999999999999e-07 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310958+0000", 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2520000000000002e-06 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310964+0000", 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8320000000000002e-06 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310969+0000", 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6580000000000001e-06 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312075+0000", 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001106157 2024-09-12T18:15:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312158+0000", 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3372000000000001e-05 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312260+0000", 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010145999999999999 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259821 5.5 5.662344b5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.310980+0000", 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0016251639999999999, 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019947599999999999, 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259821 2024-09-12T18:15:37.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310980+0000", 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310980+0000", 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310981+0000", 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1600000000000001e-07 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310983+0000", 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310989+0000", 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4019999999999999e-06 2024-09-12T18:15:37.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.310994+0000", 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9180000000000002e-06 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259822 5.0 5:033c401d:::benchmark_data_smithi062_23645_object124713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.311001+0000", 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.001604484, 2024-09-12T18:15:37.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020221129999999999, 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259822 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311001+0000", 2024-09-12T18:15:37.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311001+0000", 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311001+0000", 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5699999999999998e-07 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311003+0000", 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5939999999999999e-06 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311008+0000", 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.609e-06 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311013+0000", 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4320000000000001e-06 2024-09-12T18:15:37.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312891+0000", 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018777819999999999 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312962+0000", 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1532999999999994e-05 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259823 5.3 5:c15f1a9c:::benchmark_data_smithi062_23645_object124714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.311022+0000", 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0015833679999999999, 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020573499999999999, 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259823 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.350 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311022+0000", 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311022+0000", 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311022+0000", 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2399999999999999e-07 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311024+0000", 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.761e-06 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311030+0000", 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8239999999999996e-06 2024-09-12T18:15:37.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311034+0000", 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4819999999999996e-06 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311077+0000", 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2429000000000003e-05 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311196+0000", 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119053 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311317+0000", 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121383 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:259805 5.f e76/74)", 2024-09-12T18:15:37.354 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.312157+0000", 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00044814799999999999, 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097977299999999997, 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312157+0000", 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312157+0000", 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312157+0000", 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.79e-07 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312160+0000", 2024-09-12T18:15:37.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2139999999999999e-06 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312166+0000", 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.562e-06 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312171+0000", 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9339999999999997e-06 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.357 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:259816 5.7 e76/21)", 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.312185+0000", 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00042005500000000002, 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0009884379999999999, 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312185+0000", 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312185+0000", 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312185+0000", 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1e-07 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312190+0000", 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.459e-06 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312196+0000", 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1689999999999997e-06 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312200+0000", 2024-09-12T18:15:37.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3069999999999996e-06 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259824 5.5 5.15bcaed5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.312576+0000", 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 2.9258999999999999e-05, 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063556300000000001, 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:37.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259824 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312576+0000", 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312576+0000", 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312577+0000", 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9599999999999998e-07 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312581+0000", 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.233e-06 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312589+0000", 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3960000000000006e-06 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312594+0000", 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.797e-06 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259825 5.c 5:31bc8609:::benchmark_data_smithi062_23645_object124716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.312604+0000", 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.1119999999999999e-06, 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00065341599999999998, 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259825 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.365 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312604+0000", 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312604+0000", 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312604+0000", 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0400000000000002e-07 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312606+0000", 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.658e-06 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312610+0000", 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312612+0000", 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7379999999999999e-06 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312656+0000", 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3438e-05 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312726+0000", 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9678999999999995e-05 2024-09-12T18:15:37.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.312787+0000", 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1606000000000006e-05 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259805 5.f 5:f92137db:::benchmark_data_smithi062_23645_object124696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.302892+0000", 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0097133080000000004, 2024-09-12T18:15:37.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010427153999999999, 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259805 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302892+0000", 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302892+0000", 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302892+0000", 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.32e-07 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302895+0000", 2024-09-12T18:15:37.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.43e-06 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302901+0000", 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8799999999999996e-06 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302905+0000", 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7840000000000003e-06 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.302953+0000", 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7172999999999997e-05 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.303092+0000", 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013949000000000001 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.303210+0000", 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117835 2024-09-12T18:15:37.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.311586+0000", 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083760150000000005 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259826 5.b 5:d5d8d220:::benchmark_data_smithi062_23645_object124717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.313133+0000", 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9994717, 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025772799999999998, 2024-09-12T18:15:37.374 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259826 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313133+0000", 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313133+0000", 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313134+0000", 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8199999999999998e-07 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313138+0000", 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5609999999999999e-06 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313147+0000", 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5119999999999997e-06 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313154+0000", 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6930000000000001e-06 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313204+0000", 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0285999999999999e-05 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313307+0000", 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102613 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259810 5.5 5:a1fa28a5:::benchmark_data_smithi062_23645_object124701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.306355+0000", 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0062502410000000001, 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.007093154, 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259810 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.379 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306355+0000", 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306355+0000", 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306355+0000", 2024-09-12T18:15:37.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5100000000000001e-07 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306357+0000", 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8870000000000001e-06 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306365+0000", 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0139999999999998e-06 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306370+0000", 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3159999999999998e-06 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306421+0000", 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1783000000000002e-05 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306489+0000", 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7305999999999996e-05 2024-09-12T18:15:37.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.306548+0000", 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9620999999999997e-05 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309825+0000", 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032769269999999998 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:259814 5.4 5:2bac2572:::benchmark_data_smithi062_23645_object124705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:37.307297+0000", 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0053080530000000001, 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062145680000000002, 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:37.384 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 259814 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.307297+0000", 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.307297+0000", 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.307298+0000", 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8400000000000004e-07 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.307301+0000", 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5310000000000002e-06 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.307312+0000", 2024-09-12T18:15:37.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519e-05 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.307318+0000", 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9179999999999999e-06 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309696+0000", 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023785049999999999 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:37.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.309809+0000", 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011260399999999999 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:37.313482+0000", 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036734770000000001 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:37.388 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 17 2024-09-12T18:15:37.389 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:37.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:37.390 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:37.386+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:37.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:15:37.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:37.490 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.484+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:37.590 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:37.590 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:37.590 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:37.590 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:37.590 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:37.591 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.588+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:37.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:37.650 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:37.670 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:37.671 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:37.690 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:37.690 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:37.692 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.688+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:37.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:37.693 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:37.761 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:37.761 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:37.782 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:37.827 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.824+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:37.894 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:37.890+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:37.939 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:37.939 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:37.958 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:37.999 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:37.996+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:38.096 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:38.092+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:38.141 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:38.141 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:38.160 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:38.198 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:38.194+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:38.298 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:38.294+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:38.344 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:38.344 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:38.365 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:38.409 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:38.406+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:38.463 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is set 2024-09-12T18:15:38.501 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:38.496+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:38.524 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:38.524 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:38.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:38.602 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:38.600+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:38.703 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:38.698+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:38.741 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:38.741 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:38.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:38.809 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:38.806+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:38.904 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:38.898+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:38.958 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:38.958 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:38.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:39.021 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:39.018+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:39.105 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:39.102+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:39.131 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:39.132 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:39.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:39.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-09-12T18:15:39.206 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:39.200+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:39.296 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:39.296 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:39.307 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:39.304+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:39.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:39.409 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:39.406+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:39.501 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:39.501 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:39.511 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:39.506+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:39.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:39.612 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:39.608+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:39.686 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:39.687 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:39.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:39.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:39.712 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:39.708+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:39.813 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:39.808+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:39.837 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:39.858 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:39.858 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:39.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:39.877 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:39.880 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:39.881 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:39.928 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:39.918+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:40.017 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:40.010+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:40.021 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 51.903004332000002, 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.022 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.028 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:40.028 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 51.889603225000002, 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.029 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:40.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:40.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:40.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:40.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 51.883029542999999, 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:40.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:40.040 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 51.882917628000001, 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:40.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.045 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.655263494, 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:40.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:40.050 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.655228612999998, 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.051 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:40.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.055 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.056 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:40.057 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.642190037999999, 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.058 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:40.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.630191924000002, 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.065 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:40.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:40.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.599460098000002, 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:40.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:40.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:40.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:40.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:40.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.593848543, 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:40.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:40.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:40.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.586678724999999, 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.087 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:40.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:40.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:40.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.565201605999999, 2024-09-12T18:15:40.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:40.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:40.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.563202726, 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.102 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:40.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.550702516000001, 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.109 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:40.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.549368617999999, 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:40.116 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:40.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:40.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:40.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:40.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:40.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:40.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:40.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:40.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:40.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.126 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.549001262000001, 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.127 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.129 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:40.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:40.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:40.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:40.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.541876282, 2024-09-12T18:15:40.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:40.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.541333856000001, 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:40.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.152 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.531334881999999, 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:40.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:40.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.528914907000001, 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:40.161 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:40.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:40.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:40.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:40.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:40.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:40.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:40.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.171 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:40.172 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:40.172 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:40.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:40.174 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:40.170+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:40.274 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:40.268+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:267097 5.2 e77/49 5:4754ca96:::benchmark_data_smithi062_23645_object131988:head v 77'16710, mlcod=77'16706)", 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:40.318821+0000", 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00052787199999999998, 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00054797899999999998, 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.319 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318821+0000", 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318821+0000", 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.320 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.322 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.322 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318822+0000", 2024-09-12T18:15:40.322 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.65e-07 2024-09-12T18:15:40.322 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.322 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.323 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.323 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318824+0000", 2024-09-12T18:15:40.323 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2670000000000001e-06 2024-09-12T18:15:40.323 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.324 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.324 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318832+0000", 2024-09-12T18:15:40.324 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.807e-06 2024-09-12T18:15:40.324 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.324 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.325 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318835+0000", 2024-09-12T18:15:40.325 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.1030000000000002e-06 2024-09-12T18:15:40.325 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.325 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.325 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318873+0000", 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7803999999999999e-05 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318892+0000", 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9045000000000001e-05 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.326 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:267093 5.2 e77/49 5:4030be05:::benchmark_data_smithi062_23645_object131984:head v 77'16708, mlcod=77'16706)", 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:40.315619+0000", 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0037302310000000001, 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0038064850000000001, 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315619+0000", 2024-09-12T18:15:40.327 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315619+0000", 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315620+0000", 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0500000000000002e-07 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.328 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315626+0000", 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9769999999999997e-06 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315637+0000", 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0725e-05 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.329 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315644+0000", 2024-09-12T18:15:40.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.2640000000000002e-06 2024-09-12T18:15:40.330 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.330 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.330 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.330 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315694+0000", 2024-09-12T18:15:40.330 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0312999999999998e-05 2024-09-12T18:15:40.331 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.331 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.331 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.331 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.315711+0000", 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6671e-05 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:267095 5.2 e77/49 5:4a4ca3ca:::benchmark_data_smithi062_23645_object131986:head v 77'16709, mlcod=77'16706)", 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:40.317271+0000", 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020781189999999998, 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002203839, 2024-09-12T18:15:40.332 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317271+0000", 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317271+0000", 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317272+0000", 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.1699999999999998e-07 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317275+0000", 2024-09-12T18:15:40.334 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4460000000000001e-06 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317285+0000", 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0219e-05 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317289+0000", 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9670000000000003e-06 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.335 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317331+0000", 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1941999999999999e-05 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317348+0000", 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6379e-05 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.336 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:267099 5.3 e77/53 5:cb8287c0:::benchmark_data_smithi062_23645_object131990:head v 77'16916, mlcod=77'16914)", 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:40.317311+0000", 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.0020381119999999999, 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022114930000000001, 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317311+0000", 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.337 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317311+0000", 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317312+0000", 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4700000000000002e-07 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317318+0000", 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1340000000000001e-06 2024-09-12T18:15:40.338 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317325+0000", 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6490000000000008e-06 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317331+0000", 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3539999999999999e-06 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.339 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317377+0000", 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6502000000000003e-05 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.317397+0000", 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.9432999999999998e-05 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.340 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.341 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.341 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.341 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.341 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:267102 5.f e77/74 5:f2a42e0d:::benchmark_data_smithi062_23645_object131993:head v 77'16860, mlcod=77'16858)", 2024-09-12T18:15:40.342 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:40.318786+0000", 2024-09-12T18:15:40.342 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.00056297599999999997, 2024-09-12T18:15:40.342 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00078504200000000001, 2024-09-12T18:15:40.342 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.342 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.342 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "started", 2024-09-12T18:15:40.343 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.343 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.343 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.343 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318786+0000", 2024-09-12T18:15:40.343 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.343 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.344 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.344 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318786+0000", 2024-09-12T18:15:40.344 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.344 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.344 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.345 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318787+0000", 2024-09-12T18:15:40.345 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.4899999999999995e-07 2024-09-12T18:15:40.345 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.345 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.345 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318791+0000", 2024-09-12T18:15:40.346 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7120000000000002e-06 2024-09-12T18:15:40.346 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.346 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.346 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.346 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318799+0000", 2024-09-12T18:15:40.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0830000000000004e-06 2024-09-12T18:15:40.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.347 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.347 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318805+0000", 2024-09-12T18:15:40.347 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1460000000000001e-06 2024-09-12T18:15:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318845+0000", 2024-09-12T18:15:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0649999999999999e-05 2024-09-12T18:15:40.348 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:40.318863+0000", 2024-09-12T18:15:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.7546000000000001e-05 2024-09-12T18:15:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.349 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.350 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.350 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.350 INFO:teuthology.orchestra.run.smithi176.stdout: ], 2024-09-12T18:15:40.350 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 5 2024-09-12T18:15:40.351 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:40.353 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:40.376 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:40.370+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:40.476 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:40.472+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:40.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:15:40.540 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:40.541 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:40.541 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:40.541 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:40.541 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:40.557 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:40.599 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:40.596+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:40.678 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:40.674+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 148.447815193, 2024-09-12T18:15:40.743 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.744 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:40.745 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.746 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:40.747 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.748 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:40.749 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.750 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 137.347454715, 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.752 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.753 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:40.754 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.755 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.756 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 137.34651613899999, 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.757 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:40.758 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.759 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:40.760 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.761 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.762 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 73.486697281000005, 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.763 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:40.764 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:40.765 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.766 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.767 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.768 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 73.478674904000002, 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.769 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.770 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:40.771 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:40.772 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.773 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:40.774 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:40.775 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 73.467089618000003, 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.776 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.777 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:40.778 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:40.779 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.780 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:40.781 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 43.579737633999997, 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.782 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.783 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:40.784 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.785 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.786 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:40.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 43.574763664999999, 2024-09-12T18:15:40.788 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.789 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.790 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:40.791 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.792 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.793 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.794 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 43.574294735999999, 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.795 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.796 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:40.797 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.798 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.799 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:40.800 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 43.572253412000002, 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.801 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:40.802 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:40.803 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:40.804 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.805 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 43.571345643000001, 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.806 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.807 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:40.808 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.809 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:40.810 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:40.811 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 43.570917440000002, 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:40.812 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.813 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:40.814 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:40.815 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.910387292999999, 2024-09-12T18:15:40.816 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.817 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:40.818 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.819 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:40.820 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.821 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.822 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.908142671999997, 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.823 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.824 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:40.825 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.826 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:40.827 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.828 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:40.829 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.905609431000002, 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.830 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:40.831 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.832 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.833 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:40.834 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.835 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.905151441000001, 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:40.836 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.837 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.840 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:40.841 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:40.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.843 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.844 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.845 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.846 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.680653958999997, 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.847 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:40.848 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:40.849 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.850 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.851 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.853 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.853 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:40.855 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 35.680620429000001, 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.856 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:40.857 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.858 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.859 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.860 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:40.861 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.862 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 17.287666441999999, 2024-09-12T18:15:40.863 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.864 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.865 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:40.866 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.867 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.868 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:266074 5.7 5:e431e12e:::benchmark_data_smithi062_23645_object130965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:39.889039+0000", 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 0.85293649599999999, 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.041762335999999997, 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:40.869 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 266074 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889039+0000", 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889039+0000", 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:40.870 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889040+0000", 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1170000000000001e-06 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889045+0000", 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.871 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889057+0000", 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2575000000000001e-05 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889065+0000", 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0539999999999997e-06 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:40.872 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.890249+0000", 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011848049999999999 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.890326+0000", 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6847999999999993e-05 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.890435+0000", 2024-09-12T18:15:40.873 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000109033 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.892963+0000", 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025280150000000002 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.930709+0000", 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.037745954999999998 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.874 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.930763+0000", 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3372000000000003e-05 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.930802+0000", 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9144999999999999e-05 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.875 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:40.876 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:40.876 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:40.877 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:40.872+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:40.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:40.978 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:40.972+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:41.030 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268861 5.1 5:8013a3b5:::benchmark_data_smithi062_23645_object133752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.018175+0000", 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.010661288, 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010683686, 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.031 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268861 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018175+0000", 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018175+0000", 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018175+0000", 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3799999999999998e-07 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018178+0000", 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1859999999999999e-06 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018184+0000", 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1689999999999997e-06 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018189+0000", 2024-09-12T18:15:41.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0849999999999996e-06 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018456+0000", 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026719800000000001 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018572+0000", 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116365 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.018680+0000", 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010716 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.022169+0000", 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034894800000000001 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028812+0000", 2024-09-12T18:15:41.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066429820000000004 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028859+0000", 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7045000000000001e-05 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268884 5.5 5:a0f857ac:::benchmark_data_smithi062_23645_object133775:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.028381+0000", 2024-09-12T18:15:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00045520899999999998, 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00057544900000000001, 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268884 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028381+0000", 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028381+0000", 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028382+0000", 2024-09-12T18:15:41.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2899999999999999e-07 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028384+0000", 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3350000000000001e-06 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028390+0000", 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8560000000000003e-06 2024-09-12T18:15:41.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028395+0000", 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9409999999999998e-06 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028444+0000", 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8869999999999998e-05 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028565+0000", 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121462 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028668+0000", 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103053 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268885 5.a 5:5a6c0a85:::benchmark_data_smithi062_23645_object133776:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.028481+0000", 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00035565899999999998, 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054549600000000002, 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268885 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028481+0000", 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028481+0000", 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028482+0000", 2024-09-12T18:15:41.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.78e-07 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028486+0000", 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3619999999999999e-06 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028496+0000", 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028503+0000", 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8669999999999994e-06 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028554+0000", 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0816000000000003e-05 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028660+0000", 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000105645 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.046 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:268871 5.1 e77/49)", 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.028549+0000", 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00028699900000000002, 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053541600000000004, 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028549+0000", 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028549+0000", 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028550+0000", 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2900000000000003e-07 2024-09-12T18:15:41.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028554+0000", 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7330000000000001e-06 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028562+0000", 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2679999999999994e-06 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028568+0000", 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9989999999999997e-06 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268887 5.8 5:192186c8:::benchmark_data_smithi062_23645_object133778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.028889+0000", 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9999475, 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024145699999999999, 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.050 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268887 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.051 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028889+0000", 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028889+0000", 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028890+0000", 2024-09-12T18:15:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:15:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.056 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.056 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028894+0000", 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8909999999999997e-06 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028904+0000", 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0635000000000001e-05 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028912+0000", 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1210000000000007e-06 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028989+0000", 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6162999999999996e-05 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029131+0000", 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014292800000000001 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268888 5.4 5.7faa5874 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.029019+0000", 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9998178, 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017391100000000001, 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268888 2024-09-12T18:15:41.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029019+0000", 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029019+0000", 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029019+0000", 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1900000000000001e-07 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029023+0000", 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9829999999999998e-06 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029033+0000", 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5189999999999998e-06 2024-09-12T18:15:41.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029040+0000", 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5390000000000002e-06 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop_reply(client.4581.0:268877 5.9 e77/69)", 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.029040+0000", 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997964, 2024-09-12T18:15:41.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019998499999999999, 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029040+0000", 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029040+0000", 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029041+0000", 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8999999999999996e-07 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029044+0000", 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.41e-06 2024-09-12T18:15:41.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029052+0000", 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029057+0000", 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2510000000000002e-06 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029237+0000", 2024-09-12T18:15:41.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000179667 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029242+0000", 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8919999999999997e-06 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:268886 5.7 e77/21)", 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.029095+0000", 2024-09-12T18:15:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997416, 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000196999, 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029095+0000", 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029095+0000", 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029095+0000", 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6899999999999998e-07 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029099+0000", 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1300000000000003e-06 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029106+0000", 2024-09-12T18:15:41.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9689999999999997e-06 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029111+0000", 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6240000000000001e-06 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268889 5.4 5.b7c85154 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.029108+0000", 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9997287, 2024-09-12T18:15:41.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022526800000000001, 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268889 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029108+0000", 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029108+0000", 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029108+0000", 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3900000000000004e-07 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029111+0000", 2024-09-12T18:15:41.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.123e-06 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029120+0000", 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2360000000000004e-06 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029125+0000", 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7200000000000003e-06 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.072 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268890 5.4 5.7db1c0b4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.029215+0000", 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9996209, 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000167644, 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268890 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029215+0000", 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029215+0000", 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029216+0000", 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029219+0000", 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0539999999999999e-06 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029229+0000", 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6180000000000001e-06 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029236+0000", 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5259999999999996e-06 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268891 5.5 5.9e900f45 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.029355+0000", 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4294967295.9994817, 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7356999999999998e-05, 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "queued for pg", 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268891 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.077 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029355+0000", 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029355+0000", 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029356+0000", 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7700000000000004e-07 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029359+0000", 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.399e-06 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029367+0000", 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4640000000000006e-06 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029374+0000", 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0909999999999998e-06 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268877 5.9 5:90baecd9:::benchmark_data_smithi062_23645_object133768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.026023+0000", 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0028128939999999998, 2024-09-12T18:15:41.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003460397, 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268877 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026023+0000", 2024-09-12T18:15:41.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026023+0000", 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026024+0000", 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8500000000000001e-07 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026027+0000", 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8219999999999998e-06 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026035+0000", 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0350000000000001e-06 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026041+0000", 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9939999999999997e-06 2024-09-12T18:15:41.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.027051+0000", 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001009905 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.027157+0000", 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106223 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.027254+0000", 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7028999999999995e-05 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029247+0000", 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019930780000000001 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268878 5.f 5:fcb49fd0:::benchmark_data_smithi062_23645_object133769:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.085 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.026050+0000", 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0027863969999999999, 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035052109999999998, 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268878 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.086 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026050+0000", 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026050+0000", 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026050+0000", 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.39e-07 2024-09-12T18:15:41.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026053+0000", 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.272e-06 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026059+0000", 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5100000000000004e-06 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026064+0000", 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3730000000000001e-06 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026183+0000", 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118712 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026309+0000", 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012593899999999999 2024-09-12T18:15:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026422+0000", 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011248599999999999 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268882 5.4 5:2f87a846:::benchmark_data_smithi062_23645_object133773:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.026317+0000", 2024-09-12T18:15:41.090 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0025193989999999999, 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003301001, 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268882 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026317+0000", 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026317+0000", 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026317+0000", 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3099999999999998e-07 2024-09-12T18:15:41.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026320+0000", 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7700000000000002e-06 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026326+0000", 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8000000000000004e-06 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026330+0000", 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5499999999999999e-06 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029287+0000", 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029577200000000001 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029397+0000", 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011014 2024-09-12T18:15:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4581.0:268879 5.7 e77/21 5:e71c303f:::benchmark_data_smithi062_23645_object133770:head v 77'16595, mlcod=77'16593)", 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.026391+0000", 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.0024453500000000002, 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032812929999999998, 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "started", 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026391+0000", 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026391+0000", 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026392+0000", 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026397+0000", 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4750000000000001e-06 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026406+0000", 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0080000000000008e-06 2024-09-12T18:15:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.026412+0000", 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3459999999999999e-06 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028034+0000", 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016210210000000001 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028051+0000", 2024-09-12T18:15:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7937000000000001e-05 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:268883 5.1 5:823ad140:::benchmark_data_smithi062_23645_object133774:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:41.028347+0000", 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.00048940500000000005, 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013800220000000001, 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 268883 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028347+0000", 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028347+0000", 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028348+0000", 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0610000000000001e-06 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028352+0000", 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0069999999999999e-06 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028362+0000", 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8120000000000002e-06 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.028369+0000", 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3259999999999998e-06 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029494+0000", 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001125168 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029590+0000", 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6193000000000005e-05 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:41.029680+0000", 2024-09-12T18:15:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9149999999999999e-05 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 16 2024-09-12T18:15:41.104 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:41.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:41.106 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.102+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.206 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.202+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.304 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:41.304 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:41.305 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:41.305 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:41.305 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:41.307 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.302+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:41.414 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.410+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.482 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is set 2024-09-12T18:15:41.509 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.502+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.532 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:41.532 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:41.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.414148220000001, 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.533 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:41.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.400747113000001, 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.539 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:41.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:41.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.394173430999999, 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.544 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.394061516000001, 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:41.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:41.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.166407381999999, 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:41.554 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:41.558 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.166372501000001, 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:41.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:41.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:41.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.153333925999998, 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:41.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.572 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.141335812000001, 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:41.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.579 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.110603986000001, 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:41.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.586 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.104992430999999, 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:41.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:41.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.097822613000002, 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:41.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:41.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:41.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.076345494000002, 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:41.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:41.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:41.608 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.074346614, 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:41.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.615 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.061846404000001, 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:41.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.060512505999998, 2024-09-12T18:15:41.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:41.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:41.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.06014515, 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.630 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:41.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.05302017, 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:41.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:41.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.643 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.052477744000001, 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:41.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:41.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:41.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.042478769999999, 2024-09-12T18:15:41.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:41.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.040058795, 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:41.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:41.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:41.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:41.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:41.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.664 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:41.664 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:41.664 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:41.666 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Removed 135106 objects 2024-09-12T18:15:41.666 INFO:tasks.radosbench.radosbench.0.smithi062.stdout:Clean up completed and total clean up time :61.1731 2024-09-12T18:15:41.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:41.667 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.662+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.767 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:41.764+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:41.795 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:41.795 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:41.795 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 0 2024-09-12T18:15:41.795 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:41.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:41.867 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:41.862+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:41.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:15:41.968 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:41.964+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:41.976 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:41.976 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:41.976 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:41.977 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:41.977 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:41.990 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:42.025 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:42.047 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:42.047 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:42.066 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:42.066 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:42.070 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:42.070 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:42.071 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:42.066+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:42.153 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:42.153 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:42.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:42.170 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:42.166+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:42.271 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:42.268+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:42.293 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:42.293 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:42.306 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:42.371 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:42.366+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:42.416 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:42.416 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:42.428 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:42.513 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:42.510+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:42.573 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:42.572+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:42.583 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:42.583 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:42.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:42.674 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:42.668+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:42.726 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:42.726 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:42.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:42.775 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:42.774+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:42.876 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:42.872+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:42.906 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:42.906 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:42.920 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:42.977 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:42.970+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:43.078 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:43.072+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:43.090 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.090 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.104 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:43.179 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:43.176+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:43.229 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.229 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:43.285 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:43.282+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:43.358 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.358 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:43.380 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:43.376+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:43.481 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:43.480+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:43.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:15:43.526 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.527 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.539 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:43.581 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:43.578+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:43.672 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.672 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.682 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:43.682+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:43.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:43.783 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:43.780+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:43.806 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.806 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.821 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:43.884 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:43.882+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:43.979 INFO:teuthology.orchestra.run.smithi176.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:43.979 INFO:teuthology.orchestra.run.smithi176.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:43.986 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:43.982+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:43.993 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:15:44.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:15:44.087 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:44.082+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:44.122 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-09-12T18:15:44.122 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:15:44.137 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:15:44.179 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-12T18:15:44.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-12T18:15:44.188 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:44.184+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:44.212 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T18:15:44.232 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1: {} 2024-09-12T18:15:44.232 INFO:teuthology.orchestra.run.smithi062.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:15:44.253 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2: {} 2024-09-12T18:15:44.253 INFO:teuthology.orchestra.run.smithi062.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:15:44.257 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T18:15:44.257 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T18:15:44.289 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T18:15:44.282+0000 7f2bf94b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22908) UID: 0 2024-09-12T18:15:44.301 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:44.302 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-09-12T18:15:44.302 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-09-12T18:15:44.302 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-09-12T18:15:44.302 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:44.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:15:44.390 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:44.388+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151538 5.9 5.8d148979 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 56.363814210999998, 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0272832489999999, 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.482 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151538 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116253+0000", 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116254+0000", 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3799999999999997e-07 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116256+0000", 2024-09-12T18:15:44.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3659999999999999e-06 2024-09-12T18:15:44.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116263+0000", 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.116269+0000", 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9739999999999999e-06 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120797+0000", 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045279789999999997 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.120804+0000", 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143524+0000", 2024-09-12T18:15:44.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0227202259999999 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143536+0000", 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.239e-05 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151554 5.f 5.5b24210f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:44.488 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 56.350413103999998, 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012614591, 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151554 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129654+0000", 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129655+0000", 2024-09-12T18:15:44.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1799999999999995e-07 2024-09-12T18:15:44.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129658+0000", 2024-09-12T18:15:44.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3170000000000002e-06 2024-09-12T18:15:44.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129666+0000", 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129672+0000", 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5489999999999997e-06 2024-09-12T18:15:44.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129722+0000", 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9870000000000002e-05 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.129728+0000", 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8410000000000002e-06 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142261+0000", 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.012532403 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142269+0000", 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0099999999999995e-06 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.495 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151562 5.f 5.a7d0985f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 56.343839422000002, 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0060718740000001, 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.496 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151562 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136228+0000", 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136229+0000", 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136232+0000", 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.703e-06 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136243+0000", 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0581000000000001e-05 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136248+0000", 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2460000000000003e-06 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136289+0000", 2024-09-12T18:15:44.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0852999999999997e-05 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136295+0000", 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5010000000000004e-06 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142292+0000", 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0059968720000001 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.142300+0000", 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2930000000000001e-06 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:151564 5.9 5.9c9d9a39 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:15:44.501 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 56.343727506999997, 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0072361869999999, 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 151564 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136340+0000", 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0500000000000004e-07 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136343+0000", 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136348+0000", 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1869999999999996e-06 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136351+0000", 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4920000000000002e-06 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136397+0000", 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5658999999999998e-05 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:48.136404+0000", 2024-09-12T18:15:44.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5270000000000004e-06 2024-09-12T18:15:44.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143566+0000", 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0071627869999999 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:14:49.143576+0000", 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6399999999999992e-06 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229228 5.9 5:93f48a60:::benchmark_data_smithi062_23645_object94119:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.116073372999999, 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0684162399999999, 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "reached pg", 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229228 2024-09-12T18:15:44.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363994+0000", 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363995+0000", 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0210000000000001e-06 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.363999+0000", 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:44.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364009+0000", 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8490000000000001e-06 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364016+0000", 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9739999999999996e-06 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368574+0000", 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045573419999999998 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368581+0000", 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0249999999999997e-06 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432320+0000", 2024-09-12T18:15:44.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0637390659999999 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432410+0000", 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0545999999999997e-05 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229234 5.9 5:91a45154:::benchmark_data_smithi062_23645_object94125:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.116038492000001, 2024-09-12T18:15:44.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.094482835, 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229234 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364029+0000", 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364030+0000", 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5099999999999999e-07 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364032+0000", 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4049999999999998e-06 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364039+0000", 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9450000000000004e-06 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.364045+0000", 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1410000000000002e-06 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368648+0000", 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046027120000000001 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.368654+0000", 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6320000000000002e-06 2024-09-12T18:15:44.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.432960+0000", 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0643053099999999 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433062+0000", 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000102117 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.433415+0000", 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035316999999999998 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447744+0000", 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014329184999999999 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458387+0000", 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010642983999999999 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458444+0000", 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6570000000000002e-05 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458512+0000", 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8013000000000001e-05 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.520 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229257 5.9 5:99f2d145:::benchmark_data_smithi062_23645_object94148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.102999916999998, 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0875336120000001, 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229257 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.521 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377067+0000", 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377068+0000", 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377071+0000", 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8760000000000001e-06 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377077+0000", 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5119999999999997e-06 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377083+0000", 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4190000000000001e-06 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377171+0000", 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7861000000000005e-05 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.377180+0000", 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1789999999999997e-06 2024-09-12T18:15:44.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442013+0000", 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0648333720000001 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442214+0000", 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020118800000000001 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.442398+0000", 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018388899999999999 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450291+0000", 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078926480000000004 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464521+0000", 2024-09-12T18:15:44.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01422962 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464556+0000", 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5110000000000001e-05 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464601+0000", 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5367000000000001e-05 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.527 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229284 5.9 5:92fd1a21:::benchmark_data_smithi062_23645_object94175:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.091001803000001, 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.075659903, 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229284 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389066+0000", 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1299999999999999e-07 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389070+0000", 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5250000000000001e-06 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389076+0000", 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6440000000000003e-06 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389082+0000", 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2979999999999999e-06 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389137+0000", 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5569000000000003e-05 2024-09-12T18:15:44.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.389145+0000", 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8310000000000001e-06 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444473+0000", 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0553279440000001 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444610+0000", 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137219 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.444738+0000", 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012727800000000001 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450297+0000", 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055595469999999998 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464637+0000", 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014339971 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464671+0000", 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4004999999999997e-05 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.464725+0000", 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4358999999999999e-05 2024-09-12T18:15:44.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229348 5.9 5:9cbc6d9e:::benchmark_data_smithi062_23645_object94239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.060269977000001, 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0497983769999999, 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229348 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419797+0000", 2024-09-12T18:15:44.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419798+0000", 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4199999999999995e-07 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419802+0000", 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.495e-06 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419809+0000", 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8150000000000006e-06 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419815+0000", 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9150000000000001e-06 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419862+0000", 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6312e-05 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.419880+0000", 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8609000000000001e-05 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446019+0000", 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.026139227 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446183+0000", 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016336899999999999 2024-09-12T18:15:44.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.446296+0000", 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011315900000000001 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452409+0000", 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061132840000000001 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469507+0000", 2024-09-12T18:15:44.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017097836000000002 2024-09-12T18:15:44.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469538+0000", 2024-09-12T18:15:44.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0514999999999998e-05 2024-09-12T18:15:44.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469596+0000", 2024-09-12T18:15:44.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8199000000000003e-05 2024-09-12T18:15:44.544 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.544 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229358 5.9 5:9b0ecc93:::benchmark_data_smithi062_23645_object94249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.054658421999999, 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0443691349999999, 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.545 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229358 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425409+0000", 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425410+0000", 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425413+0000", 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3909999999999998e-06 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425421+0000", 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1960000000000008e-06 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425442+0000", 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0421999999999999e-05 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425672+0000", 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000230299 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.425679+0000", 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1709999999999996e-06 2024-09-12T18:15:44.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447801+0000", 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0221215960000001 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.447923+0000", 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122104 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448032+0000", 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010906 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452420+0000", 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043878060000000002 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469636+0000", 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017216682000000001 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469676+0000", 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9994999999999999e-05 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.469778+0000", 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101723 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229371 5.9 5:981063e7:::benchmark_data_smithi062_23645_object94262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.551 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.047488604000002, 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.041000218, 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229371 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432579+0000", 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432580+0000", 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.125e-06 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432584+0000", 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8589999999999998e-06 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432592+0000", 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1000000000000004e-06 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432596+0000", 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4490000000000001e-06 2024-09-12T18:15:44.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432671+0000", 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4431999999999995e-05 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.432678+0000", 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5410000000000003e-06 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.448997+0000", 2024-09-12T18:15:44.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0163187970000001 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449097+0000", 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9926000000000005e-05 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.449191+0000", 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4289000000000005e-05 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455382+0000", 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061902800000000003 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473473+0000", 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018091781000000001 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473514+0000", 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0899000000000003e-05 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473579+0000", 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4739999999999993e-05 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.558 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229411 5.9 5:98a11946:::benchmark_data_smithi062_23645_object94302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.026011485000001, 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.019852891, 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229411 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454056+0000", 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454060+0000", 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5559999999999999e-06 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454067+0000", 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8859999999999998e-06 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454071+0000", 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6839999999999998e-06 2024-09-12T18:15:44.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454136+0000", 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5685999999999994e-05 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.454143+0000", 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9190000000000002e-06 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450331+0000", 2024-09-12T18:15:44.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99618796399999998 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450416+0000", 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4522000000000002e-05 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.450488+0000", 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1975000000000001e-05 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455388+0000", 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048998440000000004 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473654+0000", 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018266858 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473750+0000", 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5729000000000005e-05 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.473909+0000", 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015869199999999999 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229416 5.9 5:9b9821b3:::benchmark_data_smithi062_23645_object94307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.024012604999999, 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.027401791, 2024-09-12T18:15:44.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229416 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456055+0000", 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456056+0000", 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456059+0000", 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4769999999999999e-06 2024-09-12T18:15:44.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456067+0000", 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1110000000000008e-06 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456077+0000", 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4679999999999998e-06 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456111+0000", 2024-09-12T18:15:44.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3924000000000002e-05 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.456115+0000", 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4900000000000002e-06 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451276+0000", 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.99516128100000001 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451371+0000", 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4832000000000003e-05 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.451463+0000", 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1476000000000003e-05 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457321+0000", 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058582340000000004 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483361+0000", 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026039887000000001 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483393+0000", 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2699e-05 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483457+0000", 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3132000000000005e-05 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229432 5.9 5:970991ec:::benchmark_data_smithi062_23645_object94323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.011512395, 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.01503857, 2024-09-12T18:15:44.572 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229432 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468555+0000", 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468556+0000", 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7899999999999997e-07 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468560+0000", 2024-09-12T18:15:44.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.929e-06 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468570+0000", 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0222e-05 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468576+0000", 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2360000000000001e-06 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468615+0000", 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8689000000000002e-05 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.468620+0000", 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8670000000000002e-06 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452464+0000", 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.983843998 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452537+0000", 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.326e-05 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.452611+0000", 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4356000000000004e-05 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457327+0000", 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004715688 2024-09-12T18:15:44.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483509+0000", 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026182297 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483537+0000", 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7682e-05 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.483594+0000", 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.6467e-05 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229434 5.9 5:98b60655:::benchmark_data_smithi062_23645_object94325:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.010178496999998, 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018521158, 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229434 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469889+0000", 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469890+0000", 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5099999999999998e-07 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469894+0000", 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9280000000000003e-06 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469904+0000", 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0107e-05 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469910+0000", 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.652e-06 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469987+0000", 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6495999999999994e-05 2024-09-12T18:15:44.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.469991+0000", 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4719999999999997e-06 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453393+0000", 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98340172999999997 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453461+0000", 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8213000000000006e-05 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.453532+0000", 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1076999999999997e-05 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457333+0000", 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038004890000000002 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488301+0000", 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030967716999999999 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488348+0000", 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7466000000000003e-05 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488410+0000", 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1959999999999996e-05 2024-09-12T18:15:44.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229435 5.9 5:9e4ad2fd:::benchmark_data_smithi062_23645_object94326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.009811141, 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.018291448, 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229435 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470256+0000", 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470257+0000", 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.37e-07 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470260+0000", 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5080000000000001e-06 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470272+0000", 2024-09-12T18:15:44.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1405e-05 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470279+0000", 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7819999999999996e-06 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470322+0000", 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3656999999999999e-05 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.470329+0000", 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999996e-06 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454339+0000", 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.98400972499999995 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454485+0000", 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014619000000000001 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.454597+0000", 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011145 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458520+0000", 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039229640000000001 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488456+0000", 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.029936094999999999 2024-09-12T18:15:44.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488488+0000", 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2586000000000003e-05 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488548+0000", 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9336000000000002e-05 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229442 5.9 5:9ef29a0a:::benchmark_data_smithi062_23645_object94333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.002686161, 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.011344164, 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229442 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.593 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477381+0000", 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477382+0000", 2024-09-12T18:15:44.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6899999999999996e-07 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477386+0000", 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0289999999999999e-06 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477398+0000", 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2325e-05 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477405+0000", 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8700000000000003e-06 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477444+0000", 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8670000000000001e-05 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477450+0000", 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8390000000000003e-06 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455419+0000", 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97796923300000005 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455493+0000", 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3584999999999994e-05 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.455560+0000", 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7087000000000003e-05 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458522+0000", 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029625739999999999 2024-09-12T18:15:44.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488637+0000", 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030114569000000001 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488665+0000", 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.815e-05 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488725+0000", 2024-09-12T18:15:44.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0364e-05 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229443 5.9 5:9b8fad98:::benchmark_data_smithi062_23645_object94334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.002143735000001, 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0109899449999999, 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229443 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:44.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477924+0000", 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477927+0000", 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7860000000000001e-06 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477936+0000", 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9609999999999994e-06 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477940+0000", 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4089999999999996e-06 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477993+0000", 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2633000000000002e-05 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.477998+0000", 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0860000000000001e-06 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456341+0000", 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.97834342900000004 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456428+0000", 2024-09-12T18:15:44.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6364000000000002e-05 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.456524+0000", 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6459999999999995e-05 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458528+0000", 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002003576 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488799+0000", 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030271128000000001 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488832+0000", 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3448000000000002e-05 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.488914+0000", 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1172000000000001e-05 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229449 5.9 5:9d4b5e31:::benchmark_data_smithi062_23645_object94340:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.992144760999999, 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0031417419999999, 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229449 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487923+0000", 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.68e-07 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487927+0000", 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.32e-06 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487936+0000", 2024-09-12T18:15:44.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2150000000000007e-06 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487941+0000", 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.938e-06 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487990+0000", 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9166999999999999e-05 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.487995+0000", 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8790000000000002e-06 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457370+0000", 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.96937491899999995 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457453+0000", 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3378e-05 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.457538+0000", 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4485000000000002e-05 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459443+0000", 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019058230000000001 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490925+0000", 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031481806000000001 2024-09-12T18:15:44.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.490999+0000", 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3946e-05 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491064+0000", 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5197999999999995e-05 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4581.0:229450 5.9 5:95aca146:::benchmark_data_smithi062_23645_object94341:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 21.989724786, 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.000900106, 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4581", 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 229450 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.614 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490343+0000", 2024-09-12T18:15:44.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8999999999999995e-07 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490347+0000", 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9439999999999998e-06 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490361+0000", 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3325e-05 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-09-12T18:15:44.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490366+0000", 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0889999999999999e-06 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490399+0000", 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3151999999999997e-05 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for peered", 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:22.490403+0000", 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.34e-06 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458550+0000", 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.968146956 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458620+0000", 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9906999999999993e-05 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.458687+0000", 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6755999999999996e-05 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.459699+0000", 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010125990000000001 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491105+0000", 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031405384000000001 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491157+0000", 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2292e-05 2024-09-12T18:15:44.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-09-12T18:15:23.491243+0000", 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5572e-05 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-12T18:15:44.620 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-12T18:15:44.621 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:15:44.623 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:15:44.623 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'unique_pool_0' removed 2024-09-12T18:15:44.623 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T18:15:44.635 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T18:15:44.637 INFO:tasks.ceph.osd.2.smithi176.stderr:2024-09-12T18:15:44.616+0000 7f87cc65d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22983) UID: 0 2024-09-12T18:15:44.767 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:44.767 INFO:teuthology.orchestra.run.smithi176.stdout: "num_ops": 0 2024-09-12T18:15:44.767 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:44.781 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:15:44.901 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:44.901 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [], 2024-09-12T18:15:44.901 INFO:teuthology.orchestra.run.smithi176.stdout: "complaint_time": 30, 2024-09-12T18:15:44.901 INFO:teuthology.orchestra.run.smithi176.stdout: "num_blocked_ops": 0 2024-09-12T18:15:44.901 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:44.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "size": 20, 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 600, 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "ops": [ 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 152.73922025900001, 2024-09-12T18:15:45.036 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65355807300000002, 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4170", 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/845414196", 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 1 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:45.037 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294161+0000", 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294163+0000", 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.7599999999999998e-06 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.038 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294177+0000", 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3550000000000001e-05 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294198+0000", 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.0574e-05 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294214+0000", 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6200000000000001e-05 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.039 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294338+0000", 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012449499999999999 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for peered", 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.294352+0000", 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.365e-05 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944451+0000", 2024-09-12T18:15:45.040 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.65009909600000004 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.944840+0000", 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00038852 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.945306+0000", 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00046654299999999998 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.041 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947199+0000", 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.001893409 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947514+0000", 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00031429100000000002 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947606+0000", 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1935999999999995e-05 2024-09-12T18:15:45.042 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:12.947719+0000", 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011304899999999999 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 141.63885978100001, 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034196158999999997, 2024-09-12T18:15:45.043 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394521+0000", 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.044 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394522+0000", 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.394528+0000", 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0299999999999999e-06 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.045 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395284+0000", 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00075546100000000002 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395300+0000", 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6710000000000001e-05 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.413950+0000", 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.018649145999999998 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.046 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414259+0000", 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00030919699999999999 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.414597+0000", 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00033771499999999999 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.419874+0000", 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052770689999999997 2024-09-12T18:15:45.047 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.427920+0000", 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0080460570000000006 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428607+0000", 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00068759500000000005 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428717+0000", 2024-09-12T18:15:45.048 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011003899999999999 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 141.637921205, 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.033696202000000001, 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.049 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.050 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.050 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.050 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395460+0000", 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.051 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395461+0000", 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.356e-06 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395469+0000", 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9370000000000004e-06 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395486+0000", 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.666e-05 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.052 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.395499+0000", 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3443e-05 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415297+0000", 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.019797604999999999 2024-09-12T18:15:45.053 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415585+0000", 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00028862700000000001 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.415993+0000", 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00040721000000000003 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.054 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.421370+0000", 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0053774290000000004 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.055 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.428871+0000", 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0075013049999999998 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429021+0000", 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000149462 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.056 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:13:23.429156+0000", 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013516799999999999 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109284 5.f 5:fc7e56af:::benchmark_data_smithi062_23645_object109283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 77.778102347000001, 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050237445999999998, 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.057 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109284 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.058 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.059 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:45.059 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.059 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.059 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255279+0000", 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.6699999999999999e-07 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.060 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255312+0000", 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3439999999999998e-05 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255319+0000", 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.5150000000000003e-06 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.255323+0000", 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1470000000000003e-06 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.061 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257532+0000", 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022085030000000001 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257654+0000", 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012283199999999999 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.257787+0000", 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00013269200000000001 2024-09-12T18:15:45.062 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.262991+0000", 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0052040519999999998 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305338+0000", 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042346677999999999 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.063 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305467+0000", 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012908400000000001 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.305516+0000", 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9036000000000003e-05 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109296 5.f 5:f1a4363b:::benchmark_data_smithi062_23645_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:45.064 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 77.770079969999998, 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.046169457999999997, 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109296 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.065 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263301+0000", 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263302+0000", 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.9699999999999995e-07 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.066 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263365+0000", 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.2991999999999996e-05 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263374+0000", 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9549999999999998e-06 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263379+0000", 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9520000000000002e-06 2024-09-12T18:15:45.067 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263427+0000", 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7932000000000001e-05 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263547+0000", 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000120426 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:45.068 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.263677+0000", 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000129858 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.266289+0000", 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002612138 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309282+0000", 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.042992612999999999 2024-09-12T18:15:45.069 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309389+0000", 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010751000000000001 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.309470+0000", 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1285000000000005e-05 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.070 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:109307 5.9 5:9e0e8170:::benchmark_data_smithi062_23645_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 77.758494683999999, 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.035380923000000002, 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.071 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 109307 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.072 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274886+0000", 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274887+0000", 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7300000000000002e-07 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274928+0000", 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.1888999999999998e-05 2024-09-12T18:15:45.073 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274936+0000", 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.379e-06 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274940+0000", 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.6440000000000002e-06 2024-09-12T18:15:45.074 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.274995+0000", 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5744e-05 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275152+0000", 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015694799999999999 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 0", 2024-09-12T18:15:45.075 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.275337+0000", 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00018448800000000001 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.277730+0000", 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0023934329999999999 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310137+0000", 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.032407061000000001 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.076 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310213+0000", 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6081999999999994e-05 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:27.310267+0000", 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3881999999999997e-05 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.077 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168081 5.9 5:92adb22f:::benchmark_data_smithi062_23645_object32972:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 47.8711427, 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.060950788999999998, 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.078 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168081 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.079 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162238+0000", 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162239+0000", 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2399999999999997e-07 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162242+0000", 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.3500000000000001e-06 2024-09-12T18:15:45.080 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162251+0000", 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.8510000000000005e-06 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.162257+0000", 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1650000000000003e-06 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.081 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163107+0000", 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00084944800000000004 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163193+0000", 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.6594999999999993e-05 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.163281+0000", 2024-09-12T18:15:45.082 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7633000000000006e-05 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.165200+0000", 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0019193560000000001 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.222929+0000", 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057728111999999998 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.083 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223034+0000", 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010501 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223189+0000", 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015544500000000001 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.084 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168092 5.9 5:912065ad:::benchmark_data_smithi062_23645_object32983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 47.866168731000002, 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057020399999999999, 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168092 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.085 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167212+0000", 2024-09-12T18:15:45.086 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.088 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.088 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.088 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167213+0000", 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.0699999999999997e-07 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167215+0000", 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2929999999999999e-06 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167221+0000", 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.3550000000000001e-06 2024-09-12T18:15:45.089 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167226+0000", 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.724e-06 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167272+0000", 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5930999999999998e-05 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.090 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167396+0000", 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123905 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167514+0000", 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117633 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170845+0000", 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0033317580000000002 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.091 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223977+0000", 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.053131890000000001 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224071+0000", 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.3341e-05 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224233+0000", 2024-09-12T18:15:45.092 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000162063 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:168097 5.9 5:98a6189d:::benchmark_data_smithi062_23645_object32988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 47.865699802000002, 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056797186, 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.093 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 168097 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167681+0000", 2024-09-12T18:15:45.094 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167682+0000", 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167686+0000", 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7680000000000002e-06 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.095 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167694+0000", 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7439999999999996e-06 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.167699+0000", 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.3959999999999999e-06 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169366+0000", 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0016675119999999999 2024-09-12T18:15:45.096 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169455+0000", 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9012999999999996e-05 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169535+0000", 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0284000000000006e-05 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.223910+0000", 2024-09-12T18:15:45.097 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.054374104999999999 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224287+0000", 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00037733999999999999 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224355+0000", 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8066999999999997e-05 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.098 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.224478+0000", 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012334100000000001 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168096 5.3 e58/53 5:c7e65bd3:::benchmark_data_smithi062_23645_object32987:head v 58'10644, mlcod=58'10641)", 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 47.863658477999998, 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057265334000000001, 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.099 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169722+0000", 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.100 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169723+0000", 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.5799999999999998e-07 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169729+0000", 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3820000000000003e-06 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.101 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169739+0000", 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0285999999999999e-05 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169745+0000", 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4899999999999997e-06 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169794+0000", 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.8378999999999999e-05 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.102 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.169810+0000", 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.6562000000000002e-05 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226918+0000", 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.057107777999999998 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.226988+0000", 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9698999999999998e-05 2024-09-12T18:15:45.103 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168099 5.2 e58/49 5:4c4ff9e0:::benchmark_data_smithi062_23645_object32990:head v 58'10539, mlcod=58'10535)", 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 47.862750708999997, 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056495575999999999, 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.104 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170630+0000", 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170631+0000", 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.7099999999999997e-07 2024-09-12T18:15:45.105 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170634+0000", 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.9919999999999999e-06 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170640+0000", 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.703e-06 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.106 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170645+0000", 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4859999999999999e-06 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170685+0000", 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0391e-05 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.170696+0000", 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0885e-05 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.107 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227099+0000", 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.056402842000000002 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.227126+0000", 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6906e-05 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.108 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:168101 5.3 e58/53 5:c1c73eed:::benchmark_data_smithi062_23645_object32992:head v 58'10645, mlcod=58'10641)", 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 47.862322505999998, 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.058351930000000003, 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.109 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171058+0000", 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171059+0000", 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.171063+0000", 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:15:45.110 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221827+0000", 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.050763439 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221849+0000", 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.2313000000000001e-05 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.111 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221931+0000", 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.2226999999999997e-05 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.221944+0000", 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.3269e-05 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229285+0000", 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0073408800000000001 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.112 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:14:57.229410+0000", 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012504200000000001 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187002 5.f 5:f316353f:::benchmark_data_smithi062_23645_object51893:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 40.201792359000002, 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070794217000000007, 2024-09-12T18:15:45.113 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187002 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:45.114 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831589+0000", 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.6199999999999998e-07 2024-09-12T18:15:45.115 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831592+0000", 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.6630000000000002e-06 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831598+0000", 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.0929999999999999e-06 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.116 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.831602+0000", 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4399999999999998e-06 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834135+0000", 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002532407 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834293+0000", 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00015864899999999999 2024-09-12T18:15:45.117 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.834449+0000", 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000155966 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836737+0000", 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0022878529999999998 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.118 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902251+0000", 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065514103000000004 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902321+0000", 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9879e-05 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.902383+0000", 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.1601999999999997e-05 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.119 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187007 5.f 5:fa60fcab:::benchmark_data_smithi062_23645_object51898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 40.199547738, 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.073567225999999999, 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.120 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187007 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833833+0000", 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.121 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833834+0000", 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.6200000000000006e-07 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833838+0000", 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.861e-06 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833847+0000", 2024-09-12T18:15:45.122 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.9150000000000002e-06 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.833852+0000", 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3970000000000002e-06 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836778+0000", 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029260470000000002 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.123 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836895+0000", 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117039 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837019+0000", 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000123201 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840196+0000", 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.003177156 2024-09-12T18:15:45.124 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907284+0000", 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067088728 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907319+0000", 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4147999999999999e-05 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907400+0000", 2024-09-12T18:15:45.125 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1772000000000002e-05 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187013 5.f 5:f1ff814a:::benchmark_data_smithi062_23645_object51904:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 40.197014496999998, 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.071430805, 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.126 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187013 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.127 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836366+0000", 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836368+0000", 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.308e-06 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836372+0000", 2024-09-12T18:15:45.128 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.5229999999999997e-06 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836382+0000", 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.0234000000000001e-05 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836390+0000", 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.1729999999999998e-06 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.129 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838841+0000", 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.002451586 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.838943+0000", 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00010186100000000001 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.839014+0000", 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0711999999999997e-05 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.130 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.841167+0000", 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0021529209999999999 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907484+0000", 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.066316895000000001 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907601+0000", 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000117293 2024-09-12T18:15:45.131 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907797+0000", 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00019629900000000001 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187015 5.9 5:9ca7fd1c:::benchmark_data_smithi062_23645_object51906:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:45.132 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 40.196556506999997, 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.070783671000000006, 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187015 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:45.133 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836824+0000", 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836826+0000", 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.116e-06 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836831+0000", 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.22e-06 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836841+0000", 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.8970000000000003e-06 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836848+0000", 2024-09-12T18:15:45.135 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.3300000000000001e-06 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.836896+0000", 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.7561000000000001e-05 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837015+0000", 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000119627 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.136 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.837102+0000", 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7143000000000002e-05 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.840056+0000", 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0029535960000000002 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907490+0000", 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.067434556000000007 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.137 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907540+0000", 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.9233000000000001e-05 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:04.907608+0000", 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.8392000000000005e-05 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.138 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187389 5.7 5:ec7df4f9:::benchmark_data_smithi062_23645_object52280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.972059025, 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.06656724, 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187389 2024-09-12T18:15:45.139 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:45.140 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061322+0000", 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5599999999999995e-07 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061326+0000", 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.2279999999999998e-06 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.141 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061335+0000", 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.0899999999999994e-06 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061341+0000", 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.4729999999999997e-06 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061397+0000", 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.5699000000000003e-05 2024-09-12T18:15:45.142 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061522+0000", 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00012520899999999999 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061632+0000", 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00011001399999999999 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.143 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.063653+0000", 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0020207490000000001 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127716+0000", 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.064062683999999995 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127808+0000", 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.1957000000000001e-05 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.144 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127889+0000", 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.1581000000000004e-05 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:187390 5.f 5:f4fd27e7:::benchmark_data_smithi062_23645_object52281:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 39.972025494999997, 2024-09-12T18:15:45.145 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.065991046999999997, 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 187390 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:45.146 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061355+0000", 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061356+0000", 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.7100000000000002e-07 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.147 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061359+0000", 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.649e-06 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061366+0000", 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0210000000000002e-06 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061374+0000", 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.0860000000000002e-06 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.148 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061434+0000", 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.9787000000000002e-05 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061531+0000", 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 9.7948000000000005e-05 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.061619+0000", 2024-09-12T18:15:45.149 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 8.7763999999999995e-05 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.064226+0000", 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0026065419999999999 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127060+0000", 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.062834412000000006 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.150 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127168+0000", 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000107732 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:05.127346+0000", 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.00017853500000000001 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.151 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_repop(client.4581.0:229434 5.9 e70/69 5:98b60655:::benchmark_data_smithi062_23645_object94325:head v 70'14347, mlcod=0'0)", 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 21.579071507999998, 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.034467135000000003, 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:45.152 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454309+0000", 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454312+0000", 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 2.153e-06 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.153 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454324+0000", 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.221e-05 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454342+0000", 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.8097e-05 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.454355+0000", 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2907e-05 2024-09-12T18:15:45.154 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472087+0000", 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.017732477999999999 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.472122+0000", 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.4326999999999998e-05 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.155 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488707+0000", 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.016585600999999998 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:23.488777+0000", 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 6.9362000000000004e-05 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.156 INFO:teuthology.orchestra.run.smithi176.stdout: "description": "osd_op(client.4581.0:266074 5.7 5:e431e12e:::benchmark_data_smithi062_23645_object130965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "initiated_at": "2024-09-12T18:15:39.889039+0000", 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "age": 5.1443415620000001, 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.041762335999999997, 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "continuous": false, 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "client_info": { 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "client": "client.4581", 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "client_addr": "172.21.15.62:0/2044369539", 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "tid": 266074 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ 2024-09-12T18:15:45.157 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated", 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889039+0000", 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "header_read", 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889039+0000", 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled", 2024-09-12T18:15:45.158 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889040+0000", 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.1170000000000001e-06 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "all_read", 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889045+0000", 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 4.4170000000000002e-06 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "dispatched", 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889057+0000", 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 1.2575000000000001e-05 2024-09-12T18:15:45.159 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg", 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.889065+0000", 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.0539999999999997e-06 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "reached_pg", 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.890249+0000", 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0011848049999999999 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.160 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "started", 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.890326+0000", 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 7.6847999999999993e-05 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "waiting for subops from 1", 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.890435+0000", 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.000109033 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "op_commit", 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.892963+0000", 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.0025280150000000002 2024-09-12T18:15:45.161 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.930709+0000", 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.037745954999999998 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "commit_sent", 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.930763+0000", 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 5.3372000000000003e-05 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: { 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done", 2024-09-12T18:15:45.162 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2024-09-12T18:15:39.930802+0000", 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 3.9144999999999999e-05 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-12T18:15:45.163 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-12T18:15:45.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-09-12T18:15:46.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:15:47.525 INFO:teuthology.orchestra.run.smithi062.stderr:noscrub is unset 2024-09-12T18:15:47.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:15:48.536 INFO:teuthology.orchestra.run.smithi062.stderr:nodeep-scrub is unset 2024-09-12T18:15:50.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-09-12T18:15:56.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-09-12T18:16:02.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-09-12T18:16:08.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-09-12T18:16:14.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-09-12T18:16:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-09-12T18:16:25.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-09-12T18:16:31.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~123s 2024-09-12T18:16:37.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~129s 2024-09-12T18:16:43.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-09-12T18:16:49.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2024-09-12T18:16:54.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~146s 2024-09-12T18:17:00.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~152s 2024-09-12T18:17:06.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~158s 2024-09-12T18:17:12.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~163s 2024-09-12T18:17:18.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~169s 2024-09-12T18:17:22.158 DEBUG:teuthology.orchestra.console.smithi129:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  e t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 61 GUID: 00000000 0000 0000 0000 0CC47AD91938 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.129 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.129 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:61)... Configuring (net0 0c:c4:7a:88:72:61).... Configuring (net0 0c:c4:7a:88:72:61)..... Configuring (net0 0c:c4:7a:88:72:61)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-119-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-119-generic (buildd@lcy02-amd64-075) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #129-Ubuntu SMP Fri Aug 2 19:25:20 UTC 2024 (Ubuntu 5.15.0-119.129-generic 5.15.160) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-119-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec0fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f73000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.629 MHz processor [ 0.000412] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000598] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001910] last_pfn = 0x78ec1 max_arch_pfn = 0x400000000 [ 0.008361] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008375] Using GB pages for direct mapping [ 0.008495] RAMDISK: [mem 0x300bf000-0x34056fff] [ 0.008501] ACPI: Early table checksum verification disabled [ 0.008504] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008508] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.008513] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008518] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008521] ACPI: FACS 0x0000000079D48F80 000040 [ 0.008524] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008527] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008530] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008532] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008535] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008538] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008541] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008544] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008546] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008549] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008552] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008555] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008558] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008561] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008563] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008566] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008569] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008571] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.008573] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.008574] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.008575] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.008576] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.008577] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.008578] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.008579] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.008580] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.008581] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.008582] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.008583] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.008584] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.008585] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.008586] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.008587] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.008588] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.008589] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.008590] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.008591] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.008686] No NUMA configuration found [ 0.008687] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008696] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009038] Zone ranges: [ 0.009039] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009041] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009043] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009044] Device empty [ 0.009045] Movable zone start for each node [ 0.009048] Early memory node ranges [ 0.009049] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.009050] node 0: [mem 0x0000000000100000-0x0000000078ec0fff] [ 0.009051] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009055] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009060] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009094] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.080768] On node 0, zone Normal: 28991 pages in unavailable ranges [ 0.080882] ACPI: PM-Timer IO Port: 0x408 [ 0.080890] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080892] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080893] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080894] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080895] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080896] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080896] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080897] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080907] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080911] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080913] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080915] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080919] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080920] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080924] TSC deadline timer available [ 0.080925] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080935] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080937] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.080938] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080940] PM: hibernation: Registered nosave memory: [mem 0x78ec1000-0x78f72fff] [ 0.080941] PM: hibernation: Registered nosave memory: [mem 0x78f73000-0x798acfff] [ 0.080942] PM: hibernation: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.080943] PM: hibernation: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.080944] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080944] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080945] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080946] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080948] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080949] Booting paravirtualized kernel on bare hardware [ 0.080952] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080959] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081170] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081200] Built 1 zonelists, mobility grouping on. Total pages: 8228741 [ 0.081202] Policy zone: Normal [ 0.081203] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-119-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081266] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-119-generic", will be passed to user space. [ 0.083418] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084567] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084661] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171224] Memory: 32672624K/33437996K available (16393K kernel code, 4397K rwdata, 10960K rodata, 3368K init, 18700K bss, 765112K reserved, 0K cma-reserved) [ 0.171506] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171522] Kernel/User page tables isolation: enabled [ 0.171553] ftrace: allocating 50750 entries in 199 pages [ 0.191589] ftrace: allocated 199 pages with 5 groups [ 0.191717] rcu: Hierarchical RCU implementation. [ 0.191719] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191720] Rude variant of Tasks RCU enabled. [ 0.191721] Tracing variant of Tasks RCU enabled. [ 0.191722] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191723] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195282] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195480] random: crng init done [ 0.200354] Console: colour VGA+ 80x25 [ 0.211514] printk: console [tty0] enabled [ 1.182826] printk: console [ttyS1] enabled [ 1.187086] ACPI: Core revision 20210730 [ 1.191244] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.200468] APIC: Switch to symmetric I/O mode setup [ 1.205505] DMAR: Host address width 46 [ 1.209407] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.214797] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.222896] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.229235] DMAR: ATSR flags: 0x0 [ 1.233725] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.240062] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.246485] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.252906] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.258373] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.258374] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.273560] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.278937] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.285240] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.308480] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3271f30b9a6, max_idle_ns: 440795347321 ns [ 1.319093] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.25 BogoMIPS (lpj=13998516) [ 1.323109] CPU0: Thermal monitoring enabled (TM1) [ 1.327144] process: using mwait in idle threads [ 1.331093] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.335091] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.339093] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.343092] Spectre V2 : Mitigation: Retpolines [ 1.347091] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.351091] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.355091] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.359092] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.363091] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.367092] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.371094] MDS: Mitigation: Clear CPU buffers [ 1.375091] TAA: Mitigation: Clear CPU buffers [ 1.379091] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.383096] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.387091] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.391091] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.395091] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.399091] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.421013] Freeing SMP alternatives memory: 44K [ 1.423092] pid_max: default: 32768 minimum: 301 [ 1.427112] LSM: Security Framework initializing [ 1.431099] landlock: Up and running. [ 1.435091] Yama: becoming mindful. [ 1.439108] AppArmor: AppArmor initialized [ 1.443152] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.447131] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.451453] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.455096] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.459199] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.463092] ... version: 3 [ 1.467091] ... bit width: 48 [ 1.471091] ... generic registers: 4 [ 1.475091] ... value mask: 0000ffffffffffff [ 1.479091] ... max period: 00007fffffffffff [ 1.483091] ... fixed-purpose events: 3 [ 1.487091] ... event mask: 000000070000000f [ 1.491151] signal: max sigframe size: 1776 [ 1.495106] rcu: Hierarchical SRCU implementation. [ 1.499807] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.503155] smp: Bringing up secondary CPUs ... [ 1.507171] x86: Booting SMP configuration: [ 1.511094] .... node #0, CPUs: #1 #2 #3 #4 [ 1.519377] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.527092] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.531091] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.535191] #5 #6 #7 [ 1.535737] smp: Brought up 1 node, 8 CPUs [ 1.543094] smpboot: Max logical packages: 1 [ 1.547092] smpboot: Total of 8 processors activated (55994.06 BogoMIPS) [ 1.555466] devtmpfs: initialized [ 1.558509] x86/mm: Memory block size: 128MB [ 1.560684] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 1.563167] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.567101] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.571136] pinctrl core: initialized pinctrl subsystem [ 1.575181] PM: RTC time: 18:16:50, date: 2024-09-12 [ 1.579197] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.583427] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.587391] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.591425] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.595101] audit: initializing netlink subsys (disabled) [ 1.599110] audit: type=2000 audit(1726165009.356:1): state=initialized audit_enabled=0 res=1 [ 1.599206] thermal_sys: Registered thermal governor 'fair_share' [ 1.603093] thermal_sys: Registered thermal governor 'bang_bang' [ 1.607091] thermal_sys: Registered thermal governor 'step_wise' [ 1.611091] thermal_sys: Registered thermal governor 'user_space' [ 1.615091] thermal_sys: Registered thermal governor 'power_allocator' [ 1.619096] EISA bus registered [ 1.626298] cpuidle: using governor ladder [ 1.627093] cpuidle: using governor menu [ 1.631109] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.635092] ACPI: bus type PCI registered [ 1.639093] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.643147] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.647093] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.651105] PCI: Using configuration type 1 for base access [ 1.656121] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.659108] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.663092] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.667165] ACPI: Added _OSI(Module Device) [ 1.671093] ACPI: Added _OSI(Processor Device) [ 1.675099] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.679091] ACPI: Added _OSI(Processor Aggregator Device) [ 1.683091] ACPI: Added _OSI(Linux-Dell-Video) [ 1.687091] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.691091] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.740368] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.746510] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.751237] ACPI: Dynamic OEM Table Load: [ 1.781197] ACPI: Interpreter enabled [ 1.783103] ACPI: PM: (supports S0 S4 S5) [ 1.787091] ACPI: Using IOAPIC for interrupt routing [ 1.791114] HEST: Enabling Firmware First mode for corrected errors. [ 1.795170] HEST: Table parsing has been initialized. [ 1.799239] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.803094] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.807091] PCI: Using E820 reservations for host bridge windows [ 1.811781] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.847275] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.851094] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.857074] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.860116] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.863092] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.867127] PCI host bridge to bus 0000:ff [ 1.871092] pci_bus 0000:ff: root bus resource [bus ff] [ 1.875101] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.879158] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.883146] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.887146] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.891144] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.895143] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.899142] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.903143] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.907147] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.911142] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.915143] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.919142] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.923143] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.927143] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.931143] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.935144] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.939146] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.943142] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.947142] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.951116] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.955153] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.959281] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.963158] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.967156] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.971158] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.975156] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.979154] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.983145] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.987146] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.991157] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.995156] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.999156] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.003159] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.007144] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.011144] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.015144] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.019146] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.023156] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.027155] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.031157] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.035160] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.039149] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.043144] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.047145] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.051147] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.055145] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.059145] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.063147] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.067150] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.071144] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.075143] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.079144] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.083117] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.087145] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.091143] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.099216] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.103094] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.107415] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.111541] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.115092] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.119382] PCI host bridge to bus 0000:00 [ 2.123093] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.127091] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.131091] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.135091] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.139091] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.143091] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.147091] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.151198] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.155303] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.159157] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.163263] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.167156] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.171256] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.175156] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.179253] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.183110] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.187287] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.191110] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.195283] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.199110] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.203283] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.207110] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.211284] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.215110] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.219285] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.223110] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.227283] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.231110] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.235283] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.239111] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.243237] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.247312] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.251240] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.255260] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.259106] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.263332] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.267383] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.271113] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.275103] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.279103] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.283103] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.287103] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.291103] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.295132] pci 0000:00:11.4: PME# supported from D3hot [ 2.299246] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.303117] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.307168] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.311240] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.315117] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.319169] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.323236] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.327117] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.331168] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.335255] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.339114] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.343196] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.347245] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.351181] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.355253] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.359184] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.363252] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.367183] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.371261] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.375114] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.379196] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.383248] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.387365] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.391111] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.395101] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.399101] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.403101] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.407102] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.411101] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.415125] pci 0000:00:1f.2: PME# supported from D3hot [ 2.419235] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.423117] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.427123] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.431303] acpiphp: Slot [1] registered [ 2.435108] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.439269] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.443112] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.447133] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.451094] pci 0000:02:00.0: enabling Extended Tags [ 2.455197] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.459093] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.463270] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.467113] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.471100] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.475114] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.479101] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.483132] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.487112] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.491091] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.495104] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.499091] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.503253] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.507113] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.511100] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.515114] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.519100] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.523132] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.527108] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.531091] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.535104] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.539092] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.543224] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.547092] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.551092] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.555093] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.559122] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.563157] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.567179] pci 0000:05:00.0: enabling Extended Tags [ 2.571164] pci 0000:05:00.0: supports D1 D2 [ 2.575091] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.579275] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.583094] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.587093] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.591139] pci_bus 0000:06: extended config space not accessible [ 2.595122] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.599125] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.603108] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.607108] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.611176] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.615133] pci 0000:06:00.0: supports D1 D2 [ 2.619091] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.623202] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.627097] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.631094] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.635188] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.639118] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.643119] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.647105] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.651226] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.655129] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.659092] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.663117] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.667091] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.671266] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.675118] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.679119] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.683106] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.687221] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.691129] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.695091] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.699117] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.703091] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.707246] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.711093] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.715093] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.719095] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.723995] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.727139] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.731137] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.735137] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.739136] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.743091] ACPI: PCI: Interrupt link LNKE disabled [ 2.747139] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.751091] ACPI: PCI: Interrupt link LNKF disabled [ 2.755137] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.759091] ACPI: PCI: Interrupt link LNKG disabled [ 2.763137] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.767091] ACPI: PCI: Interrupt link LNKH disabled [ 2.771281] iommu: Default domain type: Translated [ 2.775092] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.779218] SCSI subsystem initialized [ 2.783104] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.787091] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.787092] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.791091] vgaarb: loaded [ 2.793879] ACPI: bus type USB registered [ 2.795101] usbcore: registered new interface driver usbfs [ 2.799096] usbcore: registered new interface driver hub [ 2.803095] usbcore: registered new device driver usb [ 2.807109] pps_core: LinuxPPS API ver. 1 registered [ 2.811091] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.815094] PTP clock support registered [ 2.819106] EDAC MC: Ver: 3.0.0 [ 2.822402] NetLabel: Initializing [ 2.823092] NetLabel: domain hash size = 128 [ 2.827091] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.831102] NetLabel: unlabeled traffic allowed by default [ 2.835100] PCI: Using ACPI for IRQ routing [ 2.844356] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.847092] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.853132] clocksource: Switched to clocksource tsc-early [ 2.865278] VFS: Disk quotas dquot_6.6.0 [ 2.869285] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.876329] AppArmor: AppArmor Filesystem Enabled [ 2.881129] pnp: PnP ACPI init [ 2.884704] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.890698] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.896687] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.902673] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.908653] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.914635] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.920618] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.927301] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.933985] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.940666] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.947350] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.954032] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.960714] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.967594] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.973578] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.979566] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.985556] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.991546] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.998473] pnp: PnP ACPI: found 5 devices [ 3.008027] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.017023] NET: Registered PF_INET protocol family [ 3.022135] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.031425] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.040249] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.048246] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.056654] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.064187] TCP: Hash tables configured (established 262144 bind 65536) [ 3.071013] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.078793] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.085811] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.093267] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.098995] NET: Registered PF_XDP protocol family [ 3.103872] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.115446] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.123361] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.128405] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.133441] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.140307] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.147959] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.155961] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.163701] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.171787] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.179441] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.187442] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.195181] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.203270] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.210923] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.218923] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.226662] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.234750] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.242404] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.250405] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.258143] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.266233] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.271261] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.277421] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.284277] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.292112] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.297161] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.302189] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.308353] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.315227] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.320522] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.326692] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.333555] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.341386] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.349307] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.357134] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.365047] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.370073] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.376236] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.383092] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.390925] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.397171] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.403420] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.418061] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.425004] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.431948] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.438891] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.445227] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.450866] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.457197] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.464507] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.470145] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.476474] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.482116] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.488451] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.494094] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.500421] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.508039] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.539725] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 23829 usecs [ 3.571755] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23956 usecs [ 3.579252] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.585806] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.585814] Trying to unpack rootfs image as initramfs... [ 3.592311] software IO TLB: mapped [mem 0x0000000074ec1000-0x0000000078ec1000] (64MB) [ 3.606265] Initialise system trusted keyrings [ 3.610788] Key type blacklist registered [ 3.614919] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.622384] zbud: loaded [ 3.625188] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.631237] fuse: init (API version 7.34) [ 3.635471] integrity: Platform Keyring initialized [ 3.648074] Key type asymmetric registered [ 3.652251] Asymmetric key parser 'x509' registered [ 3.657221] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.664765] io scheduler mq-deadline registered [ 3.669751] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.675791] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.681814] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.687790] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.693764] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.699728] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.705687] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.712601] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.718350] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.726822] ACPI: button: Power Button [PWRB] [ 3.731279] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.738793] ACPI: button: Power Button [PWRF] [ 3.744440] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.752013] pstore: Registered erst as persistent store backend [ 3.758133] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.785070] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.813983] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.823578] Linux agpgart interface v0.103 [ 3.829350] loop: module loaded [ 3.832785] tun: Universal TUN/TAP device driver, 1.6 [ 3.837927] PPP generic driver version 2.4.2 [ 3.842308] VFIO - User Level meta-driver version: 0.3 [ 3.847634] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.854231] ehci-pci: EHCI PCI platform driver [ 3.858898] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.864201] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.871705] ehci-pci 0000:00:1a.0: debug port 2 [ 3.880216] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.899651] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.905515] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.913868] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.921183] usb usb1: Product: EHCI Host Controller [ 3.926134] usb usb1: Manufacturer: Linux 5.15.0-119-generic ehci_hcd [ 3.932648] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.937485] hub 1-0:1.0: USB hub found [ 3.939803] Freeing initrd memory: 65120K [ 3.941321] hub 1-0:1.0: 2 ports detected [ 3.949728] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.955029] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.962519] ehci-pci 0000:00:1d.0: debug port 2 [ 3.971006] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.991666] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.997511] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.005866] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.013172] usb usb2: Product: EHCI Host Controller [ 4.018114] usb usb2: Manufacturer: Linux 5.15.0-119-generic ehci_hcd [ 4.024618] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.029417] hub 2-0:1.0: USB hub found [ 4.033231] hub 2-0:1.0: 2 ports detected [ 4.037419] ehci-platform: EHCI generic platform driver [ 4.042729] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.048978] ohci-pci: OHCI PCI platform driver [ 4.053505] ohci-platform: OHCI generic platform driver [ 4.058799] uhci_hcd: USB Universal Host Controller Interface driver [ 4.065267] i8042: PNP: No PS/2 controller found. [ 4.070098] mousedev: PS/2 mouse device common for all mice [ 4.075815] rtc_cmos 00:00: RTC can wake from S4 [ 4.080716] rtc_cmos 00:00: registered as rtc0 [ 4.085259] rtc_cmos 00:00: setting system clock to 2024-09-12T18:16:54 UTC (1726165014) [ 4.093459] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.100234] i2c_dev: i2c /dev entries driver [ 4.104735] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.117017] device-mapper: uevent: version 1.0.3 [ 4.121771] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.130311] platform eisa.0: Probing EISA bus 0 [ 4.134904] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.141757] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.148263] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.154773] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.161282] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.167791] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.174302] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.180812] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.187322] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.193831] platform eisa.0: EISA: Detected 0 cards [ 4.198782] intel_pstate: Intel P-state driver initializing [ 4.205416] ledtrig-cpu: registered to indicate activity on CPUs [ 4.211642] drop_monitor: Initializing network drop monitor service [ 4.218090] NET: Registered PF_INET6 protocol family [ 4.228879] Segment Routing with IPv6 [ 4.232613] In-situ OAM (IOAM) with IPv6 [ 4.236614] NET: Registered PF_PACKET protocol family [ 4.241804] Key type dns_resolver registered [ 4.246704] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.252710] microcode: Microcode Update Driver: v2.2. [ 4.252794] resctrl: L3 allocation detected [ 4.262154] resctrl: L3 monitoring detected [ 4.266406] IPI shorthand broadcast: enabled [ 4.270756] sched_clock: Marking stable (3223126117, 1047616285)->(5256108418, -985366016) [ 4.279333] registered taskstats version 1 [ 4.283623] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.290282] Loading compiled-in X.509 certificates [ 4.295737] Loaded X.509 cert 'Build time autogenerated kernel key: ce5757b48788bd11479e35b6b0f7215086e87bd9' [ 4.306161] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.316414] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.326501] blacklist: Loading compiled-in revocation X.509 certificates [ 4.333283] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.343203] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.353736] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.364613] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.375143] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.375673] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.385953] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.403351] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.414259] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.426020] zswap: loaded using pool lzo/zbud [ 4.430715] Key type .fscrypt registered [ 4.434706] Key type fscrypt-provisioning registered [ 4.439792] pstore: Using crash dump compression: deflate [ 4.444052] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.448960] Key type encrypted registered [ 4.453526] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.457612] AppArmor: AppArmor sha1 policy hashing enabled [ 4.457635] ima: No TPM chip found, activating TPM-bypass! [ 4.465342] hub 1-1:1.0: USB hub found [ 4.470401] Loading compiled-in module X.509 certificates [ 4.470867] Loaded X.509 cert 'Build time autogenerated kernel key: ce5757b48788bd11479e35b6b0f7215086e87bd9' [ 4.479337] hub 1-1:1.0: 6 ports detected [ 4.487546] ima: Allocated hash algorithm: sha1 [ 4.487567] ima: No architecture policies found [ 4.516317] evm: Initialising EVM extended attributes: [ 4.521523] evm: security.selinux [ 4.524899] evm: security.SMACK64 [ 4.528282] evm: security.SMACK64EXEC [ 4.532006] evm: security.SMACK64TRANSMUTE [ 4.536167] evm: security.SMACK64MMAP [ 4.539895] evm: security.apparmor [ 4.543358] evm: security.ima [ 4.546385] evm: security.capability [ 4.550028] evm: HMAC attrs: 0x1 [ 4.552057] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.553582] PM: Magic number: 8:549:291 [ 4.561603] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.565733] tty tty24: hash matches [ 4.576568] acpi device:8f: hash matches [ 4.580619] memory memory153: hash matches [ 4.584984] RAS: Correctable Errors collector initialized. [ 4.584998] hub 2-1:1.0: USB hub found [ 4.590564] clk: Disabling unused clocks [ 4.598566] hub 2-1:1.0: 8 ports detected [ 4.602950] Freeing unused decrypted memory: 2036K [ 4.608256] Freeing unused kernel image (initmem) memory: 3368K [ 4.614306] Write protecting the kernel read-only data: 30720k [ 4.620605] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.627517] Freeing unused kernel image (rodata/data gap) memory: 1328K [ 4.634206] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.640460] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.692886] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.699411] x86/mm: Checking user space page tables [ 4.704361] clocksource: Switched to clocksource tsc [ 4.741729] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.748240] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.895345] dca service started, version 1.12.1 [ 4.906538] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.914748] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.915084] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.927972] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.955890] scsi host0: ahci [ 4.958982] scsi host1: ahci [ 4.962044] scsi host2: ahci [ 4.965164] scsi host3: ahci [ 4.968166] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 4.975657] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 4.983141] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 4.987866] igb 0000:07:00.0: added PHC on eth0 [ 4.990636] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 4.995265] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.002957] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.009653] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:38 [ 5.009917] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.009923] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.009923] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.011003] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.011245] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.011249] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.011252] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.011294] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.011296] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.011298] usb usb3: Product: xHCI Host Controller [ 5.011300] usb usb3: Manufacturer: Linux 5.15.0-119-generic xhci-hcd [ 5.011301] usb usb3: SerialNumber: 0000:00:14.0 [ 5.011425] hub 3-0:1.0: USB hub found [ 5.011449] hub 3-0:1.0: 15 ports detected [ 5.015587] i2c i2c-1: 2/8 memory slots populated (from DMI) [ 5.015590] i2c i2c-1: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.015840] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.015843] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.015845] usb usb4: Product: xHCI Host Controller [ 5.015846] usb usb4: Manufacturer: Linux 5.15.0-119-generic xhci-hcd [ 5.015848] usb usb4: SerialNumber: 0000:00:14.0 [ 5.015937] hub 4-0:1.0: USB hub found [ 5.015953] hub 4-0:1.0: 6 ports detected [ 5.017915] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.037972] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.038079] nvme nvme0: pci function 0000:02:00.0 [ 5.040408] nvme nvme0: 8/0/0 default/read/poll queues [ 5.043882] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.053042] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.092019] scsi host4: ahci [ 5.092767] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.099366] scsi host5: ahci [ 5.160071] igb 0000:07:00.1: added PHC on eth1 [ 5.162714] scsi host6: ahci [ 5.166749] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.174467] scsi host7: ahci [ 5.180548] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:39 [ 5.180623] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.185412] scsi host8: ahci [ 5.190539] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.255661] scsi host9: ahci [ 5.258652] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 43 [ 5.266132] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 43 [ 5.273608] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 43 [ 5.281089] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 43 [ 5.288567] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 43 [ 5.296065] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 43 [ 5.314451] ata2: SATA link down (SStatus 0 SControl 300) [ 5.319945] ata1: SATA link down (SStatus 0 SControl 300) [ 5.325431] ata3: SATA link down (SStatus 0 SControl 300) [ 5.330920] ata4: SATA link down (SStatus 0 SControl 300) [ 5.343675] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.495922] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.504299] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.512032] hub 3-12:1.0: USB hub found [ 5.516035] hub 3-12:1.0: 4 ports detected [ 5.617658] ata10: SATA link down (SStatus 0 SControl 300) [ 5.623257] ata6: SATA link down (SStatus 0 SControl 300) [ 5.628759] ata8: SATA link down (SStatus 0 SControl 300) [ 5.634265] ata7: SATA link down (SStatus 0 SControl 300) [ 5.639761] ata9: SATA link down (SStatus 0 SControl 300) [ 5.645264] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.652679] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.659556] ata5.00: NCQ Send/Recv Log not supported [ 5.664610] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.673101] ata5.00: NCQ Send/Recv Log not supported [ 5.678159] ata5.00: configured for UDMA/133 [ 5.682719] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.691201] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.691404] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.704360] sd 4:0:0:0: [sda] Write Protect is off [ 5.709244] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.733694] [ 5.736275] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.743139] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.768163] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.831638] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.963987] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.972538] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.987544] hid: raw HID events driver (C) Jiri Kosina [ 5.995369] usbcore: registered new interface driver usbhid [ 6.001012] usbhid: USB HID core driver [ 6.006576] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.075785] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.087746] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.099573] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.236424] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.254815] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.263436] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.269688] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:60 [ 6.278133] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.448408] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.458804] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.467419] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.474541] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:61 [ 6.482934] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.490776] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.516718] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 201531/61054976 files, 6893769/244190336 blocks done. [ 13.713187] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.503309] systemd[1]: Inserted module 'autofs4' [ 14.598230] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.647765] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.700605] systemd[1]: Hostname set to . [ 15.962480] systemd[1]: Queued start job for default target Graphical Interface. [ 15.971229] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 15.992447] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.016349] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.039828] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.059879] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.084124] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.111801] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.139773] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.167776] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.195750] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.223752] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.251756] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.279852] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.303793] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.323787] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.347933] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.372045] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.398444] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.424018] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.443993] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.467912] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.492192] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.511982] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.536036] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.556147] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.580041] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.599968] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.621469] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.641349] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.665234] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.689397] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.709532] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.724313] RPC: Registered named UNIX socket transport module. [ 16.730316] RPC: Registered udp transport module. [ 16.735092] RPC: Registered tcp transport module. [ 16.739866] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.747114] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.767809] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.778074] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.800607] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.828710] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.856792] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 16.880478] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 16.900564] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.920601] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 16.944427] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 16.964487] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 16.988520] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.016833] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.035717] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.045684] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.057840] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.076546] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.100456] systemd[1]: Starting Coldplug All udev Devices... [ 17.104462] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. Starting Coldplug All udev Devices... [ 17.129442] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ 17.191143] lp: driver loaded but no devices found [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trac[ 17.214768] Loading iSCSI transport class v2.0-870. e File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.480113] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Startin[ 17.553058] systemd-journald[370]: Received client request to flush runtime journal. g Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Set console font and keymap. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. Mounting RPC Pipe File System... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... StartinS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Listening on Docker Socket . [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started User Login Management. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. + myips=172.21.15.129 + attempts=1 + sleep 1 [ OK ] Started Network Time Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. [ OK ] Started ntp-systemd-netif.service. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.129 '!=' '' ']' + set -e + '[' -n 172.21.15.129 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.129 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.129 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started (i)SCSI target daemon. + newhostname=smithi129.front.sepia.ceph.com + '[' -n smithi129.front.sepia.ceph.com ']' + hostname smithi129.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi129 + echo smithi129 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.129 smithi129.front.sepia.ceph.com smithi129/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi129.front.sepia.ceph.com ttyS1 2024-09-12T18:17:22.159 DEBUG:teuthology.orchestra.console.smithi129:expect after: smithi129 login: 2024-09-12T18:17:22.213 DEBUG:teuthology.orchestra.console.smithi129:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  e t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 61 GUID: 00000000 0000 0000 0000 0CC47AD91938 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.129 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.129 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:61)... Configuring (net0 0c:c4:7a:88:72:61).... Configuring (net0 0c:c4:7a:88:72:61)..... Configuring (net0 0c:c4:7a:88:72:61)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-119-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-119-generic (buildd@lcy02-amd64-075) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #129-Ubuntu SMP Fri Aug 2 19:25:20 UTC 2024 (Ubuntu 5.15.0-119.129-generic 5.15.160) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-119-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec0fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f73000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.629 MHz processor [ 0.000412] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000598] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001910] last_pfn = 0x78ec1 max_arch_pfn = 0x400000000 [ 0.008361] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008375] Using GB pages for direct mapping [ 0.008495] RAMDISK: [mem 0x300bf000-0x34056fff] [ 0.008501] ACPI: Early table checksum verification disabled [ 0.008504] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008508] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.008513] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008518] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008521] ACPI: FACS 0x0000000079D48F80 000040 [ 0.008524] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008527] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008530] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008532] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008535] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008538] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008541] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008544] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008546] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008549] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008552] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008555] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008558] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008561] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008563] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008566] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008569] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008571] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.008573] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.008574] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.008575] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.008576] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.008577] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.008578] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.008579] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.008580] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.008581] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.008582] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.008583] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.008584] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.008585] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.008586] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.008587] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.008588] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.008589] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.008590] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.008591] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.008686] No NUMA configuration found [ 0.008687] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008696] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009038] Zone ranges: [ 0.009039] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009041] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009043] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009044] Device empty [ 0.009045] Movable zone start for each node [ 0.009048] Early memory node ranges [ 0.009049] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.009050] node 0: [mem 0x0000000000100000-0x0000000078ec0fff] [ 0.009051] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009055] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009060] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009094] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.080768] On node 0, zone Normal: 28991 pages in unavailable ranges [ 0.080882] ACPI: PM-Timer IO Port: 0x408 [ 0.080890] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080892] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080893] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080894] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080895] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080896] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080896] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080897] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080907] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080911] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080913] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080915] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080919] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080920] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080924] TSC deadline timer available [ 0.080925] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080935] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080937] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.080938] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080940] PM: hibernation: Registered nosave memory: [mem 0x78ec1000-0x78f72fff] [ 0.080941] PM: hibernation: Registered nosave memory: [mem 0x78f73000-0x798acfff] [ 0.080942] PM: hibernation: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.080943] PM: hibernation: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.080944] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080944] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080945] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080946] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080948] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080949] Booting paravirtualized kernel on bare hardware [ 0.080952] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080959] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081170] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081200] Built 1 zonelists, mobility grouping on. Total pages: 8228741 [ 0.081202] Policy zone: Normal [ 0.081203] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-119-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081266] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-119-generic", will be passed to user space. [ 0.083418] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084567] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084661] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171224] Memory: 32672624K/33437996K available (16393K kernel code, 4397K rwdata, 10960K rodata, 3368K init, 18700K bss, 765112K reserved, 0K cma-reserved) [ 0.171506] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171522] Kernel/User page tables isolation: enabled [ 0.171553] ftrace: allocating 50750 entries in 199 pages [ 0.191589] ftrace: allocated 199 pages with 5 groups [ 0.191717] rcu: Hierarchical RCU implementation. [ 0.191719] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191720] Rude variant of Tasks RCU enabled. [ 0.191721] Tracing variant of Tasks RCU enabled. [ 0.191722] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191723] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195282] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195480] random: crng init done [ 0.200354] Console: colour VGA+ 80x25 [ 0.211514] printk: console [tty0] enabled [ 1.182826] printk: console [ttyS1] enabled [ 1.187086] ACPI: Core revision 20210730 [ 1.191244] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.200468] APIC: Switch to symmetric I/O mode setup [ 1.205505] DMAR: Host address width 46 [ 1.209407] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.214797] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.222896] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.229235] DMAR: ATSR flags: 0x0 [ 1.233725] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.240062] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.246485] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.252906] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.258373] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.258374] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.273560] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.278937] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.285240] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.308480] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3271f30b9a6, max_idle_ns: 440795347321 ns [ 1.319093] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.25 BogoMIPS (lpj=13998516) [ 1.323109] CPU0: Thermal monitoring enabled (TM1) [ 1.327144] process: using mwait in idle threads [ 1.331093] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.335091] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.339093] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.343092] Spectre V2 : Mitigation: Retpolines [ 1.347091] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.351091] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.355091] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.359092] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.363091] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.367092] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.371094] MDS: Mitigation: Clear CPU buffers [ 1.375091] TAA: Mitigation: Clear CPU buffers [ 1.379091] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.383096] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.387091] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.391091] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.395091] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.399091] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.421013] Freeing SMP alternatives memory: 44K [ 1.423092] pid_max: default: 32768 minimum: 301 [ 1.427112] LSM: Security Framework initializing [ 1.431099] landlock: Up and running. [ 1.435091] Yama: becoming mindful. [ 1.439108] AppArmor: AppArmor initialized [ 1.443152] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.447131] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.451453] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.455096] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.459199] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.463092] ... version: 3 [ 1.467091] ... bit width: 48 [ 1.471091] ... generic registers: 4 [ 1.475091] ... value mask: 0000ffffffffffff [ 1.479091] ... max period: 00007fffffffffff [ 1.483091] ... fixed-purpose events: 3 [ 1.487091] ... event mask: 000000070000000f [ 1.491151] signal: max sigframe size: 1776 [ 1.495106] rcu: Hierarchical SRCU implementation. [ 1.499807] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.503155] smp: Bringing up secondary CPUs ... [ 1.507171] x86: Booting SMP configuration: [ 1.511094] .... node #0, CPUs: #1 #2 #3 #4 [ 1.519377] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.527092] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.531091] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.535191] #5 #6 #7 [ 1.535737] smp: Brought up 1 node, 8 CPUs [ 1.543094] smpboot: Max logical packages: 1 [ 1.547092] smpboot: Total of 8 processors activated (55994.06 BogoMIPS) [ 1.555466] devtmpfs: initialized [ 1.558509] x86/mm: Memory block size: 128MB [ 1.560684] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 1.563167] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.567101] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.571136] pinctrl core: initialized pinctrl subsystem [ 1.575181] PM: RTC time: 18:16:50, date: 2024-09-12 [ 1.579197] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.583427] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.587391] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.591425] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.595101] audit: initializing netlink subsys (disabled) [ 1.599110] audit: type=2000 audit(1726165009.356:1): state=initialized audit_enabled=0 res=1 [ 1.599206] thermal_sys: Registered thermal governor 'fair_share' [ 1.603093] thermal_sys: Registered thermal governor 'bang_bang' [ 1.607091] thermal_sys: Registered thermal governor 'step_wise' [ 1.611091] thermal_sys: Registered thermal governor 'user_space' [ 1.615091] thermal_sys: Registered thermal governor 'power_allocator' [ 1.619096] EISA bus registered [ 1.626298] cpuidle: using governor ladder [ 1.627093] cpuidle: using governor menu [ 1.631109] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.635092] ACPI: bus type PCI registered [ 1.639093] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.643147] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.647093] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.651105] PCI: Using configuration type 1 for base access [ 1.656121] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.659108] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.663092] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.667165] ACPI: Added _OSI(Module Device) [ 1.671093] ACPI: Added _OSI(Processor Device) [ 1.675099] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.679091] ACPI: Added _OSI(Processor Aggregator Device) [ 1.683091] ACPI: Added _OSI(Linux-Dell-Video) [ 1.687091] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.691091] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.740368] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.746510] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.751237] ACPI: Dynamic OEM Table Load: [ 1.781197] ACPI: Interpreter enabled [ 1.783103] ACPI: PM: (supports S0 S4 S5) [ 1.787091] ACPI: Using IOAPIC for interrupt routing [ 1.791114] HEST: Enabling Firmware First mode for corrected errors. [ 1.795170] HEST: Table parsing has been initialized. [ 1.799239] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.803094] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.807091] PCI: Using E820 reservations for host bridge windows [ 1.811781] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.847275] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.851094] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.857074] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.860116] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.863092] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.867127] PCI host bridge to bus 0000:ff [ 1.871092] pci_bus 0000:ff: root bus resource [bus ff] [ 1.875101] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.879158] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.883146] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.887146] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.891144] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.895143] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.899142] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.903143] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.907147] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.911142] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.915143] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.919142] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.923143] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.927143] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.931143] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.935144] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.939146] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.943142] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.947142] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.951116] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.955153] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.959281] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.963158] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.967156] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.971158] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.975156] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.979154] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.983145] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.987146] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.991157] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.995156] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.999156] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.003159] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.007144] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.011144] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.015144] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.019146] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.023156] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.027155] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.031157] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.035160] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.039149] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.043144] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.047145] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.051147] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.055145] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.059145] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.063147] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.067150] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.071144] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.075143] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.079144] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.083117] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.087145] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.091143] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.099216] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.103094] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.107415] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.111541] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.115092] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.119382] PCI host bridge to bus 0000:00 [ 2.123093] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.127091] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.131091] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.135091] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.139091] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.143091] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.147091] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.151198] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.155303] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.159157] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.163263] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.167156] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.171256] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.175156] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.179253] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.183110] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.187287] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.191110] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.195283] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.199110] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.203283] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.207110] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.211284] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.215110] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.219285] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.223110] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.227283] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.231110] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.235283] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.239111] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.243237] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.247312] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.251240] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.255260] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.259106] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.263332] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.267383] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.271113] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.275103] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.279103] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.283103] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.287103] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.291103] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.295132] pci 0000:00:11.4: PME# supported from D3hot [ 2.299246] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.303117] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.307168] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.311240] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.315117] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.319169] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.323236] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.327117] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.331168] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.335255] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.339114] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.343196] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.347245] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.351181] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.355253] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.359184] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.363252] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.367183] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.371261] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.375114] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.379196] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.383248] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.387365] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.391111] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.395101] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.399101] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.403101] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.407102] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.411101] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.415125] pci 0000:00:1f.2: PME# supported from D3hot [ 2.419235] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.423117] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.427123] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.431303] acpiphp: Slot [1] registered [ 2.435108] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.439269] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.443112] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.447133] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.451094] pci 0000:02:00.0: enabling Extended Tags [ 2.455197] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.459093] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.463270] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.467113] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.471100] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.475114] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.479101] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.483132] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.487112] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.491091] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.495104] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.499091] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.503253] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.507113] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.511100] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.515114] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.519100] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.523132] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.527108] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.531091] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.535104] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.539092] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.543224] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.547092] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.551092] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.555093] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.559122] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.563157] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.567179] pci 0000:05:00.0: enabling Extended Tags [ 2.571164] pci 0000:05:00.0: supports D1 D2 [ 2.575091] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.579275] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.583094] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.587093] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.591139] pci_bus 0000:06: extended config space not accessible [ 2.595122] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.599125] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.603108] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.607108] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.611176] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.615133] pci 0000:06:00.0: supports D1 D2 [ 2.619091] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.623202] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.627097] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.631094] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.635188] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.639118] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.643119] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.647105] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.651226] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.655129] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.659092] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.663117] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.667091] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.671266] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.675118] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.679119] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.683106] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.687221] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.691129] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.695091] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.699117] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.703091] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.707246] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.711093] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.715093] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.719095] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.723995] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.727139] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.731137] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.735137] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.739136] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.743091] ACPI: PCI: Interrupt link LNKE disabled [ 2.747139] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.751091] ACPI: PCI: Interrupt link LNKF disabled [ 2.755137] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.759091] ACPI: PCI: Interrupt link LNKG disabled [ 2.763137] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.767091] ACPI: PCI: Interrupt link LNKH disabled [ 2.771281] iommu: Default domain type: Translated [ 2.775092] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.779218] SCSI subsystem initialized [ 2.783104] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.787091] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.787092] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.791091] vgaarb: loaded [ 2.793879] ACPI: bus type USB registered [ 2.795101] usbcore: registered new interface driver usbfs [ 2.799096] usbcore: registered new interface driver hub [ 2.803095] usbcore: registered new device driver usb [ 2.807109] pps_core: LinuxPPS API ver. 1 registered [ 2.811091] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.815094] PTP clock support registered [ 2.819106] EDAC MC: Ver: 3.0.0 [ 2.822402] NetLabel: Initializing [ 2.823092] NetLabel: domain hash size = 128 [ 2.827091] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.831102] NetLabel: unlabeled traffic allowed by default [ 2.835100] PCI: Using ACPI for IRQ routing [ 2.844356] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.847092] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.853132] clocksource: Switched to clocksource tsc-early [ 2.865278] VFS: Disk quotas dquot_6.6.0 [ 2.869285] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.876329] AppArmor: AppArmor Filesystem Enabled [ 2.881129] pnp: PnP ACPI init [ 2.884704] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.890698] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.896687] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.902673] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.908653] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.914635] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.920618] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.927301] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.933985] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.940666] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.947350] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.954032] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.960714] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.967594] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.973578] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.979566] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.985556] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.991546] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.998473] pnp: PnP ACPI: found 5 devices [ 3.008027] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.017023] NET: Registered PF_INET protocol family [ 3.022135] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.031425] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.040249] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.048246] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.056654] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.064187] TCP: Hash tables configured (established 262144 bind 65536) [ 3.071013] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.078793] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.085811] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.093267] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.098995] NET: Registered PF_XDP protocol family [ 3.103872] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.115446] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.123361] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.128405] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.133441] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.140307] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.147959] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.155961] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.163701] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.171787] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.179441] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.187442] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.195181] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.203270] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.210923] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.218923] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.226662] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.234750] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.242404] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.250405] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.258143] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.266233] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.271261] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.277421] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.284277] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.292112] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.297161] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.302189] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.308353] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.315227] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.320522] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.326692] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.333555] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.341386] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.349307] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.357134] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.365047] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.370073] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.376236] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.383092] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.390925] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.397171] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.403420] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.418061] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.425004] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.431948] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.438891] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.445227] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.450866] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.457197] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.464507] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.470145] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.476474] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.482116] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.488451] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.494094] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.500421] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.508039] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.539725] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 23829 usecs [ 3.571755] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23956 usecs [ 3.579252] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.585806] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.585814] Trying to unpack rootfs image as initramfs... [ 3.592311] software IO TLB: mapped [mem 0x0000000074ec1000-0x0000000078ec1000] (64MB) [ 3.606265] Initialise system trusted keyrings [ 3.610788] Key type blacklist registered [ 3.614919] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.622384] zbud: loaded [ 3.625188] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.631237] fuse: init (API version 7.34) [ 3.635471] integrity: Platform Keyring initialized [ 3.648074] Key type asymmetric registered [ 3.652251] Asymmetric key parser 'x509' registered [ 3.657221] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.664765] io scheduler mq-deadline registered [ 3.669751] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.675791] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.681814] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.687790] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.693764] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.699728] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.705687] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.712601] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.718350] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.726822] ACPI: button: Power Button [PWRB] [ 3.731279] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.738793] ACPI: button: Power Button [PWRF] [ 3.744440] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.752013] pstore: Registered erst as persistent store backend [ 3.758133] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.785070] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.813983] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.823578] Linux agpgart interface v0.103 [ 3.829350] loop: module loaded [ 3.832785] tun: Universal TUN/TAP device driver, 1.6 [ 3.837927] PPP generic driver version 2.4.2 [ 3.842308] VFIO - User Level meta-driver version: 0.3 [ 3.847634] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.854231] ehci-pci: EHCI PCI platform driver [ 3.858898] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.864201] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.871705] ehci-pci 0000:00:1a.0: debug port 2 [ 3.880216] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.899651] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.905515] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.913868] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.921183] usb usb1: Product: EHCI Host Controller [ 3.926134] usb usb1: Manufacturer: Linux 5.15.0-119-generic ehci_hcd [ 3.932648] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.937485] hub 1-0:1.0: USB hub found [ 3.939803] Freeing initrd memory: 65120K [ 3.941321] hub 1-0:1.0: 2 ports detected [ 3.949728] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.955029] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.962519] ehci-pci 0000:00:1d.0: debug port 2 [ 3.971006] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.991666] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.997511] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.005866] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.013172] usb usb2: Product: EHCI Host Controller [ 4.018114] usb usb2: Manufacturer: Linux 5.15.0-119-generic ehci_hcd [ 4.024618] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.029417] hub 2-0:1.0: USB hub found [ 4.033231] hub 2-0:1.0: 2 ports detected [ 4.037419] ehci-platform: EHCI generic platform driver [ 4.042729] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.048978] ohci-pci: OHCI PCI platform driver [ 4.053505] ohci-platform: OHCI generic platform driver [ 4.058799] uhci_hcd: USB Universal Host Controller Interface driver [ 4.065267] i8042: PNP: No PS/2 controller found. [ 4.070098] mousedev: PS/2 mouse device common for all mice [ 4.075815] rtc_cmos 00:00: RTC can wake from S4 [ 4.080716] rtc_cmos 00:00: registered as rtc0 [ 4.085259] rtc_cmos 00:00: setting system clock to 2024-09-12T18:16:54 UTC (1726165014) [ 4.093459] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.100234] i2c_dev: i2c /dev entries driver [ 4.104735] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.117017] device-mapper: uevent: version 1.0.3 [ 4.121771] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.130311] platform eisa.0: Probing EISA bus 0 [ 4.134904] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.141757] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.148263] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.154773] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.161282] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.167791] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.174302] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.180812] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.187322] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.193831] platform eisa.0: EISA: Detected 0 cards [ 4.198782] intel_pstate: Intel P-state driver initializing [ 4.205416] ledtrig-cpu: registered to indicate activity on CPUs [ 4.211642] drop_monitor: Initializing network drop monitor service [ 4.218090] NET: Registered PF_INET6 protocol family [ 4.228879] Segment Routing with IPv6 [ 4.232613] In-situ OAM (IOAM) with IPv6 [ 4.236614] NET: Registered PF_PACKET protocol family [ 4.241804] Key type dns_resolver registered [ 4.246704] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.252710] microcode: Microcode Update Driver: v2.2. [ 4.252794] resctrl: L3 allocation detected [ 4.262154] resctrl: L3 monitoring detected [ 4.266406] IPI shorthand broadcast: enabled [ 4.270756] sched_clock: Marking stable (3223126117, 1047616285)->(5256108418, -985366016) [ 4.279333] registered taskstats version 1 [ 4.283623] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.290282] Loading compiled-in X.509 certificates [ 4.295737] Loaded X.509 cert 'Build time autogenerated kernel key: ce5757b48788bd11479e35b6b0f7215086e87bd9' [ 4.306161] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.316414] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.326501] blacklist: Loading compiled-in revocation X.509 certificates [ 4.333283] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.343203] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.353736] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.364613] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.375143] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.375673] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.385953] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.403351] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.414259] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.426020] zswap: loaded using pool lzo/zbud [ 4.430715] Key type .fscrypt registered [ 4.434706] Key type fscrypt-provisioning registered [ 4.439792] pstore: Using crash dump compression: deflate [ 4.444052] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.448960] Key type encrypted registered [ 4.453526] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.457612] AppArmor: AppArmor sha1 policy hashing enabled [ 4.457635] ima: No TPM chip found, activating TPM-bypass! [ 4.465342] hub 1-1:1.0: USB hub found [ 4.470401] Loading compiled-in module X.509 certificates [ 4.470867] Loaded X.509 cert 'Build time autogenerated kernel key: ce5757b48788bd11479e35b6b0f7215086e87bd9' [ 4.479337] hub 1-1:1.0: 6 ports detected [ 4.487546] ima: Allocated hash algorithm: sha1 [ 4.487567] ima: No architecture policies found [ 4.516317] evm: Initialising EVM extended attributes: [ 4.521523] evm: security.selinux [ 4.524899] evm: security.SMACK64 [ 4.528282] evm: security.SMACK64EXEC [ 4.532006] evm: security.SMACK64TRANSMUTE [ 4.536167] evm: security.SMACK64MMAP [ 4.539895] evm: security.apparmor [ 4.543358] evm: security.ima [ 4.546385] evm: security.capability [ 4.550028] evm: HMAC attrs: 0x1 [ 4.552057] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.553582] PM: Magic number: 8:549:291 [ 4.561603] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.565733] tty tty24: hash matches [ 4.576568] acpi device:8f: hash matches [ 4.580619] memory memory153: hash matches [ 4.584984] RAS: Correctable Errors collector initialized. [ 4.584998] hub 2-1:1.0: USB hub found [ 4.590564] clk: Disabling unused clocks [ 4.598566] hub 2-1:1.0: 8 ports detected [ 4.602950] Freeing unused decrypted memory: 2036K [ 4.608256] Freeing unused kernel image (initmem) memory: 3368K [ 4.614306] Write protecting the kernel read-only data: 30720k [ 4.620605] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.627517] Freeing unused kernel image (rodata/data gap) memory: 1328K [ 4.634206] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.640460] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.692886] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.699411] x86/mm: Checking user space page tables [ 4.704361] clocksource: Switched to clocksource tsc [ 4.741729] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.748240] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.895345] dca service started, version 1.12.1 [ 4.906538] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.914748] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.915084] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.927972] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.955890] scsi host0: ahci [ 4.958982] scsi host1: ahci [ 4.962044] scsi host2: ahci [ 4.965164] scsi host3: ahci [ 4.968166] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 4.975657] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 4.983141] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 4.987866] igb 0000:07:00.0: added PHC on eth0 [ 4.990636] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 4.995265] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.002957] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.009653] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:38 [ 5.009917] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.009923] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.009923] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.011003] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.011245] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.011249] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.011252] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.011294] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.011296] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.011298] usb usb3: Product: xHCI Host Controller [ 5.011300] usb usb3: Manufacturer: Linux 5.15.0-119-generic xhci-hcd [ 5.011301] usb usb3: SerialNumber: 0000:00:14.0 [ 5.011425] hub 3-0:1.0: USB hub found [ 5.011449] hub 3-0:1.0: 15 ports detected [ 5.015587] i2c i2c-1: 2/8 memory slots populated (from DMI) [ 5.015590] i2c i2c-1: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.015840] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.015843] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.015845] usb usb4: Product: xHCI Host Controller [ 5.015846] usb usb4: Manufacturer: Linux 5.15.0-119-generic xhci-hcd [ 5.015848] usb usb4: SerialNumber: 0000:00:14.0 [ 5.015937] hub 4-0:1.0: USB hub found [ 5.015953] hub 4-0:1.0: 6 ports detected [ 5.017915] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.037972] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.038079] nvme nvme0: pci function 0000:02:00.0 [ 5.040408] nvme nvme0: 8/0/0 default/read/poll queues [ 5.043882] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.053042] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.092019] scsi host4: ahci [ 5.092767] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.099366] scsi host5: ahci [ 5.160071] igb 0000:07:00.1: added PHC on eth1 [ 5.162714] scsi host6: ahci [ 5.166749] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.174467] scsi host7: ahci [ 5.180548] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:39 [ 5.180623] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.185412] scsi host8: ahci [ 5.190539] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.255661] scsi host9: ahci [ 5.258652] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 43 [ 5.266132] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 43 [ 5.273608] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 43 [ 5.281089] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 43 [ 5.288567] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 43 [ 5.296065] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 43 [ 5.314451] ata2: SATA link down (SStatus 0 SControl 300) [ 5.319945] ata1: SATA link down (SStatus 0 SControl 300) [ 5.325431] ata3: SATA link down (SStatus 0 SControl 300) [ 5.330920] ata4: SATA link down (SStatus 0 SControl 300) [ 5.343675] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.495922] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.504299] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.512032] hub 3-12:1.0: USB hub found [ 5.516035] hub 3-12:1.0: 4 ports detected [ 5.617658] ata10: SATA link down (SStatus 0 SControl 300) [ 5.623257] ata6: SATA link down (SStatus 0 SControl 300) [ 5.628759] ata8: SATA link down (SStatus 0 SControl 300) [ 5.634265] ata7: SATA link down (SStatus 0 SControl 300) [ 5.639761] ata9: SATA link down (SStatus 0 SControl 300) [ 5.645264] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.652679] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.659556] ata5.00: NCQ Send/Recv Log not supported [ 5.664610] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.673101] ata5.00: NCQ Send/Recv Log not supported [ 5.678159] ata5.00: configured for UDMA/133 [ 5.682719] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.691201] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.691404] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.704360] sd 4:0:0:0: [sda] Write Protect is off [ 5.709244] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.733694] [ 5.736275] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.743139] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.768163] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.831638] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.963987] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.972538] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.987544] hid: raw HID events driver (C) Jiri Kosina [ 5.995369] usbcore: registered new interface driver usbhid [ 6.001012] usbhid: USB HID core driver [ 6.006576] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.075785] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.087746] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.099573] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.236424] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.254815] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.263436] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.269688] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:60 [ 6.278133] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.448408] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.458804] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.467419] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.474541] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:61 [ 6.482934] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.490776] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.516718] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 201531/61054976 files, 6893769/244190336 blocks done. [ 13.713187] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.503309] systemd[1]: Inserted module 'autofs4' [ 14.598230] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.647765] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.700605] systemd[1]: Hostname set to . [ 15.962480] systemd[1]: Queued start job for default target Graphical Interface. [ 15.971229] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 15.992447] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.016349] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.039828] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.059879] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.084124] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.111801] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.139773] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.167776] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.195750] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.223752] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.251756] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.279852] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.303793] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.323787] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.347933] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.372045] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.398444] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.424018] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.443993] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.467912] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.492192] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.511982] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.536036] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.556147] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.580041] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.599968] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.621469] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.641349] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.665234] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.689397] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.709532] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.724313] RPC: Registered named UNIX socket transport module. [ 16.730316] RPC: Registered udp transport module. [ 16.735092] RPC: Registered tcp transport module. [ 16.739866] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 16.747114] systemd[1]: Starting Journal Service... Starting Journal Service... [ 16.767809] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.778074] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 16.800607] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 16.828710] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 16.856792] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 16.880478] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 16.900564] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 16.920601] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 16.944427] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 16.964487] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 16.988520] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.016833] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.035717] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.045684] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.057840] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.076546] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.100456] systemd[1]: Starting Coldplug All udev Devices... [ 17.104462] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. Starting Coldplug All udev Devices... [ 17.129442] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ 17.191143] lp: driver loaded but no devices found [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trac[ 17.214768] Loading iSCSI transport class v2.0-870. e File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 17.480113] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Startin[ 17.553058] systemd-journald[370]: Received client request to flush runtime journal. g Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Set console font and keymap. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. Mounting RPC Pipe File System... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... StartinS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Listening on Docker Socket . [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started User Login Management. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. + myips=172.21.15.129 + attempts=1 + sleep 1 [ OK ] Started Network Time Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished NFS server and services. [ OK ] Started ntp-systemd-netif.service. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.129 '!=' '' ']' + set -e + '[' -n 172.21.15.129 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.129 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.129 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started (i)SCSI target daemon. + newhostname=smithi129.front.sepia.ceph.com + '[' -n smithi129.front.sepia.ceph.com ']' + hostname smithi129.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi129 + echo smithi129 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.129 smithi129.front.sepia.ceph.com smithi129/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started The Apache HTTP Server. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi129.front.sepia.ceph.com ttyS1 smithi129 login: [disconnect] 2024-09-12T18:17:22.315 INFO:teuthology.misc:Re-opening connections... 2024-09-12T18:17:22.315 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:17:22.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:17:22.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:17:22.620 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-12T18:17:23.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-12T18:17:23.157 DEBUG:teuthology.misc:waited 0.8422684669494629 2024-09-12T18:17:23.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2024-09-12T18:17:24.158 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:17:24.158 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi129.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-09-12T18:17:24.158 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T18:17:24.259 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:17:24.281 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T18:17:24.281 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T18:17:24.328 INFO:tasks.ceph.osd.0:Started 2024-09-12T18:17:24.329 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:17:24.454 INFO:teuthology.orchestra.run.smithi129.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T18:17:24.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:17:24.457 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T18:17:26.105 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:17:26.459+0000 7efcac9ad7c0 -1 Falling back to public interface 2024-09-12T18:17:29.458 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:17:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:no valid command found; 10 closest matches: 2024-09-12T18:17:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:0 2024-09-12T18:17:29.578 INFO:teuthology.orchestra.run.smithi129.stderr:1 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:2 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:abort 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:assert 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs files list 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs stats 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:bluestore bluefs device info [] 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:config diff 2024-09-12T18:17:29.579 INFO:teuthology.orchestra.run.smithi129.stderr:admin_socket: invalid command 2024-09-12T18:17:29.580 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:17:29.581 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T18:17:29.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T18:17:34.075 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:17:34.430+0000 7efcac9ad7c0 -1 osd.0 42 log_to_monitors true 2024-09-12T18:17:34.582 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:17:34.706 INFO:teuthology.orchestra.run.smithi129.stderr:no valid command found; 10 closest matches: 2024-09-12T18:17:34.706 INFO:teuthology.orchestra.run.smithi129.stderr:0 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:1 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:2 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:abort 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:assert 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs files list 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs stats 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:bluestore allocator dump block 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:bluestore allocator fragmentation block 2024-09-12T18:17:34.707 INFO:teuthology.orchestra.run.smithi129.stderr:admin_socket: invalid command 2024-09-12T18:17:34.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:17:34.709 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T18:17:34.881 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-12T18:17:35.234+0000 7efca0788640 -1 osd.0 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:17:39.711 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:17:39.837 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-12T18:17:39.837 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-09-12T18:17:39.837 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-09-12T18:17:39.837 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-12T18:17:39.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:17:40.791 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:17:40.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:17:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:17:41.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:17:42.810 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:17:42.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:17:42.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:17:43.170 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:17:43.173 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:17:43.189 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-12T18:17:42.808816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":591020,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724160,"kb_used_data":3000,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391360,"statfs":{"total":289910292480,"available":289168752640,"internally_reserved":0,"allocated":3072000,"data_stored":2390460,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-13,"num_objects_misplaced":-9,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035122"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.136225+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:38.136225+0000","last_peered":"2024-09-12T18:17:38.136225+0000","last_clean":"2024-09-12T18:17:38.136225+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:38.136225+0000","last_undegraded":"2024-09-12T18:17:38.136225+0000","last_fullsized":"2024-09-12T18:17:38.136225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.786668+0000","last_change":"2024-09-12T18:17:36.809622+0000","last_active":"2024-09-12T18:17:37.786668+0000","last_peered":"2024-09-12T18:17:37.786668+0000","last_clean":"2024-09-12T18:17:37.786668+0000","last_became_active":"2024-09-12T18:17:36.809003+0000","last_became_peered":"2024-09-12T18:17:36.809003+0000","last_unstale":"2024-09-12T18:17:37.786668+0000","last_undegraded":"2024-09-12T18:17:37.786668+0000","last_fullsized":"2024-09-12T18:17:37.786668+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:06.382179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784615+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:37.784615+0000","last_peered":"2024-09-12T18:17:37.784615+0000","last_clean":"2024-09-12T18:17:37.784615+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:37.784615+0000","last_undegraded":"2024-09-12T18:17:37.784615+0000","last_fullsized":"2024-09-12T18:17:37.784615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785396+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:37.785396+0000","last_peered":"2024-09-12T18:17:37.785396+0000","last_clean":"2024-09-12T18:17:37.785396+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:37.785396+0000","last_undegraded":"2024-09-12T18:17:37.785396+0000","last_fullsized":"2024-09-12T18:17:37.785396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780422+0000","last_change":"2024-09-12T18:17:36.800605+0000","last_active":"2024-09-12T18:17:37.780422+0000","last_peered":"2024-09-12T18:17:37.780422+0000","last_clean":"2024-09-12T18:17:37.780422+0000","last_became_active":"2024-09-12T18:17:36.797634+0000","last_became_peered":"2024-09-12T18:17:36.797634+0000","last_unstale":"2024-09-12T18:17:37.780422+0000","last_undegraded":"2024-09-12T18:17:37.780422+0000","last_fullsized":"2024-09-12T18:17:37.780422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:32.678667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775534+0000","last_change":"2024-09-12T18:14:43.091871+0000","last_active":"2024-09-12T18:17:37.775534+0000","last_peered":"2024-09-12T18:17:37.775534+0000","last_clean":"2024-09-12T18:17:37.775534+0000","last_became_active":"2024-09-12T18:14:43.088851+0000","last_became_peered":"2024-09-12T18:14:43.088851+0000","last_unstale":"2024-09-12T18:17:37.775534+0000","last_undegraded":"2024-09-12T18:17:37.775534+0000","last_fullsized":"2024-09-12T18:17:37.775534+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.534130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783671+0000","last_change":"2024-09-12T18:14:43.092087+0000","last_active":"2024-09-12T18:17:37.783671+0000","last_peered":"2024-09-12T18:17:37.783671+0000","last_clean":"2024-09-12T18:17:37.783671+0000","last_became_active":"2024-09-12T18:14:43.089409+0000","last_became_peered":"2024-09-12T18:14:43.089409+0000","last_unstale":"2024-09-12T18:17:37.783671+0000","last_undegraded":"2024-09-12T18:17:37.783671+0000","last_fullsized":"2024-09-12T18:17:37.783671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.981162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800324+0000","last_change":"2024-09-12T18:17:37.800049+0000","last_active":"2024-09-12T18:17:37.800324+0000","last_peered":"2024-09-12T18:17:37.800324+0000","last_clean":"2024-09-12T18:17:37.800324+0000","last_became_active":"2024-09-12T18:17:37.797272+0000","last_became_peered":"2024-09-12T18:17:37.797272+0000","last_unstale":"2024-09-12T18:17:37.800324+0000","last_undegraded":"2024-09-12T18:17:37.800324+0000","last_fullsized":"2024-09-12T18:17:37.800324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:27.845813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.778371+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:37.778371+0000","last_peered":"2024-09-12T18:17:37.778371+0000","last_clean":"2024-09-12T18:17:37.778371+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:37.778371+0000","last_undegraded":"2024-09-12T18:17:37.778371+0000","last_fullsized":"2024-09-12T18:17:37.778371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.786151+0000","last_change":"2024-09-12T18:17:36.806954+0000","last_active":"2024-09-12T18:17:37.786151+0000","last_peered":"2024-09-12T18:17:37.786151+0000","last_clean":"2024-09-12T18:17:37.786151+0000","last_became_active":"2024-09-12T18:17:36.804438+0000","last_became_peered":"2024-09-12T18:17:36.804438+0000","last_unstale":"2024-09-12T18:17:37.786151+0000","last_undegraded":"2024-09-12T18:17:37.786151+0000","last_fullsized":"2024-09-12T18:17:37.786151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.122325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777972+0000","last_change":"2024-09-12T18:14:43.089717+0000","last_active":"2024-09-12T18:17:37.777972+0000","last_peered":"2024-09-12T18:17:37.777972+0000","last_clean":"2024-09-12T18:17:37.777972+0000","last_became_active":"2024-09-12T18:14:43.088841+0000","last_became_peered":"2024-09-12T18:14:43.088841+0000","last_unstale":"2024-09-12T18:17:37.777972+0000","last_undegraded":"2024-09-12T18:17:37.777972+0000","last_fullsized":"2024-09-12T18:17:37.777972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.068034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783629+0000","last_change":"2024-09-12T18:17:36.776701+0000","last_active":"2024-09-12T18:17:37.783629+0000","last_peered":"2024-09-12T18:17:37.783629+0000","last_clean":"2024-09-12T18:17:37.783629+0000","last_became_active":"2024-09-12T18:17:36.775273+0000","last_became_peered":"2024-09-12T18:17:36.775273+0000","last_unstale":"2024-09-12T18:17:37.783629+0000","last_undegraded":"2024-09-12T18:17:37.783629+0000","last_fullsized":"2024-09-12T18:17:37.783629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:10.775150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780237+0000","last_change":"2024-09-12T18:17:36.801388+0000","last_active":"2024-09-12T18:17:37.780237+0000","last_peered":"2024-09-12T18:17:37.780237+0000","last_clean":"2024-09-12T18:17:37.780237+0000","last_became_active":"2024-09-12T18:17:36.799774+0000","last_became_peered":"2024-09-12T18:17:36.799774+0000","last_unstale":"2024-09-12T18:17:37.780237+0000","last_undegraded":"2024-09-12T18:17:37.780237+0000","last_fullsized":"2024-09-12T18:17:37.780237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:25.516140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783225+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:37.783225+0000","last_peered":"2024-09-12T18:17:37.783225+0000","last_clean":"2024-09-12T18:17:37.783225+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:37.783225+0000","last_undegraded":"2024-09-12T18:17:37.783225+0000","last_fullsized":"2024-09-12T18:17:37.783225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.796010+0000","last_change":"2024-09-12T18:17:37.795742+0000","last_active":"2024-09-12T18:17:37.796010+0000","last_peered":"2024-09-12T18:17:37.796010+0000","last_clean":"2024-09-12T18:17:37.796010+0000","last_became_active":"2024-09-12T18:17:37.794824+0000","last_became_peered":"2024-09-12T18:17:37.794824+0000","last_unstale":"2024-09-12T18:17:37.796010+0000","last_undegraded":"2024-09-12T18:17:37.796010+0000","last_fullsized":"2024-09-12T18:17:37.796010+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:52.528615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775593+0000","last_change":"2024-09-12T18:14:43.089479+0000","last_active":"2024-09-12T18:17:37.775593+0000","last_peered":"2024-09-12T18:17:37.775593+0000","last_clean":"2024-09-12T18:17:37.775593+0000","last_became_active":"2024-09-12T18:14:43.088622+0000","last_became_peered":"2024-09-12T18:14:43.088622+0000","last_unstale":"2024-09-12T18:17:37.775593+0000","last_undegraded":"2024-09-12T18:17:37.775593+0000","last_fullsized":"2024-09-12T18:17:37.775593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:59.550636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780876+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:37.780876+0000","last_peered":"2024-09-12T18:17:37.780876+0000","last_clean":"2024-09-12T18:17:37.780876+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:37.780876+0000","last_undegraded":"2024-09-12T18:17:37.780876+0000","last_fullsized":"2024-09-12T18:17:37.780876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782683+0000","last_change":"2024-09-12T18:17:36.806316+0000","last_active":"2024-09-12T18:17:37.782683+0000","last_peered":"2024-09-12T18:17:37.782683+0000","last_clean":"2024-09-12T18:17:37.782683+0000","last_became_active":"2024-09-12T18:17:36.803934+0000","last_became_peered":"2024-09-12T18:17:36.803934+0000","last_unstale":"2024-09-12T18:17:37.782683+0000","last_undegraded":"2024-09-12T18:17:37.782683+0000","last_fullsized":"2024-09-12T18:17:37.782683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.182845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779314+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:37.779314+0000","last_peered":"2024-09-12T18:17:37.779314+0000","last_clean":"2024-09-12T18:17:37.779314+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:37.779314+0000","last_undegraded":"2024-09-12T18:17:37.779314+0000","last_fullsized":"2024-09-12T18:17:37.779314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777461+0000","last_change":"2024-09-12T18:14:43.097711+0000","last_active":"2024-09-12T18:17:37.777461+0000","last_peered":"2024-09-12T18:17:37.777461+0000","last_clean":"2024-09-12T18:17:37.777461+0000","last_became_active":"2024-09-12T18:14:43.095429+0000","last_became_peered":"2024-09-12T18:14:43.095429+0000","last_unstale":"2024-09-12T18:17:37.777461+0000","last_undegraded":"2024-09-12T18:17:37.777461+0000","last_fullsized":"2024-09-12T18:17:37.777461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:55.449555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.806606+0000","last_change":"2024-09-12T18:17:37.806327+0000","last_active":"2024-09-12T18:17:37.806606+0000","last_peered":"2024-09-12T18:17:37.806606+0000","last_clean":"2024-09-12T18:17:37.806606+0000","last_became_active":"2024-09-12T18:17:37.800412+0000","last_became_peered":"2024-09-12T18:17:37.800412+0000","last_unstale":"2024-09-12T18:17:37.806606+0000","last_undegraded":"2024-09-12T18:17:37.806606+0000","last_fullsized":"2024-09-12T18:17:37.806606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:18.837350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134474+0000","last_change":"2024-09-12T18:17:37.142722+0000","last_active":"2024-09-12T18:17:38.134474+0000","last_peered":"2024-09-12T18:17:38.134474+0000","last_clean":"2024-09-12T18:17:38.134474+0000","last_became_active":"2024-09-12T18:17:37.141936+0000","last_became_peered":"2024-09-12T18:17:37.141936+0000","last_unstale":"2024-09-12T18:17:38.134474+0000","last_undegraded":"2024-09-12T18:17:38.134474+0000","last_fullsized":"2024-09-12T18:17:38.134474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.674433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.801352+0000","last_change":"2024-09-12T18:17:37.801088+0000","last_active":"2024-09-12T18:17:37.801352+0000","last_peered":"2024-09-12T18:17:37.801352+0000","last_clean":"2024-09-12T18:17:37.801352+0000","last_became_active":"2024-09-12T18:17:37.798514+0000","last_became_peered":"2024-09-12T18:17:37.798514+0000","last_unstale":"2024-09-12T18:17:37.801352+0000","last_undegraded":"2024-09-12T18:17:37.801352+0000","last_fullsized":"2024-09-12T18:17:37.801352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:04.957104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775030+0000","last_change":"2024-09-12T18:17:36.787459+0000","last_active":"2024-09-12T18:17:37.775030+0000","last_peered":"2024-09-12T18:17:37.775030+0000","last_clean":"2024-09-12T18:17:37.775030+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:37.775030+0000","last_undegraded":"2024-09-12T18:17:37.775030+0000","last_fullsized":"2024-09-12T18:17:37.775030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:36.290604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.154053+0000","last_change":"2024-09-12T18:17:38.153540+0000","last_active":"2024-09-12T18:17:38.154053+0000","last_peered":"2024-09-12T18:17:38.154053+0000","last_clean":"2024-09-12T18:17:38.154053+0000","last_became_active":"2024-09-12T18:17:38.152617+0000","last_became_peered":"2024-09-12T18:17:38.152617+0000","last_unstale":"2024-09-12T18:17:38.154053+0000","last_undegraded":"2024-09-12T18:17:38.154053+0000","last_fullsized":"2024-09-12T18:17:38.154053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:47.511823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785857+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:37.785857+0000","last_peered":"2024-09-12T18:17:37.785857+0000","last_clean":"2024-09-12T18:17:37.785857+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:37.785857+0000","last_undegraded":"2024-09-12T18:17:37.785857+0000","last_fullsized":"2024-09-12T18:17:37.785857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800179+0000","last_change":"2024-09-12T18:17:37.799905+0000","last_active":"2024-09-12T18:17:37.800179+0000","last_peered":"2024-09-12T18:17:37.800179+0000","last_clean":"2024-09-12T18:17:37.800179+0000","last_became_active":"2024-09-12T18:17:37.798331+0000","last_became_peered":"2024-09-12T18:17:37.798331+0000","last_unstale":"2024-09-12T18:17:37.800179+0000","last_undegraded":"2024-09-12T18:17:37.800179+0000","last_fullsized":"2024-09-12T18:17:37.800179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:58.599189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.135018+0000","last_change":"2024-09-12T18:17:37.140076+0000","last_active":"2024-09-12T18:17:38.135018+0000","last_peered":"2024-09-12T18:17:38.135018+0000","last_clean":"2024-09-12T18:17:38.135018+0000","last_became_active":"2024-09-12T18:17:37.139431+0000","last_became_peered":"2024-09-12T18:17:37.139431+0000","last_unstale":"2024-09-12T18:17:38.135018+0000","last_undegraded":"2024-09-12T18:17:38.135018+0000","last_fullsized":"2024-09-12T18:17:38.135018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:10.706112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779761+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:37.779761+0000","last_peered":"2024-09-12T18:17:37.779761+0000","last_clean":"2024-09-12T18:17:37.779761+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:37.779761+0000","last_undegraded":"2024-09-12T18:17:37.779761+0000","last_fullsized":"2024-09-12T18:17:37.779761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782759+0000","last_change":"2024-09-12T18:17:36.779132+0000","last_active":"2024-09-12T18:17:37.782759+0000","last_peered":"2024-09-12T18:17:37.782759+0000","last_clean":"2024-09-12T18:17:37.782759+0000","last_became_active":"2024-09-12T18:17:36.777003+0000","last_became_peered":"2024-09-12T18:17:36.777003+0000","last_unstale":"2024-09-12T18:17:37.782759+0000","last_undegraded":"2024-09-12T18:17:37.782759+0000","last_fullsized":"2024-09-12T18:17:37.782759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:28.699621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780883+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:37.780883+0000","last_peered":"2024-09-12T18:17:37.780883+0000","last_clean":"2024-09-12T18:17:37.780883+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:37.780883+0000","last_undegraded":"2024-09-12T18:17:37.780883+0000","last_fullsized":"2024-09-12T18:17:37.780883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783000+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:37.783000+0000","last_peered":"2024-09-12T18:17:37.783000+0000","last_clean":"2024-09-12T18:17:37.783000+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:37.783000+0000","last_undegraded":"2024-09-12T18:17:37.783000+0000","last_fullsized":"2024-09-12T18:17:37.783000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782717+0000","last_change":"2024-09-12T18:17:36.794869+0000","last_active":"2024-09-12T18:17:37.782717+0000","last_peered":"2024-09-12T18:17:37.782717+0000","last_clean":"2024-09-12T18:17:37.782717+0000","last_became_active":"2024-09-12T18:17:36.791138+0000","last_became_peered":"2024-09-12T18:17:36.791138+0000","last_unstale":"2024-09-12T18:17:37.782717+0000","last_undegraded":"2024-09-12T18:17:37.782717+0000","last_fullsized":"2024-09-12T18:17:37.782717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:52.732621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784957+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:37.784957+0000","last_peered":"2024-09-12T18:17:37.784957+0000","last_clean":"2024-09-12T18:17:37.784957+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:37.784957+0000","last_undegraded":"2024-09-12T18:17:37.784957+0000","last_fullsized":"2024-09-12T18:17:37.784957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777825+0000","last_change":"2024-09-12T18:17:36.800798+0000","last_active":"2024-09-12T18:17:37.777825+0000","last_peered":"2024-09-12T18:17:37.777825+0000","last_clean":"2024-09-12T18:17:37.777825+0000","last_became_active":"2024-09-12T18:17:36.799721+0000","last_became_peered":"2024-09-12T18:17:36.799721+0000","last_unstale":"2024-09-12T18:17:37.777825+0000","last_undegraded":"2024-09-12T18:17:37.777825+0000","last_fullsized":"2024-09-12T18:17:37.777825+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.366965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776875+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:17:37.776875+0000","last_peered":"2024-09-12T18:17:37.776875+0000","last_clean":"2024-09-12T18:17:37.776875+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:17:37.776875+0000","last_undegraded":"2024-09-12T18:17:37.776875+0000","last_fullsized":"2024-09-12T18:17:37.776875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777446+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:37.777446+0000","last_peered":"2024-09-12T18:17:37.777446+0000","last_clean":"2024-09-12T18:17:37.777446+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:37.777446+0000","last_undegraded":"2024-09-12T18:17:37.777446+0000","last_fullsized":"2024-09-12T18:17:37.777446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.153812+0000","last_change":"2024-09-12T18:17:38.153525+0000","last_active":"2024-09-12T18:17:38.153812+0000","last_peered":"2024-09-12T18:17:38.153812+0000","last_clean":"2024-09-12T18:17:38.153812+0000","last_became_active":"2024-09-12T18:17:38.152725+0000","last_became_peered":"2024-09-12T18:17:38.152725+0000","last_unstale":"2024-09-12T18:17:38.153812+0000","last_undegraded":"2024-09-12T18:17:38.153812+0000","last_fullsized":"2024-09-12T18:17:38.153812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.613491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.778607+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:17:37.778607+0000","last_peered":"2024-09-12T18:17:37.778607+0000","last_clean":"2024-09-12T18:17:37.778607+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:17:37.778607+0000","last_undegraded":"2024-09-12T18:17:37.778607+0000","last_fullsized":"2024-09-12T18:17:37.778607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.133651+0000","last_change":"2024-09-12T18:17:37.142439+0000","last_active":"2024-09-12T18:17:38.133651+0000","last_peered":"2024-09-12T18:17:38.133651+0000","last_clean":"2024-09-12T18:17:38.133651+0000","last_became_active":"2024-09-12T18:17:37.142116+0000","last_became_peered":"2024-09-12T18:17:37.142116+0000","last_unstale":"2024-09-12T18:17:38.133651+0000","last_undegraded":"2024-09-12T18:17:38.133651+0000","last_fullsized":"2024-09-12T18:17:38.133651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:19.867645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784687+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:37.784687+0000","last_peered":"2024-09-12T18:17:37.784687+0000","last_clean":"2024-09-12T18:17:37.784687+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:37.784687+0000","last_undegraded":"2024-09-12T18:17:37.784687+0000","last_fullsized":"2024-09-12T18:17:37.784687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134337+0000","last_change":"2024-09-12T18:17:37.142735+0000","last_active":"2024-09-12T18:17:38.134337+0000","last_peered":"2024-09-12T18:17:38.134337+0000","last_clean":"2024-09-12T18:17:38.134337+0000","last_became_active":"2024-09-12T18:17:37.142277+0000","last_became_peered":"2024-09-12T18:17:37.142277+0000","last_unstale":"2024-09-12T18:17:38.134337+0000","last_undegraded":"2024-09-12T18:17:38.134337+0000","last_fullsized":"2024-09-12T18:17:38.134337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:12.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.808795+0000","last_change":"2024-09-12T18:17:37.808026+0000","last_active":"2024-09-12T18:17:37.808795+0000","last_peered":"2024-09-12T18:17:37.808795+0000","last_clean":"2024-09-12T18:17:37.808795+0000","last_became_active":"2024-09-12T18:17:37.804165+0000","last_became_peered":"2024-09-12T18:17:37.804165+0000","last_unstale":"2024-09-12T18:17:37.808795+0000","last_undegraded":"2024-09-12T18:17:37.808795+0000","last_fullsized":"2024-09-12T18:17:37.808795+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.227283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780352+0000","last_change":"2024-09-12T18:17:36.806545+0000","last_active":"2024-09-12T18:17:37.780352+0000","last_peered":"2024-09-12T18:17:37.780352+0000","last_clean":"2024-09-12T18:17:37.780352+0000","last_became_active":"2024-09-12T18:17:36.804199+0000","last_became_peered":"2024-09-12T18:17:36.804199+0000","last_unstale":"2024-09-12T18:17:37.780352+0000","last_undegraded":"2024-09-12T18:17:37.780352+0000","last_fullsized":"2024-09-12T18:17:37.780352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:52.646911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.797092+0000","last_change":"2024-09-12T18:17:37.796813+0000","last_active":"2024-09-12T18:17:37.797092+0000","last_peered":"2024-09-12T18:17:37.797092+0000","last_clean":"2024-09-12T18:17:37.797092+0000","last_became_active":"2024-09-12T18:17:37.795905+0000","last_became_peered":"2024-09-12T18:17:37.795905+0000","last_unstale":"2024-09-12T18:17:37.797092+0000","last_undegraded":"2024-09-12T18:17:37.797092+0000","last_fullsized":"2024-09-12T18:17:37.797092+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:22.397702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.797553+0000","last_change":"2024-09-12T18:17:37.797298+0000","last_active":"2024-09-12T18:17:37.797553+0000","last_peered":"2024-09-12T18:17:37.797553+0000","last_clean":"2024-09-12T18:17:37.797553+0000","last_became_active":"2024-09-12T18:17:37.796460+0000","last_became_peered":"2024-09-12T18:17:37.796460+0000","last_unstale":"2024-09-12T18:17:37.797553+0000","last_undegraded":"2024-09-12T18:17:37.797553+0000","last_fullsized":"2024-09-12T18:17:37.797553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:58.122658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777701+0000","last_change":"2024-09-12T18:14:43.096073+0000","last_active":"2024-09-12T18:17:37.777701+0000","last_peered":"2024-09-12T18:17:37.777701+0000","last_clean":"2024-09-12T18:17:37.777701+0000","last_became_active":"2024-09-12T18:14:43.092815+0000","last_became_peered":"2024-09-12T18:14:43.092815+0000","last_unstale":"2024-09-12T18:17:37.777701+0000","last_undegraded":"2024-09-12T18:17:37.777701+0000","last_fullsized":"2024-09-12T18:17:37.777701+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.757546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.807159+0000","last_change":"2024-09-12T18:17:37.806931+0000","last_active":"2024-09-12T18:17:37.807159+0000","last_peered":"2024-09-12T18:17:37.807159+0000","last_clean":"2024-09-12T18:17:37.807159+0000","last_became_active":"2024-09-12T18:17:37.800840+0000","last_became_peered":"2024-09-12T18:17:37.800840+0000","last_unstale":"2024-09-12T18:17:37.807159+0000","last_undegraded":"2024-09-12T18:17:37.807159+0000","last_fullsized":"2024-09-12T18:17:37.807159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:38.017162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.828633+0000","last_change":"2024-09-12T18:17:37.828478+0000","last_active":"2024-09-12T18:17:37.828633+0000","last_peered":"2024-09-12T18:17:37.828633+0000","last_clean":"2024-09-12T18:17:37.828633+0000","last_became_active":"2024-09-12T18:17:37.798893+0000","last_became_peered":"2024-09-12T18:17:37.798893+0000","last_unstale":"2024-09-12T18:17:37.828633+0000","last_undegraded":"2024-09-12T18:17:37.828633+0000","last_fullsized":"2024-09-12T18:17:37.828633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.797729+0000","last_change":"2024-09-12T18:17:37.797451+0000","last_active":"2024-09-12T18:17:37.797729+0000","last_peered":"2024-09-12T18:17:37.797729+0000","last_clean":"2024-09-12T18:17:37.797729+0000","last_became_active":"2024-09-12T18:17:37.795472+0000","last_became_peered":"2024-09-12T18:17:37.795472+0000","last_unstale":"2024-09-12T18:17:37.797729+0000","last_undegraded":"2024-09-12T18:17:37.797729+0000","last_fullsized":"2024-09-12T18:17:37.797729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:51.503168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776403+0000","last_change":"2024-09-12T18:14:43.095580+0000","last_active":"2024-09-12T18:17:37.776403+0000","last_peered":"2024-09-12T18:17:37.776403+0000","last_clean":"2024-09-12T18:17:37.776403+0000","last_became_active":"2024-09-12T18:14:43.092061+0000","last_became_peered":"2024-09-12T18:14:43.092061+0000","last_unstale":"2024-09-12T18:17:37.776403+0000","last_undegraded":"2024-09-12T18:17:37.776403+0000","last_fullsized":"2024-09-12T18:17:37.776403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:03.825242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.155123+0000","last_change":"2024-09-12T18:17:38.153281+0000","last_active":"2024-09-12T18:17:38.155123+0000","last_peered":"2024-09-12T18:17:38.155123+0000","last_clean":"2024-09-12T18:17:38.155123+0000","last_became_active":"2024-09-12T18:17:38.152437+0000","last_became_peered":"2024-09-12T18:17:38.152437+0000","last_unstale":"2024-09-12T18:17:38.155123+0000","last_undegraded":"2024-09-12T18:17:38.155123+0000","last_fullsized":"2024-09-12T18:17:38.155123+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:00.510477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782828+0000","last_change":"2024-09-12T18:17:36.782758+0000","last_active":"2024-09-12T18:17:37.782828+0000","last_peered":"2024-09-12T18:17:37.782828+0000","last_clean":"2024-09-12T18:17:37.782828+0000","last_became_active":"2024-09-12T18:17:36.780017+0000","last_became_peered":"2024-09-12T18:17:36.780017+0000","last_unstale":"2024-09-12T18:17:37.782828+0000","last_undegraded":"2024-09-12T18:17:37.782828+0000","last_fullsized":"2024-09-12T18:17:37.782828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:11.394054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.155439+0000","last_change":"2024-09-12T18:17:38.154306+0000","last_active":"2024-09-12T18:17:38.155439+0000","last_peered":"2024-09-12T18:17:38.155439+0000","last_clean":"2024-09-12T18:17:38.155439+0000","last_became_active":"2024-09-12T18:17:38.153668+0000","last_became_peered":"2024-09-12T18:17:38.153668+0000","last_unstale":"2024-09-12T18:17:38.155439+0000","last_undegraded":"2024-09-12T18:17:38.155439+0000","last_fullsized":"2024-09-12T18:17:38.155439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:49.832192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775965+0000","last_change":"2024-09-12T18:17:36.793762+0000","last_active":"2024-09-12T18:17:37.775965+0000","last_peered":"2024-09-12T18:17:37.775965+0000","last_clean":"2024-09-12T18:17:37.775965+0000","last_became_active":"2024-09-12T18:17:36.790151+0000","last_became_peered":"2024-09-12T18:17:36.790151+0000","last_unstale":"2024-09-12T18:17:37.775965+0000","last_undegraded":"2024-09-12T18:17:37.775965+0000","last_fullsized":"2024-09-12T18:17:37.775965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:29.545701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780491+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:37.780491+0000","last_peered":"2024-09-12T18:17:37.780491+0000","last_clean":"2024-09-12T18:17:37.780491+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:37.780491+0000","last_undegraded":"2024-09-12T18:17:37.780491+0000","last_fullsized":"2024-09-12T18:17:37.780491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":310,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.801190+0000","last_change":"2024-09-12T18:17:37.800920+0000","last_active":"2024-09-12T18:17:37.801190+0000","last_peered":"2024-09-12T18:17:37.801190+0000","last_clean":"2024-09-12T18:17:37.801190+0000","last_became_active":"2024-09-12T18:17:37.797285+0000","last_became_peered":"2024-09-12T18:17:37.797285+0000","last_unstale":"2024-09-12T18:17:37.801190+0000","last_undegraded":"2024-09-12T18:17:37.801190+0000","last_fullsized":"2024-09-12T18:17:37.801190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:35.553721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785287+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:37.785287+0000","last_peered":"2024-09-12T18:17:37.785287+0000","last_clean":"2024-09-12T18:17:37.785287+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:37.785287+0000","last_undegraded":"2024-09-12T18:17:37.785287+0000","last_fullsized":"2024-09-12T18:17:37.785287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777540+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:37.777540+0000","last_peered":"2024-09-12T18:17:37.777540+0000","last_clean":"2024-09-12T18:17:37.777540+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:37.777540+0000","last_undegraded":"2024-09-12T18:17:37.777540+0000","last_fullsized":"2024-09-12T18:17:37.777540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785535+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:37.785535+0000","last_peered":"2024-09-12T18:17:37.785535+0000","last_clean":"2024-09-12T18:17:37.785535+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:37.785535+0000","last_undegraded":"2024-09-12T18:17:37.785535+0000","last_fullsized":"2024-09-12T18:17:37.785535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783259+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:37.783259+0000","last_peered":"2024-09-12T18:17:37.783259+0000","last_clean":"2024-09-12T18:17:37.783259+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:37.783259+0000","last_undegraded":"2024-09-12T18:17:37.783259+0000","last_fullsized":"2024-09-12T18:17:37.783259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800675+0000","last_change":"2024-09-12T18:17:37.800428+0000","last_active":"2024-09-12T18:17:37.800675+0000","last_peered":"2024-09-12T18:17:37.800675+0000","last_clean":"2024-09-12T18:17:37.800675+0000","last_became_active":"2024-09-12T18:17:37.796795+0000","last_became_peered":"2024-09-12T18:17:37.796795+0000","last_unstale":"2024-09-12T18:17:37.800675+0000","last_undegraded":"2024-09-12T18:17:37.800675+0000","last_fullsized":"2024-09-12T18:17:37.800675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:51.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.135880+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:38.135880+0000","last_peered":"2024-09-12T18:17:38.135880+0000","last_clean":"2024-09-12T18:17:38.135880+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:38.135880+0000","last_undegraded":"2024-09-12T18:17:38.135880+0000","last_fullsized":"2024-09-12T18:17:38.135880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783407+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:37.783407+0000","last_peered":"2024-09-12T18:17:37.783407+0000","last_clean":"2024-09-12T18:17:37.783407+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:37.783407+0000","last_undegraded":"2024-09-12T18:17:37.783407+0000","last_fullsized":"2024-09-12T18:17:37.783407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.787613+0000","last_change":"2024-09-12T18:17:37.787360+0000","last_active":"2024-09-12T18:17:37.787613+0000","last_peered":"2024-09-12T18:17:37.787613+0000","last_clean":"2024-09-12T18:17:37.787613+0000","last_became_active":"2024-09-12T18:17:37.786527+0000","last_became_peered":"2024-09-12T18:17:37.786527+0000","last_unstale":"2024-09-12T18:17:37.787613+0000","last_undegraded":"2024-09-12T18:17:37.787613+0000","last_fullsized":"2024-09-12T18:17:37.787613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:44.024618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779716+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:37.779716+0000","last_peered":"2024-09-12T18:17:37.779716+0000","last_clean":"2024-09-12T18:17:37.779716+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:37.779716+0000","last_undegraded":"2024-09-12T18:17:37.779716+0000","last_fullsized":"2024-09-12T18:17:37.779716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785379+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:37.785379+0000","last_peered":"2024-09-12T18:17:37.785379+0000","last_clean":"2024-09-12T18:17:37.785379+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:37.785379+0000","last_undegraded":"2024-09-12T18:17:37.785379+0000","last_fullsized":"2024-09-12T18:17:37.785379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785246+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:37.785246+0000","last_peered":"2024-09-12T18:17:37.785246+0000","last_clean":"2024-09-12T18:17:37.785246+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:37.785246+0000","last_undegraded":"2024-09-12T18:17:37.785246+0000","last_fullsized":"2024-09-12T18:17:37.785246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783027+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:37.783027+0000","last_peered":"2024-09-12T18:17:37.783027+0000","last_clean":"2024-09-12T18:17:37.783027+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:37.783027+0000","last_undegraded":"2024-09-12T18:17:37.783027+0000","last_fullsized":"2024-09-12T18:17:37.783027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779138+0000","last_change":"2024-09-12T18:14:43.094420+0000","last_active":"2024-09-12T18:17:37.779138+0000","last_peered":"2024-09-12T18:17:37.779138+0000","last_clean":"2024-09-12T18:17:37.779138+0000","last_became_active":"2024-09-12T18:14:43.092106+0000","last_became_peered":"2024-09-12T18:14:43.092106+0000","last_unstale":"2024-09-12T18:17:37.779138+0000","last_undegraded":"2024-09-12T18:17:37.779138+0000","last_fullsized":"2024-09-12T18:17:37.779138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.122610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783502+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:37.783502+0000","last_peered":"2024-09-12T18:17:37.783502+0000","last_clean":"2024-09-12T18:17:37.783502+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:37.783502+0000","last_undegraded":"2024-09-12T18:17:37.783502+0000","last_fullsized":"2024-09-12T18:17:37.783502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.796656+0000","last_change":"2024-09-12T18:17:37.796391+0000","last_active":"2024-09-12T18:17:37.796656+0000","last_peered":"2024-09-12T18:17:37.796656+0000","last_clean":"2024-09-12T18:17:37.796656+0000","last_became_active":"2024-09-12T18:17:37.795351+0000","last_became_peered":"2024-09-12T18:17:37.795351+0000","last_unstale":"2024-09-12T18:17:37.796656+0000","last_undegraded":"2024-09-12T18:17:37.796656+0000","last_fullsized":"2024-09-12T18:17:37.796656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:28.203873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783322+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:37.783322+0000","last_peered":"2024-09-12T18:17:37.783322+0000","last_clean":"2024-09-12T18:17:37.783322+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:37.783322+0000","last_undegraded":"2024-09-12T18:17:37.783322+0000","last_fullsized":"2024-09-12T18:17:37.783322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.136929+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:38.136929+0000","last_peered":"2024-09-12T18:17:38.136929+0000","last_clean":"2024-09-12T18:17:38.136929+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:38.136929+0000","last_undegraded":"2024-09-12T18:17:38.136929+0000","last_fullsized":"2024-09-12T18:17:38.136929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.803799+0000","last_change":"2024-09-12T18:17:37.803588+0000","last_active":"2024-09-12T18:17:37.803799+0000","last_peered":"2024-09-12T18:17:37.803799+0000","last_clean":"2024-09-12T18:17:37.803799+0000","last_became_active":"2024-09-12T18:17:37.795092+0000","last_became_peered":"2024-09-12T18:17:37.795092+0000","last_unstale":"2024-09-12T18:17:37.803799+0000","last_undegraded":"2024-09-12T18:17:37.803799+0000","last_fullsized":"2024-09-12T18:17:37.803799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:23.076015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782338+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:37.782338+0000","last_peered":"2024-09-12T18:17:37.782338+0000","last_clean":"2024-09-12T18:17:37.782338+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:37.782338+0000","last_undegraded":"2024-09-12T18:17:37.782338+0000","last_fullsized":"2024-09-12T18:17:37.782338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777300+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:37.777300+0000","last_peered":"2024-09-12T18:17:37.777300+0000","last_clean":"2024-09-12T18:17:37.777300+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:37.777300+0000","last_undegraded":"2024-09-12T18:17:37.777300+0000","last_fullsized":"2024-09-12T18:17:37.777300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800515+0000","last_change":"2024-09-12T18:17:37.798798+0000","last_active":"2024-09-12T18:17:37.800515+0000","last_peered":"2024-09-12T18:17:37.800515+0000","last_clean":"2024-09-12T18:17:37.800515+0000","last_became_active":"2024-09-12T18:17:37.796134+0000","last_became_peered":"2024-09-12T18:17:37.796134+0000","last_unstale":"2024-09-12T18:17:37.800515+0000","last_undegraded":"2024-09-12T18:17:37.800515+0000","last_fullsized":"2024-09-12T18:17:37.800515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:22.208836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.832986+0000","last_change":"2024-09-12T18:17:37.832803+0000","last_active":"2024-09-12T18:17:37.832986+0000","last_peered":"2024-09-12T18:17:37.832986+0000","last_clean":"2024-09-12T18:17:37.832986+0000","last_became_active":"2024-09-12T18:17:37.807346+0000","last_became_peered":"2024-09-12T18:17:37.807346+0000","last_unstale":"2024-09-12T18:17:37.832986+0000","last_undegraded":"2024-09-12T18:17:37.832986+0000","last_fullsized":"2024-09-12T18:17:37.832986+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:34.919928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784873+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:37.784873+0000","last_peered":"2024-09-12T18:17:37.784873+0000","last_clean":"2024-09-12T18:17:37.784873+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:37.784873+0000","last_undegraded":"2024-09-12T18:17:37.784873+0000","last_fullsized":"2024-09-12T18:17:37.784873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.806187+0000","last_change":"2024-09-12T18:17:37.804867+0000","last_active":"2024-09-12T18:17:37.806187+0000","last_peered":"2024-09-12T18:17:37.806187+0000","last_clean":"2024-09-12T18:17:37.806187+0000","last_became_active":"2024-09-12T18:17:37.803507+0000","last_became_peered":"2024-09-12T18:17:37.803507+0000","last_unstale":"2024-09-12T18:17:37.806187+0000","last_undegraded":"2024-09-12T18:17:37.806187+0000","last_fullsized":"2024-09-12T18:17:37.806187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:33.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.798812+0000","last_change":"2024-09-12T18:17:37.798542+0000","last_active":"2024-09-12T18:17:37.798812+0000","last_peered":"2024-09-12T18:17:37.798812+0000","last_clean":"2024-09-12T18:17:37.798812+0000","last_became_active":"2024-09-12T18:17:37.795151+0000","last_became_peered":"2024-09-12T18:17:37.795151+0000","last_unstale":"2024-09-12T18:17:37.798812+0000","last_undegraded":"2024-09-12T18:17:37.798812+0000","last_fullsized":"2024-09-12T18:17:37.798812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:55.067325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134529+0000","last_change":"2024-09-12T18:17:37.149255+0000","last_active":"2024-09-12T18:17:38.134529+0000","last_peered":"2024-09-12T18:17:38.134529+0000","last_clean":"2024-09-12T18:17:38.134529+0000","last_became_active":"2024-09-12T18:17:37.147887+0000","last_became_peered":"2024-09-12T18:17:37.147887+0000","last_unstale":"2024-09-12T18:17:38.134529+0000","last_undegraded":"2024-09-12T18:17:38.134529+0000","last_fullsized":"2024-09-12T18:17:38.134529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:38.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776559+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:37.776559+0000","last_peered":"2024-09-12T18:17:37.776559+0000","last_clean":"2024-09-12T18:17:37.776559+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:37.776559+0000","last_undegraded":"2024-09-12T18:17:37.776559+0000","last_fullsized":"2024-09-12T18:17:37.776559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785215+0000","last_change":"2024-09-12T18:17:36.785578+0000","last_active":"2024-09-12T18:17:37.785215+0000","last_peered":"2024-09-12T18:17:37.785215+0000","last_clean":"2024-09-12T18:17:37.785215+0000","last_became_active":"2024-09-12T18:17:36.782643+0000","last_became_peered":"2024-09-12T18:17:36.782643+0000","last_unstale":"2024-09-12T18:17:37.785215+0000","last_undegraded":"2024-09-12T18:17:37.785215+0000","last_fullsized":"2024-09-12T18:17:37.785215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.694821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.808186+0000","last_change":"2024-09-12T18:17:37.808023+0000","last_active":"2024-09-12T18:17:37.808186+0000","last_peered":"2024-09-12T18:17:37.808186+0000","last_clean":"2024-09-12T18:17:37.808186+0000","last_became_active":"2024-09-12T18:17:37.807159+0000","last_became_peered":"2024-09-12T18:17:37.807159+0000","last_unstale":"2024-09-12T18:17:37.808186+0000","last_undegraded":"2024-09-12T18:17:37.808186+0000","last_fullsized":"2024-09-12T18:17:37.808186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:10.003292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780633+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:37.780633+0000","last_peered":"2024-09-12T18:17:37.780633+0000","last_clean":"2024-09-12T18:17:37.780633+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:37.780633+0000","last_undegraded":"2024-09-12T18:17:37.780633+0000","last_fullsized":"2024-09-12T18:17:37.780633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780753+0000","last_change":"2024-09-12T18:15:13.303308+0000","last_active":"2024-09-12T18:17:37.780753+0000","last_peered":"2024-09-12T18:17:37.780753+0000","last_clean":"2024-09-12T18:17:37.780753+0000","last_became_active":"2024-09-12T18:15:13.303093+0000","last_became_peered":"2024-09-12T18:15:13.303093+0000","last_unstale":"2024-09-12T18:17:37.780753+0000","last_undegraded":"2024-09-12T18:17:37.780753+0000","last_fullsized":"2024-09-12T18:17:37.780753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776915+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:37.776915+0000","last_peered":"2024-09-12T18:17:37.776915+0000","last_clean":"2024-09-12T18:17:37.776915+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:37.776915+0000","last_undegraded":"2024-09-12T18:17:37.776915+0000","last_fullsized":"2024-09-12T18:17:37.776915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784327+0000","last_change":"2024-09-12T18:17:36.781903+0000","last_active":"2024-09-12T18:17:37.784327+0000","last_peered":"2024-09-12T18:17:37.784327+0000","last_clean":"2024-09-12T18:17:37.784327+0000","last_became_active":"2024-09-12T18:17:36.780395+0000","last_became_peered":"2024-09-12T18:17:36.780395+0000","last_unstale":"2024-09-12T18:17:37.784327+0000","last_undegraded":"2024-09-12T18:17:37.784327+0000","last_fullsized":"2024-09-12T18:17:37.784327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:47.917209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780226+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:37.780226+0000","last_peered":"2024-09-12T18:17:37.780226+0000","last_clean":"2024-09-12T18:17:37.780226+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:37.780226+0000","last_undegraded":"2024-09-12T18:17:37.780226+0000","last_fullsized":"2024-09-12T18:17:37.780226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.806094+0000","last_change":"2024-09-12T18:17:37.804788+0000","last_active":"2024-09-12T18:17:37.806094+0000","last_peered":"2024-09-12T18:17:37.806094+0000","last_clean":"2024-09-12T18:17:37.806094+0000","last_became_active":"2024-09-12T18:17:37.800337+0000","last_became_peered":"2024-09-12T18:17:37.800337+0000","last_unstale":"2024-09-12T18:17:37.806094+0000","last_undegraded":"2024-09-12T18:17:37.806094+0000","last_fullsized":"2024-09-12T18:17:37.806094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.414203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.801733+0000","last_change":"2024-09-12T18:17:37.801491+0000","last_active":"2024-09-12T18:17:37.801733+0000","last_peered":"2024-09-12T18:17:37.801733+0000","last_clean":"2024-09-12T18:17:37.801733+0000","last_became_active":"2024-09-12T18:17:37.797845+0000","last_became_peered":"2024-09-12T18:17:37.797845+0000","last_unstale":"2024-09-12T18:17:37.801733+0000","last_undegraded":"2024-09-12T18:17:37.801733+0000","last_fullsized":"2024-09-12T18:17:37.801733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.692223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.153672+0000","last_change":"2024-09-12T18:17:38.153303+0000","last_active":"2024-09-12T18:17:38.153672+0000","last_peered":"2024-09-12T18:17:38.153672+0000","last_clean":"2024-09-12T18:17:38.153672+0000","last_became_active":"2024-09-12T18:17:38.152386+0000","last_became_peered":"2024-09-12T18:17:38.152386+0000","last_unstale":"2024-09-12T18:17:38.153672+0000","last_undegraded":"2024-09-12T18:17:38.153672+0000","last_fullsized":"2024-09-12T18:17:38.153672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:31.984057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776106+0000","last_change":"2024-09-12T18:17:36.793395+0000","last_active":"2024-09-12T18:17:37.776106+0000","last_peered":"2024-09-12T18:17:37.776106+0000","last_clean":"2024-09-12T18:17:37.776106+0000","last_became_active":"2024-09-12T18:17:36.787318+0000","last_became_peered":"2024-09-12T18:17:36.787318+0000","last_unstale":"2024-09-12T18:17:37.776106+0000","last_undegraded":"2024-09-12T18:17:37.776106+0000","last_fullsized":"2024-09-12T18:17:37.776106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:07.751267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776058+0000","last_change":"2024-09-12T18:17:36.797003+0000","last_active":"2024-09-12T18:17:37.776058+0000","last_peered":"2024-09-12T18:17:37.776058+0000","last_clean":"2024-09-12T18:17:37.776058+0000","last_became_active":"2024-09-12T18:17:36.791964+0000","last_became_peered":"2024-09-12T18:17:36.791964+0000","last_unstale":"2024-09-12T18:17:37.776058+0000","last_undegraded":"2024-09-12T18:17:37.776058+0000","last_fullsized":"2024-09-12T18:17:37.776058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:46.151762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.807908+0000","last_change":"2024-09-12T18:17:37.807727+0000","last_active":"2024-09-12T18:17:37.807908+0000","last_peered":"2024-09-12T18:17:37.807908+0000","last_clean":"2024-09-12T18:17:37.807908+0000","last_became_active":"2024-09-12T18:17:37.802850+0000","last_became_peered":"2024-09-12T18:17:37.802850+0000","last_unstale":"2024-09-12T18:17:37.807908+0000","last_undegraded":"2024-09-12T18:17:37.807908+0000","last_fullsized":"2024-09-12T18:17:37.807908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:47.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.807567+0000","last_change":"2024-09-12T18:17:37.807244+0000","last_active":"2024-09-12T18:17:37.807567+0000","last_peered":"2024-09-12T18:17:37.807567+0000","last_clean":"2024-09-12T18:17:37.807567+0000","last_became_active":"2024-09-12T18:17:37.801474+0000","last_became_peered":"2024-09-12T18:17:37.801474+0000","last_unstale":"2024-09-12T18:17:37.807567+0000","last_undegraded":"2024-09-12T18:17:37.807567+0000","last_fullsized":"2024-09-12T18:17:37.807567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:51.866240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.814959+0000","last_change":"2024-09-12T18:17:37.814819+0000","last_active":"2024-09-12T18:17:37.814959+0000","last_peered":"2024-09-12T18:17:37.814959+0000","last_clean":"2024-09-12T18:17:37.814959+0000","last_became_active":"2024-09-12T18:17:37.796873+0000","last_became_peered":"2024-09-12T18:17:37.796873+0000","last_unstale":"2024-09-12T18:17:37.814959+0000","last_undegraded":"2024-09-12T18:17:37.814959+0000","last_fullsized":"2024-09-12T18:17:37.814959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:56.597550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.798334+0000","last_change":"2024-09-12T18:17:37.798085+0000","last_active":"2024-09-12T18:17:37.798334+0000","last_peered":"2024-09-12T18:17:37.798334+0000","last_clean":"2024-09-12T18:17:37.798334+0000","last_became_active":"2024-09-12T18:17:37.795487+0000","last_became_peered":"2024-09-12T18:17:37.795487+0000","last_unstale":"2024-09-12T18:17:37.798334+0000","last_undegraded":"2024-09-12T18:17:37.798334+0000","last_fullsized":"2024-09-12T18:17:37.798334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:31.548973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134636+0000","last_change":"2024-09-12T18:17:37.149265+0000","last_active":"2024-09-12T18:17:38.134636+0000","last_peered":"2024-09-12T18:17:38.134636+0000","last_clean":"2024-09-12T18:17:38.134636+0000","last_became_active":"2024-09-12T18:17:37.148345+0000","last_became_peered":"2024-09-12T18:17:37.148345+0000","last_unstale":"2024-09-12T18:17:38.134636+0000","last_undegraded":"2024-09-12T18:17:38.134636+0000","last_fullsized":"2024-09-12T18:17:38.134636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:53.813446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775424+0000","last_change":"2024-09-12T18:17:36.805845+0000","last_active":"2024-09-12T18:17:37.775424+0000","last_peered":"2024-09-12T18:17:37.775424+0000","last_clean":"2024-09-12T18:17:37.775424+0000","last_became_active":"2024-09-12T18:17:36.803137+0000","last_became_peered":"2024-09-12T18:17:36.803137+0000","last_unstale":"2024-09-12T18:17:37.775424+0000","last_undegraded":"2024-09-12T18:17:37.775424+0000","last_fullsized":"2024-09-12T18:17:37.775424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.380784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.786404+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:37.786404+0000","last_peered":"2024-09-12T18:17:37.786404+0000","last_clean":"2024-09-12T18:17:37.786404+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:37.786404+0000","last_undegraded":"2024-09-12T18:17:37.786404+0000","last_fullsized":"2024-09-12T18:17:37.786404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783016+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:37.783016+0000","last_peered":"2024-09-12T18:17:37.783016+0000","last_clean":"2024-09-12T18:17:37.783016+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:37.783016+0000","last_undegraded":"2024-09-12T18:17:37.783016+0000","last_fullsized":"2024-09-12T18:17:37.783016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.821756+0000","last_change":"2024-09-12T18:17:37.821614+0000","last_active":"2024-09-12T18:17:37.821756+0000","last_peered":"2024-09-12T18:17:37.821756+0000","last_clean":"2024-09-12T18:17:37.821756+0000","last_became_active":"2024-09-12T18:17:37.803143+0000","last_became_peered":"2024-09-12T18:17:37.803143+0000","last_unstale":"2024-09-12T18:17:37.821756+0000","last_undegraded":"2024-09-12T18:17:37.821756+0000","last_fullsized":"2024-09-12T18:17:37.821756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:15.318739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":652,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":21223,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280680,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091160,"statfs":{"total":96636764160,"available":96349347840,"internally_reserved":0,"allocated":995328,"data_stored":403399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397308,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974532,"statfs":{"total":96636764160,"available":96229920768,"internally_reserved":0,"allocated":1024000,"data_stored":992695,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285570,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46172,"kb_used_data":1028,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325668,"statfs":{"total":96636764160,"available":96589484032,"internally_reserved":0,"allocated":1052672,"data_stored":994366,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:17:43.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:17:43.552 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:17:43.554 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:17:43.570 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-12T18:17:42.808816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":591020,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724160,"kb_used_data":3000,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391360,"statfs":{"total":289910292480,"available":289168752640,"internally_reserved":0,"allocated":3072000,"data_stored":2390460,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-13,"num_objects_misplaced":-9,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.035122"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.136225+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:38.136225+0000","last_peered":"2024-09-12T18:17:38.136225+0000","last_clean":"2024-09-12T18:17:38.136225+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:38.136225+0000","last_undegraded":"2024-09-12T18:17:38.136225+0000","last_fullsized":"2024-09-12T18:17:38.136225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.786668+0000","last_change":"2024-09-12T18:17:36.809622+0000","last_active":"2024-09-12T18:17:37.786668+0000","last_peered":"2024-09-12T18:17:37.786668+0000","last_clean":"2024-09-12T18:17:37.786668+0000","last_became_active":"2024-09-12T18:17:36.809003+0000","last_became_peered":"2024-09-12T18:17:36.809003+0000","last_unstale":"2024-09-12T18:17:37.786668+0000","last_undegraded":"2024-09-12T18:17:37.786668+0000","last_fullsized":"2024-09-12T18:17:37.786668+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:06.382179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784615+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:37.784615+0000","last_peered":"2024-09-12T18:17:37.784615+0000","last_clean":"2024-09-12T18:17:37.784615+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:37.784615+0000","last_undegraded":"2024-09-12T18:17:37.784615+0000","last_fullsized":"2024-09-12T18:17:37.784615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785396+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:37.785396+0000","last_peered":"2024-09-12T18:17:37.785396+0000","last_clean":"2024-09-12T18:17:37.785396+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:37.785396+0000","last_undegraded":"2024-09-12T18:17:37.785396+0000","last_fullsized":"2024-09-12T18:17:37.785396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780422+0000","last_change":"2024-09-12T18:17:36.800605+0000","last_active":"2024-09-12T18:17:37.780422+0000","last_peered":"2024-09-12T18:17:37.780422+0000","last_clean":"2024-09-12T18:17:37.780422+0000","last_became_active":"2024-09-12T18:17:36.797634+0000","last_became_peered":"2024-09-12T18:17:36.797634+0000","last_unstale":"2024-09-12T18:17:37.780422+0000","last_undegraded":"2024-09-12T18:17:37.780422+0000","last_fullsized":"2024-09-12T18:17:37.780422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:32.678667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775534+0000","last_change":"2024-09-12T18:14:43.091871+0000","last_active":"2024-09-12T18:17:37.775534+0000","last_peered":"2024-09-12T18:17:37.775534+0000","last_clean":"2024-09-12T18:17:37.775534+0000","last_became_active":"2024-09-12T18:14:43.088851+0000","last_became_peered":"2024-09-12T18:14:43.088851+0000","last_unstale":"2024-09-12T18:17:37.775534+0000","last_undegraded":"2024-09-12T18:17:37.775534+0000","last_fullsized":"2024-09-12T18:17:37.775534+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.534130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783671+0000","last_change":"2024-09-12T18:14:43.092087+0000","last_active":"2024-09-12T18:17:37.783671+0000","last_peered":"2024-09-12T18:17:37.783671+0000","last_clean":"2024-09-12T18:17:37.783671+0000","last_became_active":"2024-09-12T18:14:43.089409+0000","last_became_peered":"2024-09-12T18:14:43.089409+0000","last_unstale":"2024-09-12T18:17:37.783671+0000","last_undegraded":"2024-09-12T18:17:37.783671+0000","last_fullsized":"2024-09-12T18:17:37.783671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:55.981162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800324+0000","last_change":"2024-09-12T18:17:37.800049+0000","last_active":"2024-09-12T18:17:37.800324+0000","last_peered":"2024-09-12T18:17:37.800324+0000","last_clean":"2024-09-12T18:17:37.800324+0000","last_became_active":"2024-09-12T18:17:37.797272+0000","last_became_peered":"2024-09-12T18:17:37.797272+0000","last_unstale":"2024-09-12T18:17:37.800324+0000","last_undegraded":"2024-09-12T18:17:37.800324+0000","last_fullsized":"2024-09-12T18:17:37.800324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:27.845813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.778371+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:37.778371+0000","last_peered":"2024-09-12T18:17:37.778371+0000","last_clean":"2024-09-12T18:17:37.778371+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:37.778371+0000","last_undegraded":"2024-09-12T18:17:37.778371+0000","last_fullsized":"2024-09-12T18:17:37.778371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.786151+0000","last_change":"2024-09-12T18:17:36.806954+0000","last_active":"2024-09-12T18:17:37.786151+0000","last_peered":"2024-09-12T18:17:37.786151+0000","last_clean":"2024-09-12T18:17:37.786151+0000","last_became_active":"2024-09-12T18:17:36.804438+0000","last_became_peered":"2024-09-12T18:17:36.804438+0000","last_unstale":"2024-09-12T18:17:37.786151+0000","last_undegraded":"2024-09-12T18:17:37.786151+0000","last_fullsized":"2024-09-12T18:17:37.786151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.122325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777972+0000","last_change":"2024-09-12T18:14:43.089717+0000","last_active":"2024-09-12T18:17:37.777972+0000","last_peered":"2024-09-12T18:17:37.777972+0000","last_clean":"2024-09-12T18:17:37.777972+0000","last_became_active":"2024-09-12T18:14:43.088841+0000","last_became_peered":"2024-09-12T18:14:43.088841+0000","last_unstale":"2024-09-12T18:17:37.777972+0000","last_undegraded":"2024-09-12T18:17:37.777972+0000","last_fullsized":"2024-09-12T18:17:37.777972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.068034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783629+0000","last_change":"2024-09-12T18:17:36.776701+0000","last_active":"2024-09-12T18:17:37.783629+0000","last_peered":"2024-09-12T18:17:37.783629+0000","last_clean":"2024-09-12T18:17:37.783629+0000","last_became_active":"2024-09-12T18:17:36.775273+0000","last_became_peered":"2024-09-12T18:17:36.775273+0000","last_unstale":"2024-09-12T18:17:37.783629+0000","last_undegraded":"2024-09-12T18:17:37.783629+0000","last_fullsized":"2024-09-12T18:17:37.783629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:10.775150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780237+0000","last_change":"2024-09-12T18:17:36.801388+0000","last_active":"2024-09-12T18:17:37.780237+0000","last_peered":"2024-09-12T18:17:37.780237+0000","last_clean":"2024-09-12T18:17:37.780237+0000","last_became_active":"2024-09-12T18:17:36.799774+0000","last_became_peered":"2024-09-12T18:17:36.799774+0000","last_unstale":"2024-09-12T18:17:37.780237+0000","last_undegraded":"2024-09-12T18:17:37.780237+0000","last_fullsized":"2024-09-12T18:17:37.780237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:25.516140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783225+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:37.783225+0000","last_peered":"2024-09-12T18:17:37.783225+0000","last_clean":"2024-09-12T18:17:37.783225+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:37.783225+0000","last_undegraded":"2024-09-12T18:17:37.783225+0000","last_fullsized":"2024-09-12T18:17:37.783225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.796010+0000","last_change":"2024-09-12T18:17:37.795742+0000","last_active":"2024-09-12T18:17:37.796010+0000","last_peered":"2024-09-12T18:17:37.796010+0000","last_clean":"2024-09-12T18:17:37.796010+0000","last_became_active":"2024-09-12T18:17:37.794824+0000","last_became_peered":"2024-09-12T18:17:37.794824+0000","last_unstale":"2024-09-12T18:17:37.796010+0000","last_undegraded":"2024-09-12T18:17:37.796010+0000","last_fullsized":"2024-09-12T18:17:37.796010+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:52.528615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775593+0000","last_change":"2024-09-12T18:14:43.089479+0000","last_active":"2024-09-12T18:17:37.775593+0000","last_peered":"2024-09-12T18:17:37.775593+0000","last_clean":"2024-09-12T18:17:37.775593+0000","last_became_active":"2024-09-12T18:14:43.088622+0000","last_became_peered":"2024-09-12T18:14:43.088622+0000","last_unstale":"2024-09-12T18:17:37.775593+0000","last_undegraded":"2024-09-12T18:17:37.775593+0000","last_fullsized":"2024-09-12T18:17:37.775593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:59.550636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780876+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:37.780876+0000","last_peered":"2024-09-12T18:17:37.780876+0000","last_clean":"2024-09-12T18:17:37.780876+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:37.780876+0000","last_undegraded":"2024-09-12T18:17:37.780876+0000","last_fullsized":"2024-09-12T18:17:37.780876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782683+0000","last_change":"2024-09-12T18:17:36.806316+0000","last_active":"2024-09-12T18:17:37.782683+0000","last_peered":"2024-09-12T18:17:37.782683+0000","last_clean":"2024-09-12T18:17:37.782683+0000","last_became_active":"2024-09-12T18:17:36.803934+0000","last_became_peered":"2024-09-12T18:17:36.803934+0000","last_unstale":"2024-09-12T18:17:37.782683+0000","last_undegraded":"2024-09-12T18:17:37.782683+0000","last_fullsized":"2024-09-12T18:17:37.782683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.182845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779314+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:37.779314+0000","last_peered":"2024-09-12T18:17:37.779314+0000","last_clean":"2024-09-12T18:17:37.779314+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:37.779314+0000","last_undegraded":"2024-09-12T18:17:37.779314+0000","last_fullsized":"2024-09-12T18:17:37.779314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777461+0000","last_change":"2024-09-12T18:14:43.097711+0000","last_active":"2024-09-12T18:17:37.777461+0000","last_peered":"2024-09-12T18:17:37.777461+0000","last_clean":"2024-09-12T18:17:37.777461+0000","last_became_active":"2024-09-12T18:14:43.095429+0000","last_became_peered":"2024-09-12T18:14:43.095429+0000","last_unstale":"2024-09-12T18:17:37.777461+0000","last_undegraded":"2024-09-12T18:17:37.777461+0000","last_fullsized":"2024-09-12T18:17:37.777461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:55.449555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.806606+0000","last_change":"2024-09-12T18:17:37.806327+0000","last_active":"2024-09-12T18:17:37.806606+0000","last_peered":"2024-09-12T18:17:37.806606+0000","last_clean":"2024-09-12T18:17:37.806606+0000","last_became_active":"2024-09-12T18:17:37.800412+0000","last_became_peered":"2024-09-12T18:17:37.800412+0000","last_unstale":"2024-09-12T18:17:37.806606+0000","last_undegraded":"2024-09-12T18:17:37.806606+0000","last_fullsized":"2024-09-12T18:17:37.806606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:18.837350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134474+0000","last_change":"2024-09-12T18:17:37.142722+0000","last_active":"2024-09-12T18:17:38.134474+0000","last_peered":"2024-09-12T18:17:38.134474+0000","last_clean":"2024-09-12T18:17:38.134474+0000","last_became_active":"2024-09-12T18:17:37.141936+0000","last_became_peered":"2024-09-12T18:17:37.141936+0000","last_unstale":"2024-09-12T18:17:38.134474+0000","last_undegraded":"2024-09-12T18:17:38.134474+0000","last_fullsized":"2024-09-12T18:17:38.134474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:00.674433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.801352+0000","last_change":"2024-09-12T18:17:37.801088+0000","last_active":"2024-09-12T18:17:37.801352+0000","last_peered":"2024-09-12T18:17:37.801352+0000","last_clean":"2024-09-12T18:17:37.801352+0000","last_became_active":"2024-09-12T18:17:37.798514+0000","last_became_peered":"2024-09-12T18:17:37.798514+0000","last_unstale":"2024-09-12T18:17:37.801352+0000","last_undegraded":"2024-09-12T18:17:37.801352+0000","last_fullsized":"2024-09-12T18:17:37.801352+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:04.957104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775030+0000","last_change":"2024-09-12T18:17:36.787459+0000","last_active":"2024-09-12T18:17:37.775030+0000","last_peered":"2024-09-12T18:17:37.775030+0000","last_clean":"2024-09-12T18:17:37.775030+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:37.775030+0000","last_undegraded":"2024-09-12T18:17:37.775030+0000","last_fullsized":"2024-09-12T18:17:37.775030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:36.290604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.154053+0000","last_change":"2024-09-12T18:17:38.153540+0000","last_active":"2024-09-12T18:17:38.154053+0000","last_peered":"2024-09-12T18:17:38.154053+0000","last_clean":"2024-09-12T18:17:38.154053+0000","last_became_active":"2024-09-12T18:17:38.152617+0000","last_became_peered":"2024-09-12T18:17:38.152617+0000","last_unstale":"2024-09-12T18:17:38.154053+0000","last_undegraded":"2024-09-12T18:17:38.154053+0000","last_fullsized":"2024-09-12T18:17:38.154053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:47.511823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785857+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:37.785857+0000","last_peered":"2024-09-12T18:17:37.785857+0000","last_clean":"2024-09-12T18:17:37.785857+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:37.785857+0000","last_undegraded":"2024-09-12T18:17:37.785857+0000","last_fullsized":"2024-09-12T18:17:37.785857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800179+0000","last_change":"2024-09-12T18:17:37.799905+0000","last_active":"2024-09-12T18:17:37.800179+0000","last_peered":"2024-09-12T18:17:37.800179+0000","last_clean":"2024-09-12T18:17:37.800179+0000","last_became_active":"2024-09-12T18:17:37.798331+0000","last_became_peered":"2024-09-12T18:17:37.798331+0000","last_unstale":"2024-09-12T18:17:37.800179+0000","last_undegraded":"2024-09-12T18:17:37.800179+0000","last_fullsized":"2024-09-12T18:17:37.800179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:58.599189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.135018+0000","last_change":"2024-09-12T18:17:37.140076+0000","last_active":"2024-09-12T18:17:38.135018+0000","last_peered":"2024-09-12T18:17:38.135018+0000","last_clean":"2024-09-12T18:17:38.135018+0000","last_became_active":"2024-09-12T18:17:37.139431+0000","last_became_peered":"2024-09-12T18:17:37.139431+0000","last_unstale":"2024-09-12T18:17:38.135018+0000","last_undegraded":"2024-09-12T18:17:38.135018+0000","last_fullsized":"2024-09-12T18:17:38.135018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:10.706112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779761+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:37.779761+0000","last_peered":"2024-09-12T18:17:37.779761+0000","last_clean":"2024-09-12T18:17:37.779761+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:37.779761+0000","last_undegraded":"2024-09-12T18:17:37.779761+0000","last_fullsized":"2024-09-12T18:17:37.779761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782759+0000","last_change":"2024-09-12T18:17:36.779132+0000","last_active":"2024-09-12T18:17:37.782759+0000","last_peered":"2024-09-12T18:17:37.782759+0000","last_clean":"2024-09-12T18:17:37.782759+0000","last_became_active":"2024-09-12T18:17:36.777003+0000","last_became_peered":"2024-09-12T18:17:36.777003+0000","last_unstale":"2024-09-12T18:17:37.782759+0000","last_undegraded":"2024-09-12T18:17:37.782759+0000","last_fullsized":"2024-09-12T18:17:37.782759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:28.699621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780883+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:37.780883+0000","last_peered":"2024-09-12T18:17:37.780883+0000","last_clean":"2024-09-12T18:17:37.780883+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:37.780883+0000","last_undegraded":"2024-09-12T18:17:37.780883+0000","last_fullsized":"2024-09-12T18:17:37.780883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783000+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:37.783000+0000","last_peered":"2024-09-12T18:17:37.783000+0000","last_clean":"2024-09-12T18:17:37.783000+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:37.783000+0000","last_undegraded":"2024-09-12T18:17:37.783000+0000","last_fullsized":"2024-09-12T18:17:37.783000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782717+0000","last_change":"2024-09-12T18:17:36.794869+0000","last_active":"2024-09-12T18:17:37.782717+0000","last_peered":"2024-09-12T18:17:37.782717+0000","last_clean":"2024-09-12T18:17:37.782717+0000","last_became_active":"2024-09-12T18:17:36.791138+0000","last_became_peered":"2024-09-12T18:17:36.791138+0000","last_unstale":"2024-09-12T18:17:37.782717+0000","last_undegraded":"2024-09-12T18:17:37.782717+0000","last_fullsized":"2024-09-12T18:17:37.782717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:52.732621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784957+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:37.784957+0000","last_peered":"2024-09-12T18:17:37.784957+0000","last_clean":"2024-09-12T18:17:37.784957+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:37.784957+0000","last_undegraded":"2024-09-12T18:17:37.784957+0000","last_fullsized":"2024-09-12T18:17:37.784957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777825+0000","last_change":"2024-09-12T18:17:36.800798+0000","last_active":"2024-09-12T18:17:37.777825+0000","last_peered":"2024-09-12T18:17:37.777825+0000","last_clean":"2024-09-12T18:17:37.777825+0000","last_became_active":"2024-09-12T18:17:36.799721+0000","last_became_peered":"2024-09-12T18:17:36.799721+0000","last_unstale":"2024-09-12T18:17:37.777825+0000","last_undegraded":"2024-09-12T18:17:37.777825+0000","last_fullsized":"2024-09-12T18:17:37.777825+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.366965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776875+0000","last_change":"2024-09-12T18:13:22.409739+0000","last_active":"2024-09-12T18:17:37.776875+0000","last_peered":"2024-09-12T18:17:37.776875+0000","last_clean":"2024-09-12T18:17:37.776875+0000","last_became_active":"2024-09-12T18:13:22.408684+0000","last_became_peered":"2024-09-12T18:13:22.408684+0000","last_unstale":"2024-09-12T18:17:37.776875+0000","last_undegraded":"2024-09-12T18:17:37.776875+0000","last_fullsized":"2024-09-12T18:17:37.776875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:40.494689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777446+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:37.777446+0000","last_peered":"2024-09-12T18:17:37.777446+0000","last_clean":"2024-09-12T18:17:37.777446+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:37.777446+0000","last_undegraded":"2024-09-12T18:17:37.777446+0000","last_fullsized":"2024-09-12T18:17:37.777446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.153812+0000","last_change":"2024-09-12T18:17:38.153525+0000","last_active":"2024-09-12T18:17:38.153812+0000","last_peered":"2024-09-12T18:17:38.153812+0000","last_clean":"2024-09-12T18:17:38.153812+0000","last_became_active":"2024-09-12T18:17:38.152725+0000","last_became_peered":"2024-09-12T18:17:38.152725+0000","last_unstale":"2024-09-12T18:17:38.153812+0000","last_undegraded":"2024-09-12T18:17:38.153812+0000","last_fullsized":"2024-09-12T18:17:38.153812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.613491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.778607+0000","last_change":"2024-09-12T18:13:23.417886+0000","last_active":"2024-09-12T18:17:37.778607+0000","last_peered":"2024-09-12T18:17:37.778607+0000","last_clean":"2024-09-12T18:17:37.778607+0000","last_became_active":"2024-09-12T18:13:23.416727+0000","last_became_peered":"2024-09-12T18:13:23.416727+0000","last_unstale":"2024-09-12T18:17:37.778607+0000","last_undegraded":"2024-09-12T18:17:37.778607+0000","last_fullsized":"2024-09-12T18:17:37.778607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.133651+0000","last_change":"2024-09-12T18:17:37.142439+0000","last_active":"2024-09-12T18:17:38.133651+0000","last_peered":"2024-09-12T18:17:38.133651+0000","last_clean":"2024-09-12T18:17:38.133651+0000","last_became_active":"2024-09-12T18:17:37.142116+0000","last_became_peered":"2024-09-12T18:17:37.142116+0000","last_unstale":"2024-09-12T18:17:38.133651+0000","last_undegraded":"2024-09-12T18:17:38.133651+0000","last_fullsized":"2024-09-12T18:17:38.133651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:19.867645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784687+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:37.784687+0000","last_peered":"2024-09-12T18:17:37.784687+0000","last_clean":"2024-09-12T18:17:37.784687+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:37.784687+0000","last_undegraded":"2024-09-12T18:17:37.784687+0000","last_fullsized":"2024-09-12T18:17:37.784687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134337+0000","last_change":"2024-09-12T18:17:37.142735+0000","last_active":"2024-09-12T18:17:38.134337+0000","last_peered":"2024-09-12T18:17:38.134337+0000","last_clean":"2024-09-12T18:17:38.134337+0000","last_became_active":"2024-09-12T18:17:37.142277+0000","last_became_peered":"2024-09-12T18:17:37.142277+0000","last_unstale":"2024-09-12T18:17:38.134337+0000","last_undegraded":"2024-09-12T18:17:38.134337+0000","last_fullsized":"2024-09-12T18:17:38.134337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:12.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.808795+0000","last_change":"2024-09-12T18:17:37.808026+0000","last_active":"2024-09-12T18:17:37.808795+0000","last_peered":"2024-09-12T18:17:37.808795+0000","last_clean":"2024-09-12T18:17:37.808795+0000","last_became_active":"2024-09-12T18:17:37.804165+0000","last_became_peered":"2024-09-12T18:17:37.804165+0000","last_unstale":"2024-09-12T18:17:37.808795+0000","last_undegraded":"2024-09-12T18:17:37.808795+0000","last_fullsized":"2024-09-12T18:17:37.808795+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:25.227283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780352+0000","last_change":"2024-09-12T18:17:36.806545+0000","last_active":"2024-09-12T18:17:37.780352+0000","last_peered":"2024-09-12T18:17:37.780352+0000","last_clean":"2024-09-12T18:17:37.780352+0000","last_became_active":"2024-09-12T18:17:36.804199+0000","last_became_peered":"2024-09-12T18:17:36.804199+0000","last_unstale":"2024-09-12T18:17:37.780352+0000","last_undegraded":"2024-09-12T18:17:37.780352+0000","last_fullsized":"2024-09-12T18:17:37.780352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:52.646911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.797092+0000","last_change":"2024-09-12T18:17:37.796813+0000","last_active":"2024-09-12T18:17:37.797092+0000","last_peered":"2024-09-12T18:17:37.797092+0000","last_clean":"2024-09-12T18:17:37.797092+0000","last_became_active":"2024-09-12T18:17:37.795905+0000","last_became_peered":"2024-09-12T18:17:37.795905+0000","last_unstale":"2024-09-12T18:17:37.797092+0000","last_undegraded":"2024-09-12T18:17:37.797092+0000","last_fullsized":"2024-09-12T18:17:37.797092+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:22.397702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.797553+0000","last_change":"2024-09-12T18:17:37.797298+0000","last_active":"2024-09-12T18:17:37.797553+0000","last_peered":"2024-09-12T18:17:37.797553+0000","last_clean":"2024-09-12T18:17:37.797553+0000","last_became_active":"2024-09-12T18:17:37.796460+0000","last_became_peered":"2024-09-12T18:17:37.796460+0000","last_unstale":"2024-09-12T18:17:37.797553+0000","last_undegraded":"2024-09-12T18:17:37.797553+0000","last_fullsized":"2024-09-12T18:17:37.797553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:58.122658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777701+0000","last_change":"2024-09-12T18:14:43.096073+0000","last_active":"2024-09-12T18:17:37.777701+0000","last_peered":"2024-09-12T18:17:37.777701+0000","last_clean":"2024-09-12T18:17:37.777701+0000","last_became_active":"2024-09-12T18:14:43.092815+0000","last_became_peered":"2024-09-12T18:14:43.092815+0000","last_unstale":"2024-09-12T18:17:37.777701+0000","last_undegraded":"2024-09-12T18:17:37.777701+0000","last_fullsized":"2024-09-12T18:17:37.777701+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:24.757546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.807159+0000","last_change":"2024-09-12T18:17:37.806931+0000","last_active":"2024-09-12T18:17:37.807159+0000","last_peered":"2024-09-12T18:17:37.807159+0000","last_clean":"2024-09-12T18:17:37.807159+0000","last_became_active":"2024-09-12T18:17:37.800840+0000","last_became_peered":"2024-09-12T18:17:37.800840+0000","last_unstale":"2024-09-12T18:17:37.807159+0000","last_undegraded":"2024-09-12T18:17:37.807159+0000","last_fullsized":"2024-09-12T18:17:37.807159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:38.017162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.828633+0000","last_change":"2024-09-12T18:17:37.828478+0000","last_active":"2024-09-12T18:17:37.828633+0000","last_peered":"2024-09-12T18:17:37.828633+0000","last_clean":"2024-09-12T18:17:37.828633+0000","last_became_active":"2024-09-12T18:17:37.798893+0000","last_became_peered":"2024-09-12T18:17:37.798893+0000","last_unstale":"2024-09-12T18:17:37.828633+0000","last_undegraded":"2024-09-12T18:17:37.828633+0000","last_fullsized":"2024-09-12T18:17:37.828633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.797729+0000","last_change":"2024-09-12T18:17:37.797451+0000","last_active":"2024-09-12T18:17:37.797729+0000","last_peered":"2024-09-12T18:17:37.797729+0000","last_clean":"2024-09-12T18:17:37.797729+0000","last_became_active":"2024-09-12T18:17:37.795472+0000","last_became_peered":"2024-09-12T18:17:37.795472+0000","last_unstale":"2024-09-12T18:17:37.797729+0000","last_undegraded":"2024-09-12T18:17:37.797729+0000","last_fullsized":"2024-09-12T18:17:37.797729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:51.503168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776403+0000","last_change":"2024-09-12T18:14:43.095580+0000","last_active":"2024-09-12T18:17:37.776403+0000","last_peered":"2024-09-12T18:17:37.776403+0000","last_clean":"2024-09-12T18:17:37.776403+0000","last_became_active":"2024-09-12T18:14:43.092061+0000","last_became_peered":"2024-09-12T18:14:43.092061+0000","last_unstale":"2024-09-12T18:17:37.776403+0000","last_undegraded":"2024-09-12T18:17:37.776403+0000","last_fullsized":"2024-09-12T18:17:37.776403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:03.825242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.155123+0000","last_change":"2024-09-12T18:17:38.153281+0000","last_active":"2024-09-12T18:17:38.155123+0000","last_peered":"2024-09-12T18:17:38.155123+0000","last_clean":"2024-09-12T18:17:38.155123+0000","last_became_active":"2024-09-12T18:17:38.152437+0000","last_became_peered":"2024-09-12T18:17:38.152437+0000","last_unstale":"2024-09-12T18:17:38.155123+0000","last_undegraded":"2024-09-12T18:17:38.155123+0000","last_fullsized":"2024-09-12T18:17:38.155123+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:00.510477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782828+0000","last_change":"2024-09-12T18:17:36.782758+0000","last_active":"2024-09-12T18:17:37.782828+0000","last_peered":"2024-09-12T18:17:37.782828+0000","last_clean":"2024-09-12T18:17:37.782828+0000","last_became_active":"2024-09-12T18:17:36.780017+0000","last_became_peered":"2024-09-12T18:17:36.780017+0000","last_unstale":"2024-09-12T18:17:37.782828+0000","last_undegraded":"2024-09-12T18:17:37.782828+0000","last_fullsized":"2024-09-12T18:17:37.782828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:11.394054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.155439+0000","last_change":"2024-09-12T18:17:38.154306+0000","last_active":"2024-09-12T18:17:38.155439+0000","last_peered":"2024-09-12T18:17:38.155439+0000","last_clean":"2024-09-12T18:17:38.155439+0000","last_became_active":"2024-09-12T18:17:38.153668+0000","last_became_peered":"2024-09-12T18:17:38.153668+0000","last_unstale":"2024-09-12T18:17:38.155439+0000","last_undegraded":"2024-09-12T18:17:38.155439+0000","last_fullsized":"2024-09-12T18:17:38.155439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:49.832192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775965+0000","last_change":"2024-09-12T18:17:36.793762+0000","last_active":"2024-09-12T18:17:37.775965+0000","last_peered":"2024-09-12T18:17:37.775965+0000","last_clean":"2024-09-12T18:17:37.775965+0000","last_became_active":"2024-09-12T18:17:36.790151+0000","last_became_peered":"2024-09-12T18:17:36.790151+0000","last_unstale":"2024-09-12T18:17:37.775965+0000","last_undegraded":"2024-09-12T18:17:37.775965+0000","last_fullsized":"2024-09-12T18:17:37.775965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:29.545701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780491+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:37.780491+0000","last_peered":"2024-09-12T18:17:37.780491+0000","last_clean":"2024-09-12T18:17:37.780491+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:37.780491+0000","last_undegraded":"2024-09-12T18:17:37.780491+0000","last_fullsized":"2024-09-12T18:17:37.780491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":310,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.801190+0000","last_change":"2024-09-12T18:17:37.800920+0000","last_active":"2024-09-12T18:17:37.801190+0000","last_peered":"2024-09-12T18:17:37.801190+0000","last_clean":"2024-09-12T18:17:37.801190+0000","last_became_active":"2024-09-12T18:17:37.797285+0000","last_became_peered":"2024-09-12T18:17:37.797285+0000","last_unstale":"2024-09-12T18:17:37.801190+0000","last_undegraded":"2024-09-12T18:17:37.801190+0000","last_fullsized":"2024-09-12T18:17:37.801190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:35.553721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785287+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:37.785287+0000","last_peered":"2024-09-12T18:17:37.785287+0000","last_clean":"2024-09-12T18:17:37.785287+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:37.785287+0000","last_undegraded":"2024-09-12T18:17:37.785287+0000","last_fullsized":"2024-09-12T18:17:37.785287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777540+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:37.777540+0000","last_peered":"2024-09-12T18:17:37.777540+0000","last_clean":"2024-09-12T18:17:37.777540+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:37.777540+0000","last_undegraded":"2024-09-12T18:17:37.777540+0000","last_fullsized":"2024-09-12T18:17:37.777540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785535+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:37.785535+0000","last_peered":"2024-09-12T18:17:37.785535+0000","last_clean":"2024-09-12T18:17:37.785535+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:37.785535+0000","last_undegraded":"2024-09-12T18:17:37.785535+0000","last_fullsized":"2024-09-12T18:17:37.785535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783259+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:37.783259+0000","last_peered":"2024-09-12T18:17:37.783259+0000","last_clean":"2024-09-12T18:17:37.783259+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:37.783259+0000","last_undegraded":"2024-09-12T18:17:37.783259+0000","last_fullsized":"2024-09-12T18:17:37.783259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800675+0000","last_change":"2024-09-12T18:17:37.800428+0000","last_active":"2024-09-12T18:17:37.800675+0000","last_peered":"2024-09-12T18:17:37.800675+0000","last_clean":"2024-09-12T18:17:37.800675+0000","last_became_active":"2024-09-12T18:17:37.796795+0000","last_became_peered":"2024-09-12T18:17:37.796795+0000","last_unstale":"2024-09-12T18:17:37.800675+0000","last_undegraded":"2024-09-12T18:17:37.800675+0000","last_fullsized":"2024-09-12T18:17:37.800675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:51.589715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.135880+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:38.135880+0000","last_peered":"2024-09-12T18:17:38.135880+0000","last_clean":"2024-09-12T18:17:38.135880+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:38.135880+0000","last_undegraded":"2024-09-12T18:17:38.135880+0000","last_fullsized":"2024-09-12T18:17:38.135880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783407+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:37.783407+0000","last_peered":"2024-09-12T18:17:37.783407+0000","last_clean":"2024-09-12T18:17:37.783407+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:37.783407+0000","last_undegraded":"2024-09-12T18:17:37.783407+0000","last_fullsized":"2024-09-12T18:17:37.783407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.787613+0000","last_change":"2024-09-12T18:17:37.787360+0000","last_active":"2024-09-12T18:17:37.787613+0000","last_peered":"2024-09-12T18:17:37.787613+0000","last_clean":"2024-09-12T18:17:37.787613+0000","last_became_active":"2024-09-12T18:17:37.786527+0000","last_became_peered":"2024-09-12T18:17:37.786527+0000","last_unstale":"2024-09-12T18:17:37.787613+0000","last_undegraded":"2024-09-12T18:17:37.787613+0000","last_fullsized":"2024-09-12T18:17:37.787613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:44.024618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779716+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:37.779716+0000","last_peered":"2024-09-12T18:17:37.779716+0000","last_clean":"2024-09-12T18:17:37.779716+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:37.779716+0000","last_undegraded":"2024-09-12T18:17:37.779716+0000","last_fullsized":"2024-09-12T18:17:37.779716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785379+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:37.785379+0000","last_peered":"2024-09-12T18:17:37.785379+0000","last_clean":"2024-09-12T18:17:37.785379+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:37.785379+0000","last_undegraded":"2024-09-12T18:17:37.785379+0000","last_fullsized":"2024-09-12T18:17:37.785379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785246+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:37.785246+0000","last_peered":"2024-09-12T18:17:37.785246+0000","last_clean":"2024-09-12T18:17:37.785246+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:37.785246+0000","last_undegraded":"2024-09-12T18:17:37.785246+0000","last_fullsized":"2024-09-12T18:17:37.785246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783027+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:37.783027+0000","last_peered":"2024-09-12T18:17:37.783027+0000","last_clean":"2024-09-12T18:17:37.783027+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:37.783027+0000","last_undegraded":"2024-09-12T18:17:37.783027+0000","last_fullsized":"2024-09-12T18:17:37.783027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.779138+0000","last_change":"2024-09-12T18:14:43.094420+0000","last_active":"2024-09-12T18:17:37.779138+0000","last_peered":"2024-09-12T18:17:37.779138+0000","last_clean":"2024-09-12T18:17:37.779138+0000","last_became_active":"2024-09-12T18:14:43.092106+0000","last_became_peered":"2024-09-12T18:14:43.092106+0000","last_unstale":"2024-09-12T18:17:37.779138+0000","last_undegraded":"2024-09-12T18:17:37.779138+0000","last_fullsized":"2024-09-12T18:17:37.779138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.122610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783502+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:37.783502+0000","last_peered":"2024-09-12T18:17:37.783502+0000","last_clean":"2024-09-12T18:17:37.783502+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:37.783502+0000","last_undegraded":"2024-09-12T18:17:37.783502+0000","last_fullsized":"2024-09-12T18:17:37.783502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.796656+0000","last_change":"2024-09-12T18:17:37.796391+0000","last_active":"2024-09-12T18:17:37.796656+0000","last_peered":"2024-09-12T18:17:37.796656+0000","last_clean":"2024-09-12T18:17:37.796656+0000","last_became_active":"2024-09-12T18:17:37.795351+0000","last_became_peered":"2024-09-12T18:17:37.795351+0000","last_unstale":"2024-09-12T18:17:37.796656+0000","last_undegraded":"2024-09-12T18:17:37.796656+0000","last_fullsized":"2024-09-12T18:17:37.796656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:28.203873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783322+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:37.783322+0000","last_peered":"2024-09-12T18:17:37.783322+0000","last_clean":"2024-09-12T18:17:37.783322+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:37.783322+0000","last_undegraded":"2024-09-12T18:17:37.783322+0000","last_fullsized":"2024-09-12T18:17:37.783322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.136929+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:38.136929+0000","last_peered":"2024-09-12T18:17:38.136929+0000","last_clean":"2024-09-12T18:17:38.136929+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:38.136929+0000","last_undegraded":"2024-09-12T18:17:38.136929+0000","last_fullsized":"2024-09-12T18:17:38.136929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.803799+0000","last_change":"2024-09-12T18:17:37.803588+0000","last_active":"2024-09-12T18:17:37.803799+0000","last_peered":"2024-09-12T18:17:37.803799+0000","last_clean":"2024-09-12T18:17:37.803799+0000","last_became_active":"2024-09-12T18:17:37.795092+0000","last_became_peered":"2024-09-12T18:17:37.795092+0000","last_unstale":"2024-09-12T18:17:37.803799+0000","last_undegraded":"2024-09-12T18:17:37.803799+0000","last_fullsized":"2024-09-12T18:17:37.803799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:23.076015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.782338+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:37.782338+0000","last_peered":"2024-09-12T18:17:37.782338+0000","last_clean":"2024-09-12T18:17:37.782338+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:37.782338+0000","last_undegraded":"2024-09-12T18:17:37.782338+0000","last_fullsized":"2024-09-12T18:17:37.782338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.777300+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:37.777300+0000","last_peered":"2024-09-12T18:17:37.777300+0000","last_clean":"2024-09-12T18:17:37.777300+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:37.777300+0000","last_undegraded":"2024-09-12T18:17:37.777300+0000","last_fullsized":"2024-09-12T18:17:37.777300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.800515+0000","last_change":"2024-09-12T18:17:37.798798+0000","last_active":"2024-09-12T18:17:37.800515+0000","last_peered":"2024-09-12T18:17:37.800515+0000","last_clean":"2024-09-12T18:17:37.800515+0000","last_became_active":"2024-09-12T18:17:37.796134+0000","last_became_peered":"2024-09-12T18:17:37.796134+0000","last_unstale":"2024-09-12T18:17:37.800515+0000","last_undegraded":"2024-09-12T18:17:37.800515+0000","last_fullsized":"2024-09-12T18:17:37.800515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:22.208836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.832986+0000","last_change":"2024-09-12T18:17:37.832803+0000","last_active":"2024-09-12T18:17:37.832986+0000","last_peered":"2024-09-12T18:17:37.832986+0000","last_clean":"2024-09-12T18:17:37.832986+0000","last_became_active":"2024-09-12T18:17:37.807346+0000","last_became_peered":"2024-09-12T18:17:37.807346+0000","last_unstale":"2024-09-12T18:17:37.832986+0000","last_undegraded":"2024-09-12T18:17:37.832986+0000","last_fullsized":"2024-09-12T18:17:37.832986+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:34.919928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784873+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:37.784873+0000","last_peered":"2024-09-12T18:17:37.784873+0000","last_clean":"2024-09-12T18:17:37.784873+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:37.784873+0000","last_undegraded":"2024-09-12T18:17:37.784873+0000","last_fullsized":"2024-09-12T18:17:37.784873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.806187+0000","last_change":"2024-09-12T18:17:37.804867+0000","last_active":"2024-09-12T18:17:37.806187+0000","last_peered":"2024-09-12T18:17:37.806187+0000","last_clean":"2024-09-12T18:17:37.806187+0000","last_became_active":"2024-09-12T18:17:37.803507+0000","last_became_peered":"2024-09-12T18:17:37.803507+0000","last_unstale":"2024-09-12T18:17:37.806187+0000","last_undegraded":"2024-09-12T18:17:37.806187+0000","last_fullsized":"2024-09-12T18:17:37.806187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:33.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.798812+0000","last_change":"2024-09-12T18:17:37.798542+0000","last_active":"2024-09-12T18:17:37.798812+0000","last_peered":"2024-09-12T18:17:37.798812+0000","last_clean":"2024-09-12T18:17:37.798812+0000","last_became_active":"2024-09-12T18:17:37.795151+0000","last_became_peered":"2024-09-12T18:17:37.795151+0000","last_unstale":"2024-09-12T18:17:37.798812+0000","last_undegraded":"2024-09-12T18:17:37.798812+0000","last_fullsized":"2024-09-12T18:17:37.798812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:55.067325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134529+0000","last_change":"2024-09-12T18:17:37.149255+0000","last_active":"2024-09-12T18:17:38.134529+0000","last_peered":"2024-09-12T18:17:38.134529+0000","last_clean":"2024-09-12T18:17:38.134529+0000","last_became_active":"2024-09-12T18:17:37.147887+0000","last_became_peered":"2024-09-12T18:17:37.147887+0000","last_unstale":"2024-09-12T18:17:38.134529+0000","last_undegraded":"2024-09-12T18:17:38.134529+0000","last_fullsized":"2024-09-12T18:17:38.134529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:38.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776559+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:37.776559+0000","last_peered":"2024-09-12T18:17:37.776559+0000","last_clean":"2024-09-12T18:17:37.776559+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:37.776559+0000","last_undegraded":"2024-09-12T18:17:37.776559+0000","last_fullsized":"2024-09-12T18:17:37.776559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.785215+0000","last_change":"2024-09-12T18:17:36.785578+0000","last_active":"2024-09-12T18:17:37.785215+0000","last_peered":"2024-09-12T18:17:37.785215+0000","last_clean":"2024-09-12T18:17:37.785215+0000","last_became_active":"2024-09-12T18:17:36.782643+0000","last_became_peered":"2024-09-12T18:17:36.782643+0000","last_unstale":"2024-09-12T18:17:37.785215+0000","last_undegraded":"2024-09-12T18:17:37.785215+0000","last_fullsized":"2024-09-12T18:17:37.785215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.694821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.808186+0000","last_change":"2024-09-12T18:17:37.808023+0000","last_active":"2024-09-12T18:17:37.808186+0000","last_peered":"2024-09-12T18:17:37.808186+0000","last_clean":"2024-09-12T18:17:37.808186+0000","last_became_active":"2024-09-12T18:17:37.807159+0000","last_became_peered":"2024-09-12T18:17:37.807159+0000","last_unstale":"2024-09-12T18:17:37.808186+0000","last_undegraded":"2024-09-12T18:17:37.808186+0000","last_fullsized":"2024-09-12T18:17:37.808186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:10.003292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780633+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:37.780633+0000","last_peered":"2024-09-12T18:17:37.780633+0000","last_clean":"2024-09-12T18:17:37.780633+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:37.780633+0000","last_undegraded":"2024-09-12T18:17:37.780633+0000","last_fullsized":"2024-09-12T18:17:37.780633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780753+0000","last_change":"2024-09-12T18:15:13.303308+0000","last_active":"2024-09-12T18:17:37.780753+0000","last_peered":"2024-09-12T18:17:37.780753+0000","last_clean":"2024-09-12T18:17:37.780753+0000","last_became_active":"2024-09-12T18:15:13.303093+0000","last_became_peered":"2024-09-12T18:15:13.303093+0000","last_unstale":"2024-09-12T18:17:37.780753+0000","last_undegraded":"2024-09-12T18:17:37.780753+0000","last_fullsized":"2024-09-12T18:17:37.780753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776915+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:37.776915+0000","last_peered":"2024-09-12T18:17:37.776915+0000","last_clean":"2024-09-12T18:17:37.776915+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:37.776915+0000","last_undegraded":"2024-09-12T18:17:37.776915+0000","last_fullsized":"2024-09-12T18:17:37.776915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.784327+0000","last_change":"2024-09-12T18:17:36.781903+0000","last_active":"2024-09-12T18:17:37.784327+0000","last_peered":"2024-09-12T18:17:37.784327+0000","last_clean":"2024-09-12T18:17:37.784327+0000","last_became_active":"2024-09-12T18:17:36.780395+0000","last_became_peered":"2024-09-12T18:17:36.780395+0000","last_unstale":"2024-09-12T18:17:37.784327+0000","last_undegraded":"2024-09-12T18:17:37.784327+0000","last_fullsized":"2024-09-12T18:17:37.784327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:47.917209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.780226+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:37.780226+0000","last_peered":"2024-09-12T18:17:37.780226+0000","last_clean":"2024-09-12T18:17:37.780226+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:37.780226+0000","last_undegraded":"2024-09-12T18:17:37.780226+0000","last_fullsized":"2024-09-12T18:17:37.780226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.806094+0000","last_change":"2024-09-12T18:17:37.804788+0000","last_active":"2024-09-12T18:17:37.806094+0000","last_peered":"2024-09-12T18:17:37.806094+0000","last_clean":"2024-09-12T18:17:37.806094+0000","last_became_active":"2024-09-12T18:17:37.800337+0000","last_became_peered":"2024-09-12T18:17:37.800337+0000","last_unstale":"2024-09-12T18:17:37.806094+0000","last_undegraded":"2024-09-12T18:17:37.806094+0000","last_fullsized":"2024-09-12T18:17:37.806094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.414203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.801733+0000","last_change":"2024-09-12T18:17:37.801491+0000","last_active":"2024-09-12T18:17:37.801733+0000","last_peered":"2024-09-12T18:17:37.801733+0000","last_clean":"2024-09-12T18:17:37.801733+0000","last_became_active":"2024-09-12T18:17:37.797845+0000","last_became_peered":"2024-09-12T18:17:37.797845+0000","last_unstale":"2024-09-12T18:17:37.801733+0000","last_undegraded":"2024-09-12T18:17:37.801733+0000","last_fullsized":"2024-09-12T18:17:37.801733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:38.692223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.153672+0000","last_change":"2024-09-12T18:17:38.153303+0000","last_active":"2024-09-12T18:17:38.153672+0000","last_peered":"2024-09-12T18:17:38.153672+0000","last_clean":"2024-09-12T18:17:38.153672+0000","last_became_active":"2024-09-12T18:17:38.152386+0000","last_became_peered":"2024-09-12T18:17:38.152386+0000","last_unstale":"2024-09-12T18:17:38.153672+0000","last_undegraded":"2024-09-12T18:17:38.153672+0000","last_fullsized":"2024-09-12T18:17:38.153672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:31.984057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776106+0000","last_change":"2024-09-12T18:17:36.793395+0000","last_active":"2024-09-12T18:17:37.776106+0000","last_peered":"2024-09-12T18:17:37.776106+0000","last_clean":"2024-09-12T18:17:37.776106+0000","last_became_active":"2024-09-12T18:17:36.787318+0000","last_became_peered":"2024-09-12T18:17:36.787318+0000","last_unstale":"2024-09-12T18:17:37.776106+0000","last_undegraded":"2024-09-12T18:17:37.776106+0000","last_fullsized":"2024-09-12T18:17:37.776106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:07.751267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.776058+0000","last_change":"2024-09-12T18:17:36.797003+0000","last_active":"2024-09-12T18:17:37.776058+0000","last_peered":"2024-09-12T18:17:37.776058+0000","last_clean":"2024-09-12T18:17:37.776058+0000","last_became_active":"2024-09-12T18:17:36.791964+0000","last_became_peered":"2024-09-12T18:17:36.791964+0000","last_unstale":"2024-09-12T18:17:37.776058+0000","last_undegraded":"2024-09-12T18:17:37.776058+0000","last_fullsized":"2024-09-12T18:17:37.776058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:46.151762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.807908+0000","last_change":"2024-09-12T18:17:37.807727+0000","last_active":"2024-09-12T18:17:37.807908+0000","last_peered":"2024-09-12T18:17:37.807908+0000","last_clean":"2024-09-12T18:17:37.807908+0000","last_became_active":"2024-09-12T18:17:37.802850+0000","last_became_peered":"2024-09-12T18:17:37.802850+0000","last_unstale":"2024-09-12T18:17:37.807908+0000","last_undegraded":"2024-09-12T18:17:37.807908+0000","last_fullsized":"2024-09-12T18:17:37.807908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:47.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.807567+0000","last_change":"2024-09-12T18:17:37.807244+0000","last_active":"2024-09-12T18:17:37.807567+0000","last_peered":"2024-09-12T18:17:37.807567+0000","last_clean":"2024-09-12T18:17:37.807567+0000","last_became_active":"2024-09-12T18:17:37.801474+0000","last_became_peered":"2024-09-12T18:17:37.801474+0000","last_unstale":"2024-09-12T18:17:37.807567+0000","last_undegraded":"2024-09-12T18:17:37.807567+0000","last_fullsized":"2024-09-12T18:17:37.807567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:51.866240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":108,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.814959+0000","last_change":"2024-09-12T18:17:37.814819+0000","last_active":"2024-09-12T18:17:37.814959+0000","last_peered":"2024-09-12T18:17:37.814959+0000","last_clean":"2024-09-12T18:17:37.814959+0000","last_became_active":"2024-09-12T18:17:37.796873+0000","last_became_peered":"2024-09-12T18:17:37.796873+0000","last_unstale":"2024-09-12T18:17:37.814959+0000","last_undegraded":"2024-09-12T18:17:37.814959+0000","last_fullsized":"2024-09-12T18:17:37.814959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:56.597550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.798334+0000","last_change":"2024-09-12T18:17:37.798085+0000","last_active":"2024-09-12T18:17:37.798334+0000","last_peered":"2024-09-12T18:17:37.798334+0000","last_clean":"2024-09-12T18:17:37.798334+0000","last_became_active":"2024-09-12T18:17:37.795487+0000","last_became_peered":"2024-09-12T18:17:37.795487+0000","last_unstale":"2024-09-12T18:17:37.798334+0000","last_undegraded":"2024-09-12T18:17:37.798334+0000","last_fullsized":"2024-09-12T18:17:37.798334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:31.548973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:38.134636+0000","last_change":"2024-09-12T18:17:37.149265+0000","last_active":"2024-09-12T18:17:38.134636+0000","last_peered":"2024-09-12T18:17:38.134636+0000","last_clean":"2024-09-12T18:17:38.134636+0000","last_became_active":"2024-09-12T18:17:37.148345+0000","last_became_peered":"2024-09-12T18:17:37.148345+0000","last_unstale":"2024-09-12T18:17:38.134636+0000","last_undegraded":"2024-09-12T18:17:38.134636+0000","last_fullsized":"2024-09-12T18:17:38.134636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:53.813446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.775424+0000","last_change":"2024-09-12T18:17:36.805845+0000","last_active":"2024-09-12T18:17:37.775424+0000","last_peered":"2024-09-12T18:17:37.775424+0000","last_clean":"2024-09-12T18:17:37.775424+0000","last_became_active":"2024-09-12T18:17:36.803137+0000","last_became_peered":"2024-09-12T18:17:36.803137+0000","last_unstale":"2024-09-12T18:17:37.775424+0000","last_undegraded":"2024-09-12T18:17:37.775424+0000","last_fullsized":"2024-09-12T18:17:37.775424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:38.380784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.786404+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:37.786404+0000","last_peered":"2024-09-12T18:17:37.786404+0000","last_clean":"2024-09-12T18:17:37.786404+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:37.786404+0000","last_undegraded":"2024-09-12T18:17:37.786404+0000","last_fullsized":"2024-09-12T18:17:37.786404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.783016+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:37.783016+0000","last_peered":"2024-09-12T18:17:37.783016+0000","last_clean":"2024-09-12T18:17:37.783016+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:37.783016+0000","last_undegraded":"2024-09-12T18:17:37.783016+0000","last_fullsized":"2024-09-12T18:17:37.783016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:17:37.821756+0000","last_change":"2024-09-12T18:17:37.821614+0000","last_active":"2024-09-12T18:17:37.821756+0000","last_peered":"2024-09-12T18:17:37.821756+0000","last_clean":"2024-09-12T18:17:37.821756+0000","last_became_active":"2024-09-12T18:17:37.803143+0000","last_became_peered":"2024-09-12T18:17:37.803143+0000","last_unstale":"2024-09-12T18:17:37.821756+0000","last_undegraded":"2024-09-12T18:17:37.821756+0000","last_fullsized":"2024-09-12T18:17:37.821756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:15.318739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":652,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":21223,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280680,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091160,"statfs":{"total":96636764160,"available":96349347840,"internally_reserved":0,"allocated":995328,"data_stored":403399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738425,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397308,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974532,"statfs":{"total":96636764160,"available":96229920768,"internally_reserved":0,"allocated":1024000,"data_stored":992695,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285570,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46172,"kb_used_data":1028,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325668,"statfs":{"total":96636764160,"available":96589484032,"internally_reserved":0,"allocated":1052672,"data_stored":994366,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:17:43.575 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:17:43.575 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:17:43.575 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T18:17:43.575 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.488793 2024-09-12T18:17:43.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.48879331109615 2024-09-12T18:17:44.843 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.1 primary-affinity to 0.488793 (8320332) 2024-09-12T18:17:49.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T18:17:50.021 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a: {} 2024-09-12T18:17:50.021 INFO:teuthology.orchestra.run.smithi062.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:17:50.030 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b: {} 2024-09-12T18:17:50.030 INFO:teuthology.orchestra.run.smithi062.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:17:50.039 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c: {} 2024-09-12T18:17:50.040 INFO:teuthology.orchestra.run.smithi062.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:17:50.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:17:50.785 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:17:50.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T18:17:51.795 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T18:17:51.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:17:52.804 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:17:52.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T18:17:53.806 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T18:17:53.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:17:54.829 INFO:teuthology.orchestra.run.smithi062.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:17:54.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T18:17:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T18:17:55.858 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T18:17:55.859 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T18:17:55.859 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T18:17:55.859 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T18:17:55.859 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:17:55.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:17:56.177 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:17:56.178 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":98,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:17:55.826317+0000","last_up_change":"2024-09-12T18:17:35.753661+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":42,"up_from":83,"up_thru":90,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6801","nonce":2528869308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6803","nonce":2528869308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6807","nonce":2528869308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6805","nonce":2528869308}]},"public_addr":"172.21.15.129:6801/2528869308","cluster_addr":"172.21.15.129:6803/2528869308","heartbeat_back_addr":"172.21.15.129:6807/2528869308","heartbeat_front_addr":"172.21.15.129:6805/2528869308","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:17:56.198 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:17:56.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:17:56.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:17:56.504 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":98,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:17:55.826317+0000","last_up_change":"2024-09-12T18:17:35.753661+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":42,"up_from":83,"up_thru":90,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6801","nonce":2528869308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6803","nonce":2528869308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6807","nonce":2528869308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6805","nonce":2528869308}]},"public_addr":"172.21.15.129:6801/2528869308","cluster_addr":"172.21.15.129:6803/2528869308","heartbeat_back_addr":"172.21.15.129:6807/2528869308","heartbeat_front_addr":"172.21.15.129:6805/2528869308","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:17:56.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:17:56.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:17:56.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:17:56.681 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-09-12T18:17:56.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:17:56.685 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-09-12T18:17:56.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:17:56.689 INFO:teuthology.orchestra.run.smithi062.stdout:356482285574 2024-09-12T18:17:56.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:17:56.987 INFO:teuthology.orchestra.run.smithi062.stdout:34359738428 2024-09-12T18:17:57.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-09-12T18:17:57.025 INFO:teuthology.orchestra.run.smithi062.stdout:34359738428 2024-09-12T18:17:57.030 INFO:teuthology.orchestra.run.smithi062.stdout:356482285573 2024-09-12T18:17:57.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.1 2024-09-12T18:17:57.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285574 got 356482285573 for osd.0 2024-09-12T18:17:58.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:17:58.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:17:58.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:17:58.325 INFO:teuthology.orchestra.run.smithi062.stdout:34359738428 2024-09-12T18:17:58.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-09-12T18:17:58.352 INFO:teuthology.orchestra.run.smithi062.stdout:34359738428 2024-09-12T18:17:58.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.1 2024-09-12T18:17:58.390 INFO:teuthology.orchestra.run.smithi062.stdout:356482285573 2024-09-12T18:17:58.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285574 got 356482285573 for osd.0 2024-09-12T18:17:59.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:17:59.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:17:59.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:17:59.675 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-09-12T18:17:59.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.2 2024-09-12T18:17:59.693 DEBUG:teuthology.parallel:result is None 2024-09-12T18:17:59.712 INFO:teuthology.orchestra.run.smithi062.stdout:34359738429 2024-09-12T18:17:59.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.1 2024-09-12T18:17:59.729 DEBUG:teuthology.parallel:result is None 2024-09-12T18:17:59.731 INFO:teuthology.orchestra.run.smithi062.stdout:356482285574 2024-09-12T18:17:59.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285574 got 356482285574 for osd.0 2024-09-12T18:17:59.748 DEBUG:teuthology.parallel:result is None 2024-09-12T18:17:59.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:17:59.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:00.098 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:00.101 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:00.116 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-12T18:17:58.469448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724472,"kb_used_data":3304,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391048,"statfs":{"total":289910292480,"available":289168433152,"internally_reserved":0,"allocated":3383296,"data_stored":2554012,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.659265"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.193465+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:56.193465+0000","last_peered":"2024-09-12T18:17:56.193465+0000","last_clean":"2024-09-12T18:17:56.193465+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:56.193465+0000","last_undegraded":"2024-09-12T18:17:56.193465+0000","last_fullsized":"2024-09-12T18:17:56.193465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831649+0000","last_change":"2024-09-12T18:17:36.809622+0000","last_active":"2024-09-12T18:17:54.831649+0000","last_peered":"2024-09-12T18:17:54.831649+0000","last_clean":"2024-09-12T18:17:54.831649+0000","last_became_active":"2024-09-12T18:17:36.809003+0000","last_became_peered":"2024-09-12T18:17:36.809003+0000","last_unstale":"2024-09-12T18:17:54.831649+0000","last_undegraded":"2024-09-12T18:17:54.831649+0000","last_fullsized":"2024-09-12T18:17:54.831649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:06.382179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839554+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:55.839554+0000","last_peered":"2024-09-12T18:17:55.839554+0000","last_clean":"2024-09-12T18:17:55.839554+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:55.839554+0000","last_undegraded":"2024-09-12T18:17:55.839554+0000","last_fullsized":"2024-09-12T18:17:55.839554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841425+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:55.841425+0000","last_peered":"2024-09-12T18:17:55.841425+0000","last_clean":"2024-09-12T18:17:55.841425+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:55.841425+0000","last_undegraded":"2024-09-12T18:17:55.841425+0000","last_fullsized":"2024-09-12T18:17:55.841425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831863+0000","last_change":"2024-09-12T18:17:52.822116+0000","last_active":"2024-09-12T18:17:54.831863+0000","last_peered":"2024-09-12T18:17:54.831863+0000","last_clean":"2024-09-12T18:17:54.831863+0000","last_became_active":"2024-09-12T18:17:52.820092+0000","last_became_peered":"2024-09-12T18:17:52.820092+0000","last_unstale":"2024-09-12T18:17:54.831863+0000","last_undegraded":"2024-09-12T18:17:54.831863+0000","last_fullsized":"2024-09-12T18:17:54.831863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:46.011867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844144+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:55.844144+0000","last_peered":"2024-09-12T18:17:55.844144+0000","last_clean":"2024-09-12T18:17:55.844144+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:55.844144+0000","last_undegraded":"2024-09-12T18:17:55.844144+0000","last_fullsized":"2024-09-12T18:17:55.844144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837979+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:55.837979+0000","last_peered":"2024-09-12T18:17:55.837979+0000","last_clean":"2024-09-12T18:17:55.837979+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:55.837979+0000","last_undegraded":"2024-09-12T18:17:55.837979+0000","last_fullsized":"2024-09-12T18:17:55.837979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841664+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:55.841664+0000","last_peered":"2024-09-12T18:17:55.841664+0000","last_clean":"2024-09-12T18:17:55.841664+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:55.841664+0000","last_undegraded":"2024-09-12T18:17:55.841664+0000","last_fullsized":"2024-09-12T18:17:55.841664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832653+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:55.832653+0000","last_peered":"2024-09-12T18:17:55.832653+0000","last_clean":"2024-09-12T18:17:55.832653+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:55.832653+0000","last_undegraded":"2024-09-12T18:17:55.832653+0000","last_fullsized":"2024-09-12T18:17:55.832653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831390+0000","last_change":"2024-09-12T18:17:36.806954+0000","last_active":"2024-09-12T18:17:54.831390+0000","last_peered":"2024-09-12T18:17:54.831390+0000","last_clean":"2024-09-12T18:17:54.831390+0000","last_became_active":"2024-09-12T18:17:36.804438+0000","last_became_peered":"2024-09-12T18:17:36.804438+0000","last_unstale":"2024-09-12T18:17:54.831390+0000","last_undegraded":"2024-09-12T18:17:54.831390+0000","last_fullsized":"2024-09-12T18:17:54.831390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.122325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839824+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:55.839824+0000","last_peered":"2024-09-12T18:17:55.839824+0000","last_clean":"2024-09-12T18:17:55.839824+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:55.839824+0000","last_undegraded":"2024-09-12T18:17:55.839824+0000","last_fullsized":"2024-09-12T18:17:55.839824+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.843464+0000","last_change":"2024-09-12T18:17:36.776701+0000","last_active":"2024-09-12T18:17:54.843464+0000","last_peered":"2024-09-12T18:17:54.843464+0000","last_clean":"2024-09-12T18:17:54.843464+0000","last_became_active":"2024-09-12T18:17:36.775273+0000","last_became_peered":"2024-09-12T18:17:36.775273+0000","last_unstale":"2024-09-12T18:17:54.843464+0000","last_undegraded":"2024-09-12T18:17:54.843464+0000","last_fullsized":"2024-09-12T18:17:54.843464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:10.775150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831802+0000","last_change":"2024-09-12T18:17:52.822675+0000","last_active":"2024-09-12T18:17:54.831802+0000","last_peered":"2024-09-12T18:17:54.831802+0000","last_clean":"2024-09-12T18:17:54.831802+0000","last_became_active":"2024-09-12T18:17:52.819135+0000","last_became_peered":"2024-09-12T18:17:52.819135+0000","last_unstale":"2024-09-12T18:17:54.831802+0000","last_undegraded":"2024-09-12T18:17:54.831802+0000","last_fullsized":"2024-09-12T18:17:54.831802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:08.684352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844403+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:55.844403+0000","last_peered":"2024-09-12T18:17:55.844403+0000","last_clean":"2024-09-12T18:17:55.844403+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:55.844403+0000","last_undegraded":"2024-09-12T18:17:55.844403+0000","last_fullsized":"2024-09-12T18:17:55.844403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837492+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:55.837492+0000","last_peered":"2024-09-12T18:17:55.837492+0000","last_clean":"2024-09-12T18:17:55.837492+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:55.837492+0000","last_undegraded":"2024-09-12T18:17:55.837492+0000","last_fullsized":"2024-09-12T18:17:55.837492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842341+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:55.842341+0000","last_peered":"2024-09-12T18:17:55.842341+0000","last_clean":"2024-09-12T18:17:55.842341+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:55.842341+0000","last_undegraded":"2024-09-12T18:17:55.842341+0000","last_fullsized":"2024-09-12T18:17:55.842341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833940+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:55.833940+0000","last_peered":"2024-09-12T18:17:55.833940+0000","last_clean":"2024-09-12T18:17:55.833940+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:55.833940+0000","last_undegraded":"2024-09-12T18:17:55.833940+0000","last_fullsized":"2024-09-12T18:17:55.833940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.830385+0000","last_change":"2024-09-12T18:17:36.806316+0000","last_active":"2024-09-12T18:17:54.830385+0000","last_peered":"2024-09-12T18:17:54.830385+0000","last_clean":"2024-09-12T18:17:54.830385+0000","last_became_active":"2024-09-12T18:17:36.803934+0000","last_became_peered":"2024-09-12T18:17:36.803934+0000","last_unstale":"2024-09-12T18:17:54.830385+0000","last_undegraded":"2024-09-12T18:17:54.830385+0000","last_fullsized":"2024-09-12T18:17:54.830385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.182845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832908+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:55.832908+0000","last_peered":"2024-09-12T18:17:55.832908+0000","last_clean":"2024-09-12T18:17:55.832908+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:55.832908+0000","last_undegraded":"2024-09-12T18:17:55.832908+0000","last_fullsized":"2024-09-12T18:17:55.832908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841740+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:55.841740+0000","last_peered":"2024-09-12T18:17:55.841740+0000","last_clean":"2024-09-12T18:17:55.841740+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:55.841740+0000","last_undegraded":"2024-09-12T18:17:55.841740+0000","last_fullsized":"2024-09-12T18:17:55.841740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842094+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:55.842094+0000","last_peered":"2024-09-12T18:17:55.842094+0000","last_clean":"2024-09-12T18:17:55.842094+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:55.842094+0000","last_undegraded":"2024-09-12T18:17:55.842094+0000","last_fullsized":"2024-09-12T18:17:55.842094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.851702+0000","last_change":"2024-09-12T18:17:54.851444+0000","last_active":"2024-09-12T18:17:54.851702+0000","last_peered":"2024-09-12T18:17:54.851702+0000","last_clean":"2024-09-12T18:17:54.851702+0000","last_became_active":"2024-09-12T18:17:54.850490+0000","last_became_peered":"2024-09-12T18:17:54.850490+0000","last_unstale":"2024-09-12T18:17:54.851702+0000","last_undegraded":"2024-09-12T18:17:54.851702+0000","last_fullsized":"2024-09-12T18:17:54.851702+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.077010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833863+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:55.833863+0000","last_peered":"2024-09-12T18:17:55.833863+0000","last_clean":"2024-09-12T18:17:55.833863+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:55.833863+0000","last_undegraded":"2024-09-12T18:17:55.833863+0000","last_fullsized":"2024-09-12T18:17:55.833863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.828437+0000","last_change":"2024-09-12T18:17:52.823337+0000","last_active":"2024-09-12T18:17:54.828437+0000","last_peered":"2024-09-12T18:17:54.828437+0000","last_clean":"2024-09-12T18:17:54.828437+0000","last_became_active":"2024-09-12T18:17:52.822059+0000","last_became_peered":"2024-09-12T18:17:52.822059+0000","last_unstale":"2024-09-12T18:17:54.828437+0000","last_undegraded":"2024-09-12T18:17:54.828437+0000","last_fullsized":"2024-09-12T18:17:54.828437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:51.273134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.191338+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:56.191338+0000","last_peered":"2024-09-12T18:17:56.191338+0000","last_clean":"2024-09-12T18:17:56.191338+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:56.191338+0000","last_undegraded":"2024-09-12T18:17:56.191338+0000","last_fullsized":"2024-09-12T18:17:56.191338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834825+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:55.834825+0000","last_peered":"2024-09-12T18:17:55.834825+0000","last_clean":"2024-09-12T18:17:55.834825+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:55.834825+0000","last_undegraded":"2024-09-12T18:17:55.834825+0000","last_fullsized":"2024-09-12T18:17:55.834825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838677+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:55.838677+0000","last_peered":"2024-09-12T18:17:55.838677+0000","last_clean":"2024-09-12T18:17:55.838677+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:55.838677+0000","last_undegraded":"2024-09-12T18:17:55.838677+0000","last_fullsized":"2024-09-12T18:17:55.838677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.853093+0000","last_change":"2024-09-12T18:17:54.852838+0000","last_active":"2024-09-12T18:17:54.853093+0000","last_peered":"2024-09-12T18:17:54.853093+0000","last_clean":"2024-09-12T18:17:54.853093+0000","last_became_active":"2024-09-12T18:17:54.848172+0000","last_became_peered":"2024-09-12T18:17:54.848172+0000","last_unstale":"2024-09-12T18:17:54.853093+0000","last_undegraded":"2024-09-12T18:17:54.853093+0000","last_fullsized":"2024-09-12T18:17:54.853093+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:46.151762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832341+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:55.832341+0000","last_peered":"2024-09-12T18:17:55.832341+0000","last_clean":"2024-09-12T18:17:55.832341+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:55.832341+0000","last_undegraded":"2024-09-12T18:17:55.832341+0000","last_fullsized":"2024-09-12T18:17:55.832341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.837701+0000","last_change":"2024-09-12T18:17:36.779132+0000","last_active":"2024-09-12T18:17:54.837701+0000","last_peered":"2024-09-12T18:17:54.837701+0000","last_clean":"2024-09-12T18:17:54.837701+0000","last_became_active":"2024-09-12T18:17:36.777003+0000","last_became_peered":"2024-09-12T18:17:36.777003+0000","last_unstale":"2024-09-12T18:17:54.837701+0000","last_undegraded":"2024-09-12T18:17:54.837701+0000","last_fullsized":"2024-09-12T18:17:54.837701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:28.699621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832906+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:55.832906+0000","last_peered":"2024-09-12T18:17:55.832906+0000","last_clean":"2024-09-12T18:17:55.832906+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:55.832906+0000","last_undegraded":"2024-09-12T18:17:55.832906+0000","last_fullsized":"2024-09-12T18:17:55.832906+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.843987+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:55.843987+0000","last_peered":"2024-09-12T18:17:55.843987+0000","last_clean":"2024-09-12T18:17:55.843987+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:55.843987+0000","last_undegraded":"2024-09-12T18:17:55.843987+0000","last_fullsized":"2024-09-12T18:17:55.843987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829556+0000","last_change":"2024-09-12T18:17:52.819277+0000","last_active":"2024-09-12T18:17:54.829556+0000","last_peered":"2024-09-12T18:17:54.829556+0000","last_clean":"2024-09-12T18:17:54.829556+0000","last_became_active":"2024-09-12T18:17:52.817513+0000","last_became_peered":"2024-09-12T18:17:52.817513+0000","last_unstale":"2024-09-12T18:17:54.829556+0000","last_undegraded":"2024-09-12T18:17:54.829556+0000","last_fullsized":"2024-09-12T18:17:54.829556+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:44.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":176,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842381+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:55.842381+0000","last_peered":"2024-09-12T18:17:55.842381+0000","last_clean":"2024-09-12T18:17:55.842381+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:55.842381+0000","last_undegraded":"2024-09-12T18:17:55.842381+0000","last_fullsized":"2024-09-12T18:17:55.842381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.830353+0000","last_change":"2024-09-12T18:17:52.826137+0000","last_active":"2024-09-12T18:17:54.830353+0000","last_peered":"2024-09-12T18:17:54.830353+0000","last_clean":"2024-09-12T18:17:54.830353+0000","last_became_active":"2024-09-12T18:17:52.822058+0000","last_became_peered":"2024-09-12T18:17:52.822058+0000","last_unstale":"2024-09-12T18:17:54.830353+0000","last_undegraded":"2024-09-12T18:17:54.830353+0000","last_fullsized":"2024-09-12T18:17:54.830353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:47.237661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832603+0000","last_change":"2024-09-12T18:17:52.825472+0000","last_active":"2024-09-12T18:17:55.832603+0000","last_peered":"2024-09-12T18:17:55.832603+0000","last_clean":"2024-09-12T18:17:55.832603+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:17:55.832603+0000","last_undegraded":"2024-09-12T18:17:55.832603+0000","last_fullsized":"2024-09-12T18:17:55.832603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:11.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832539+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:55.832539+0000","last_peered":"2024-09-12T18:17:55.832539+0000","last_clean":"2024-09-12T18:17:55.832539+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:55.832539+0000","last_undegraded":"2024-09-12T18:17:55.832539+0000","last_fullsized":"2024-09-12T18:17:55.832539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.198910+0000","last_change":"2024-09-12T18:17:44.195812+0000","last_active":"2024-09-12T18:17:56.198910+0000","last_peered":"2024-09-12T18:17:56.198910+0000","last_clean":"2024-09-12T18:17:56.198910+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:17:56.198910+0000","last_undegraded":"2024-09-12T18:17:56.198910+0000","last_fullsized":"2024-09-12T18:17:56.198910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:15.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832918+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:55.832918+0000","last_peered":"2024-09-12T18:17:55.832918+0000","last_clean":"2024-09-12T18:17:55.832918+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:55.832918+0000","last_undegraded":"2024-09-12T18:17:55.832918+0000","last_fullsized":"2024-09-12T18:17:55.832918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:37.804558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":165,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844029+0000","last_change":"2024-09-12T18:17:54.850651+0000","last_active":"2024-09-12T18:17:55.844029+0000","last_peered":"2024-09-12T18:17:55.844029+0000","last_clean":"2024-09-12T18:17:55.844029+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:17:55.844029+0000","last_undegraded":"2024-09-12T18:17:55.844029+0000","last_fullsized":"2024-09-12T18:17:55.844029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:21.588951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839732+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:55.839732+0000","last_peered":"2024-09-12T18:17:55.839732+0000","last_clean":"2024-09-12T18:17:55.839732+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:55.839732+0000","last_undegraded":"2024-09-12T18:17:55.839732+0000","last_fullsized":"2024-09-12T18:17:55.839732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.853079+0000","last_change":"2024-09-12T18:17:54.852825+0000","last_active":"2024-09-12T18:17:54.853079+0000","last_peered":"2024-09-12T18:17:54.853079+0000","last_clean":"2024-09-12T18:17:54.853079+0000","last_became_active":"2024-09-12T18:17:54.851363+0000","last_became_peered":"2024-09-12T18:17:54.851363+0000","last_unstale":"2024-09-12T18:17:54.853079+0000","last_undegraded":"2024-09-12T18:17:54.853079+0000","last_fullsized":"2024-09-12T18:17:54.853079+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.642954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.847973+0000","last_change":"2024-09-12T18:17:54.840724+0000","last_active":"2024-09-12T18:17:54.847973+0000","last_peered":"2024-09-12T18:17:54.847973+0000","last_clean":"2024-09-12T18:17:54.847973+0000","last_became_active":"2024-09-12T18:17:54.838294+0000","last_became_peered":"2024-09-12T18:17:54.838294+0000","last_unstale":"2024-09-12T18:17:54.847973+0000","last_undegraded":"2024-09-12T18:17:54.847973+0000","last_fullsized":"2024-09-12T18:17:54.847973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:06.293356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829018+0000","last_change":"2024-09-12T18:17:52.825440+0000","last_active":"2024-09-12T18:17:54.829018+0000","last_peered":"2024-09-12T18:17:54.829018+0000","last_clean":"2024-09-12T18:17:54.829018+0000","last_became_active":"2024-09-12T18:17:52.817863+0000","last_became_peered":"2024-09-12T18:17:52.817863+0000","last_unstale":"2024-09-12T18:17:54.829018+0000","last_undegraded":"2024-09-12T18:17:54.829018+0000","last_fullsized":"2024-09-12T18:17:54.829018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.482320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842056+0000","last_change":"2024-09-12T18:17:43.850032+0000","last_active":"2024-09-12T18:17:55.842056+0000","last_peered":"2024-09-12T18:17:55.842056+0000","last_clean":"2024-09-12T18:17:55.842056+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:17:55.842056+0000","last_undegraded":"2024-09-12T18:17:55.842056+0000","last_fullsized":"2024-09-12T18:17:55.842056+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837482+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:55.837482+0000","last_peered":"2024-09-12T18:17:55.837482+0000","last_clean":"2024-09-12T18:17:55.837482+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:55.837482+0000","last_undegraded":"2024-09-12T18:17:55.837482+0000","last_fullsized":"2024-09-12T18:17:55.837482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842562+0000","last_change":"2024-09-12T18:17:54.848137+0000","last_active":"2024-09-12T18:17:55.842562+0000","last_peered":"2024-09-12T18:17:55.842562+0000","last_clean":"2024-09-12T18:17:55.842562+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:17:55.842562+0000","last_undegraded":"2024-09-12T18:17:55.842562+0000","last_fullsized":"2024-09-12T18:17:55.842562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:47.582059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832054+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:55.832054+0000","last_peered":"2024-09-12T18:17:55.832054+0000","last_clean":"2024-09-12T18:17:55.832054+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:55.832054+0000","last_undegraded":"2024-09-12T18:17:55.832054+0000","last_fullsized":"2024-09-12T18:17:55.832054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834047+0000","last_change":"2024-09-12T18:17:43.846663+0000","last_active":"2024-09-12T18:17:55.834047+0000","last_peered":"2024-09-12T18:17:55.834047+0000","last_clean":"2024-09-12T18:17:55.834047+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:17:55.834047+0000","last_undegraded":"2024-09-12T18:17:55.834047+0000","last_fullsized":"2024-09-12T18:17:55.834047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:52.288114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838202+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:55.838202+0000","last_peered":"2024-09-12T18:17:55.838202+0000","last_clean":"2024-09-12T18:17:55.838202+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:55.838202+0000","last_undegraded":"2024-09-12T18:17:55.838202+0000","last_fullsized":"2024-09-12T18:17:55.838202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844793+0000","last_change":"2024-09-12T18:17:54.844194+0000","last_active":"2024-09-12T18:17:55.844793+0000","last_peered":"2024-09-12T18:17:55.844793+0000","last_clean":"2024-09-12T18:17:55.844793+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:17:55.844793+0000","last_undegraded":"2024-09-12T18:17:55.844793+0000","last_fullsized":"2024-09-12T18:17:55.844793+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:26.010260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840710+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:55.840710+0000","last_peered":"2024-09-12T18:17:55.840710+0000","last_clean":"2024-09-12T18:17:55.840710+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:55.840710+0000","last_undegraded":"2024-09-12T18:17:55.840710+0000","last_fullsized":"2024-09-12T18:17:55.840710+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.834072+0000","last_change":"2024-09-12T18:17:36.782758+0000","last_active":"2024-09-12T18:17:54.834072+0000","last_peered":"2024-09-12T18:17:54.834072+0000","last_clean":"2024-09-12T18:17:54.834072+0000","last_became_active":"2024-09-12T18:17:36.780017+0000","last_became_peered":"2024-09-12T18:17:36.780017+0000","last_unstale":"2024-09-12T18:17:54.834072+0000","last_undegraded":"2024-09-12T18:17:54.834072+0000","last_fullsized":"2024-09-12T18:17:54.834072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:11.394054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.828911+0000","last_change":"2024-09-12T18:17:36.793762+0000","last_active":"2024-09-12T18:17:54.828911+0000","last_peered":"2024-09-12T18:17:54.828911+0000","last_clean":"2024-09-12T18:17:54.828911+0000","last_became_active":"2024-09-12T18:17:36.790151+0000","last_became_peered":"2024-09-12T18:17:36.790151+0000","last_unstale":"2024-09-12T18:17:54.828911+0000","last_undegraded":"2024-09-12T18:17:54.828911+0000","last_fullsized":"2024-09-12T18:17:54.828911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:29.545701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833175+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:55.833175+0000","last_peered":"2024-09-12T18:17:55.833175+0000","last_clean":"2024-09-12T18:17:55.833175+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:55.833175+0000","last_undegraded":"2024-09-12T18:17:55.833175+0000","last_fullsized":"2024-09-12T18:17:55.833175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839718+0000","last_change":"2024-09-12T18:17:46.785093+0000","last_active":"2024-09-12T18:17:55.839718+0000","last_peered":"2024-09-12T18:17:55.839718+0000","last_clean":"2024-09-12T18:17:55.839718+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:17:55.839718+0000","last_undegraded":"2024-09-12T18:17:55.839718+0000","last_fullsized":"2024-09-12T18:17:55.839718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:07.703117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844012+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:55.844012+0000","last_peered":"2024-09-12T18:17:55.844012+0000","last_clean":"2024-09-12T18:17:55.844012+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:55.844012+0000","last_undegraded":"2024-09-12T18:17:55.844012+0000","last_fullsized":"2024-09-12T18:17:55.844012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833432+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:55.833432+0000","last_peered":"2024-09-12T18:17:55.833432+0000","last_clean":"2024-09-12T18:17:55.833432+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:55.833432+0000","last_undegraded":"2024-09-12T18:17:55.833432+0000","last_fullsized":"2024-09-12T18:17:55.833432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842366+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:55.842366+0000","last_peered":"2024-09-12T18:17:55.842366+0000","last_clean":"2024-09-12T18:17:55.842366+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:55.842366+0000","last_undegraded":"2024-09-12T18:17:55.842366+0000","last_fullsized":"2024-09-12T18:17:55.842366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844328+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:55.844328+0000","last_peered":"2024-09-12T18:17:55.844328+0000","last_clean":"2024-09-12T18:17:55.844328+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:55.844328+0000","last_undegraded":"2024-09-12T18:17:55.844328+0000","last_fullsized":"2024-09-12T18:17:55.844328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":191,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831259+0000","last_change":"2024-09-12T18:17:43.837153+0000","last_active":"2024-09-12T18:17:55.831259+0000","last_peered":"2024-09-12T18:17:55.831259+0000","last_clean":"2024-09-12T18:17:55.831259+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:17:55.831259+0000","last_undegraded":"2024-09-12T18:17:55.831259+0000","last_fullsized":"2024-09-12T18:17:55.831259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:44.908861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.196443+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:56.196443+0000","last_peered":"2024-09-12T18:17:56.196443+0000","last_clean":"2024-09-12T18:17:56.196443+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:56.196443+0000","last_undegraded":"2024-09-12T18:17:56.196443+0000","last_fullsized":"2024-09-12T18:17:56.196443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834958+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:55.834958+0000","last_peered":"2024-09-12T18:17:55.834958+0000","last_clean":"2024-09-12T18:17:55.834958+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:55.834958+0000","last_undegraded":"2024-09-12T18:17:55.834958+0000","last_fullsized":"2024-09-12T18:17:55.834958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.856335+0000","last_change":"2024-09-12T18:17:54.854109+0000","last_active":"2024-09-12T18:17:54.856335+0000","last_peered":"2024-09-12T18:17:54.856335+0000","last_clean":"2024-09-12T18:17:54.856335+0000","last_became_active":"2024-09-12T18:17:54.851548+0000","last_became_peered":"2024-09-12T18:17:54.851548+0000","last_unstale":"2024-09-12T18:17:54.856335+0000","last_undegraded":"2024-09-12T18:17:54.856335+0000","last_fullsized":"2024-09-12T18:17:54.856335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:45.162841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833187+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:55.833187+0000","last_peered":"2024-09-12T18:17:55.833187+0000","last_clean":"2024-09-12T18:17:55.833187+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:55.833187+0000","last_undegraded":"2024-09-12T18:17:55.833187+0000","last_fullsized":"2024-09-12T18:17:55.833187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844868+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:55.844868+0000","last_peered":"2024-09-12T18:17:55.844868+0000","last_clean":"2024-09-12T18:17:55.844868+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:55.844868+0000","last_undegraded":"2024-09-12T18:17:55.844868+0000","last_fullsized":"2024-09-12T18:17:55.844868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842674+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:55.842674+0000","last_peered":"2024-09-12T18:17:55.842674+0000","last_clean":"2024-09-12T18:17:55.842674+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:55.842674+0000","last_undegraded":"2024-09-12T18:17:55.842674+0000","last_fullsized":"2024-09-12T18:17:55.842674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837309+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:55.837309+0000","last_peered":"2024-09-12T18:17:55.837309+0000","last_clean":"2024-09-12T18:17:55.837309+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:55.837309+0000","last_undegraded":"2024-09-12T18:17:55.837309+0000","last_fullsized":"2024-09-12T18:17:55.837309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842598+0000","last_change":"2024-09-12T18:17:54.845043+0000","last_active":"2024-09-12T18:17:55.842598+0000","last_peered":"2024-09-12T18:17:55.842598+0000","last_clean":"2024-09-12T18:17:55.842598+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:17:55.842598+0000","last_undegraded":"2024-09-12T18:17:55.842598+0000","last_fullsized":"2024-09-12T18:17:55.842598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:09.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837568+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:55.837568+0000","last_peered":"2024-09-12T18:17:55.837568+0000","last_clean":"2024-09-12T18:17:55.837568+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:55.837568+0000","last_undegraded":"2024-09-12T18:17:55.837568+0000","last_fullsized":"2024-09-12T18:17:55.837568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.835504+0000","last_change":"2024-09-12T18:17:43.833964+0000","last_active":"2024-09-12T18:17:54.835504+0000","last_peered":"2024-09-12T18:17:54.835504+0000","last_clean":"2024-09-12T18:17:54.835504+0000","last_became_active":"2024-09-12T18:17:43.832888+0000","last_became_peered":"2024-09-12T18:17:43.832888+0000","last_unstale":"2024-09-12T18:17:54.835504+0000","last_undegraded":"2024-09-12T18:17:54.835504+0000","last_fullsized":"2024-09-12T18:17:54.835504+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:40.373118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837464+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:55.837464+0000","last_peered":"2024-09-12T18:17:55.837464+0000","last_clean":"2024-09-12T18:17:55.837464+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:55.837464+0000","last_undegraded":"2024-09-12T18:17:55.837464+0000","last_fullsized":"2024-09-12T18:17:55.837464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.201796+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:56.201796+0000","last_peered":"2024-09-12T18:17:56.201796+0000","last_clean":"2024-09-12T18:17:56.201796+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:56.201796+0000","last_undegraded":"2024-09-12T18:17:56.201796+0000","last_fullsized":"2024-09-12T18:17:56.201796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.835009+0000","last_change":"2024-09-12T18:17:43.833456+0000","last_active":"2024-09-12T18:17:54.835009+0000","last_peered":"2024-09-12T18:17:54.835009+0000","last_clean":"2024-09-12T18:17:54.835009+0000","last_became_active":"2024-09-12T18:17:43.832672+0000","last_became_peered":"2024-09-12T18:17:43.832672+0000","last_unstale":"2024-09-12T18:17:54.835009+0000","last_undegraded":"2024-09-12T18:17:54.835009+0000","last_fullsized":"2024-09-12T18:17:54.835009+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:18.052747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834223+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:55.834223+0000","last_peered":"2024-09-12T18:17:55.834223+0000","last_clean":"2024-09-12T18:17:55.834223+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:55.834223+0000","last_undegraded":"2024-09-12T18:17:55.834223+0000","last_fullsized":"2024-09-12T18:17:55.834223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832472+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:55.832472+0000","last_peered":"2024-09-12T18:17:55.832472+0000","last_clean":"2024-09-12T18:17:55.832472+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:55.832472+0000","last_undegraded":"2024-09-12T18:17:55.832472+0000","last_fullsized":"2024-09-12T18:17:55.832472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833275+0000","last_change":"2024-09-12T18:17:43.838249+0000","last_active":"2024-09-12T18:17:55.833275+0000","last_peered":"2024-09-12T18:17:55.833275+0000","last_clean":"2024-09-12T18:17:55.833275+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:17:55.833275+0000","last_undegraded":"2024-09-12T18:17:55.833275+0000","last_fullsized":"2024-09-12T18:17:55.833275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:22.433973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":200,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834678+0000","last_change":"2024-09-12T18:17:43.870789+0000","last_active":"2024-09-12T18:17:55.834678+0000","last_peered":"2024-09-12T18:17:55.834678+0000","last_clean":"2024-09-12T18:17:55.834678+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:17:55.834678+0000","last_undegraded":"2024-09-12T18:17:55.834678+0000","last_fullsized":"2024-09-12T18:17:55.834678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:49.502247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840543+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:55.840543+0000","last_peered":"2024-09-12T18:17:55.840543+0000","last_clean":"2024-09-12T18:17:55.840543+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:55.840543+0000","last_undegraded":"2024-09-12T18:17:55.840543+0000","last_fullsized":"2024-09-12T18:17:55.840543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.847611+0000","last_change":"2024-09-12T18:17:54.840513+0000","last_active":"2024-09-12T18:17:54.847611+0000","last_peered":"2024-09-12T18:17:54.847611+0000","last_clean":"2024-09-12T18:17:54.847611+0000","last_became_active":"2024-09-12T18:17:54.838161+0000","last_became_peered":"2024-09-12T18:17:54.838161+0000","last_unstale":"2024-09-12T18:17:54.847611+0000","last_undegraded":"2024-09-12T18:17:54.847611+0000","last_fullsized":"2024-09-12T18:17:54.847611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:15.847135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841325+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:55.841325+0000","last_peered":"2024-09-12T18:17:55.841325+0000","last_clean":"2024-09-12T18:17:55.841325+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:55.841325+0000","last_undegraded":"2024-09-12T18:17:55.841325+0000","last_fullsized":"2024-09-12T18:17:55.841325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":163,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842264+0000","last_change":"2024-09-12T18:17:54.850699+0000","last_active":"2024-09-12T18:17:55.842264+0000","last_peered":"2024-09-12T18:17:55.842264+0000","last_clean":"2024-09-12T18:17:55.842264+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:17:55.842264+0000","last_undegraded":"2024-09-12T18:17:55.842264+0000","last_fullsized":"2024-09-12T18:17:55.842264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:42.033453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831765+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:55.831765+0000","last_peered":"2024-09-12T18:17:55.831765+0000","last_clean":"2024-09-12T18:17:55.831765+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:55.831765+0000","last_undegraded":"2024-09-12T18:17:55.831765+0000","last_fullsized":"2024-09-12T18:17:55.831765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":133,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.841720+0000","last_change":"2024-09-12T18:17:36.785578+0000","last_active":"2024-09-12T18:17:54.841720+0000","last_peered":"2024-09-12T18:17:54.841720+0000","last_clean":"2024-09-12T18:17:54.841720+0000","last_became_active":"2024-09-12T18:17:36.782643+0000","last_became_peered":"2024-09-12T18:17:36.782643+0000","last_unstale":"2024-09-12T18:17:54.841720+0000","last_undegraded":"2024-09-12T18:17:54.841720+0000","last_fullsized":"2024-09-12T18:17:54.841720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.694821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839256+0000","last_change":"2024-09-12T18:17:54.840249+0000","last_active":"2024-09-12T18:17:55.839256+0000","last_peered":"2024-09-12T18:17:55.839256+0000","last_clean":"2024-09-12T18:17:55.839256+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:17:55.839256+0000","last_undegraded":"2024-09-12T18:17:55.839256+0000","last_fullsized":"2024-09-12T18:17:55.839256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:47.078593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832620+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:55.832620+0000","last_peered":"2024-09-12T18:17:55.832620+0000","last_clean":"2024-09-12T18:17:55.832620+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:55.832620+0000","last_undegraded":"2024-09-12T18:17:55.832620+0000","last_fullsized":"2024-09-12T18:17:55.832620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833671+0000","last_change":"2024-09-12T18:17:52.823288+0000","last_active":"2024-09-12T18:17:55.833671+0000","last_peered":"2024-09-12T18:17:55.833671+0000","last_clean":"2024-09-12T18:17:55.833671+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:17:55.833671+0000","last_undegraded":"2024-09-12T18:17:55.833671+0000","last_fullsized":"2024-09-12T18:17:55.833671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:50.555729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833019+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:55.833019+0000","last_peered":"2024-09-12T18:17:55.833019+0000","last_clean":"2024-09-12T18:17:55.833019+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:55.833019+0000","last_undegraded":"2024-09-12T18:17:55.833019+0000","last_fullsized":"2024-09-12T18:17:55.833019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.835106+0000","last_change":"2024-09-12T18:17:36.781903+0000","last_active":"2024-09-12T18:17:54.835106+0000","last_peered":"2024-09-12T18:17:54.835106+0000","last_clean":"2024-09-12T18:17:54.835106+0000","last_became_active":"2024-09-12T18:17:36.780395+0000","last_became_peered":"2024-09-12T18:17:36.780395+0000","last_unstale":"2024-09-12T18:17:54.835106+0000","last_undegraded":"2024-09-12T18:17:54.835106+0000","last_fullsized":"2024-09-12T18:17:54.835106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:47.917209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833517+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:55.833517+0000","last_peered":"2024-09-12T18:17:55.833517+0000","last_clean":"2024-09-12T18:17:55.833517+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:55.833517+0000","last_undegraded":"2024-09-12T18:17:55.833517+0000","last_fullsized":"2024-09-12T18:17:55.833517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834514+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:55.834514+0000","last_peered":"2024-09-12T18:17:55.834514+0000","last_clean":"2024-09-12T18:17:55.834514+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:55.834514+0000","last_undegraded":"2024-09-12T18:17:55.834514+0000","last_fullsized":"2024-09-12T18:17:55.834514+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831562+0000","last_change":"2024-09-12T18:17:43.837788+0000","last_active":"2024-09-12T18:17:55.831562+0000","last_peered":"2024-09-12T18:17:55.831562+0000","last_clean":"2024-09-12T18:17:55.831562+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:17:55.831562+0000","last_undegraded":"2024-09-12T18:17:55.831562+0000","last_fullsized":"2024-09-12T18:17:55.831562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:27.702672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.199411+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:56.199411+0000","last_peered":"2024-09-12T18:17:56.199411+0000","last_clean":"2024-09-12T18:17:56.199411+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:56.199411+0000","last_undegraded":"2024-09-12T18:17:56.199411+0000","last_fullsized":"2024-09-12T18:17:56.199411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829047+0000","last_change":"2024-09-12T18:17:52.818955+0000","last_active":"2024-09-12T18:17:54.829047+0000","last_peered":"2024-09-12T18:17:54.829047+0000","last_clean":"2024-09-12T18:17:54.829047+0000","last_became_active":"2024-09-12T18:17:52.817406+0000","last_became_peered":"2024-09-12T18:17:52.817406+0000","last_unstale":"2024-09-12T18:17:54.829047+0000","last_undegraded":"2024-09-12T18:17:54.829047+0000","last_fullsized":"2024-09-12T18:17:54.829047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:45.648878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829628+0000","last_change":"2024-09-12T18:17:52.819879+0000","last_active":"2024-09-12T18:17:54.829628+0000","last_peered":"2024-09-12T18:17:54.829628+0000","last_clean":"2024-09-12T18:17:54.829628+0000","last_became_active":"2024-09-12T18:17:52.817536+0000","last_became_peered":"2024-09-12T18:17:52.817536+0000","last_unstale":"2024-09-12T18:17:54.829628+0000","last_undegraded":"2024-09-12T18:17:54.829628+0000","last_fullsized":"2024-09-12T18:17:54.829628+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:34.143564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.851064+0000","last_change":"2024-09-12T18:17:54.846399+0000","last_active":"2024-09-12T18:17:54.851064+0000","last_peered":"2024-09-12T18:17:54.851064+0000","last_clean":"2024-09-12T18:17:54.851064+0000","last_became_active":"2024-09-12T18:17:54.844135+0000","last_became_peered":"2024-09-12T18:17:54.844135+0000","last_unstale":"2024-09-12T18:17:54.851064+0000","last_undegraded":"2024-09-12T18:17:54.851064+0000","last_fullsized":"2024-09-12T18:17:54.851064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:05.340600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837639+0000","last_change":"2024-09-12T18:17:54.854658+0000","last_active":"2024-09-12T18:17:55.837639+0000","last_peered":"2024-09-12T18:17:55.837639+0000","last_clean":"2024-09-12T18:17:55.837639+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:17:55.837639+0000","last_undegraded":"2024-09-12T18:17:55.837639+0000","last_fullsized":"2024-09-12T18:17:55.837639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.476487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844591+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:55.844591+0000","last_peered":"2024-09-12T18:17:55.844591+0000","last_clean":"2024-09-12T18:17:55.844591+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:55.844591+0000","last_undegraded":"2024-09-12T18:17:55.844591+0000","last_fullsized":"2024-09-12T18:17:55.844591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.850069+0000","last_change":"2024-09-12T18:17:54.849767+0000","last_active":"2024-09-12T18:17:54.850069+0000","last_peered":"2024-09-12T18:17:54.850069+0000","last_clean":"2024-09-12T18:17:54.850069+0000","last_became_active":"2024-09-12T18:17:54.847619+0000","last_became_peered":"2024-09-12T18:17:54.847619+0000","last_unstale":"2024-09-12T18:17:54.850069+0000","last_undegraded":"2024-09-12T18:17:54.850069+0000","last_fullsized":"2024-09-12T18:17:54.850069+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:19.089432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.828689+0000","last_change":"2024-09-12T18:17:52.818851+0000","last_active":"2024-09-12T18:17:54.828689+0000","last_peered":"2024-09-12T18:17:54.828689+0000","last_clean":"2024-09-12T18:17:54.828689+0000","last_became_active":"2024-09-12T18:17:52.817220+0000","last_became_peered":"2024-09-12T18:17:52.817220+0000","last_unstale":"2024-09-12T18:17:54.828689+0000","last_undegraded":"2024-09-12T18:17:54.828689+0000","last_fullsized":"2024-09-12T18:17:54.828689+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:53.284930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.836656+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:55.836656+0000","last_peered":"2024-09-12T18:17:55.836656+0000","last_clean":"2024-09-12T18:17:55.836656+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:55.836656+0000","last_undegraded":"2024-09-12T18:17:55.836656+0000","last_fullsized":"2024-09-12T18:17:55.836656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844194+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:55.844194+0000","last_peered":"2024-09-12T18:17:55.844194+0000","last_clean":"2024-09-12T18:17:55.844194+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:55.844194+0000","last_undegraded":"2024-09-12T18:17:55.844194+0000","last_fullsized":"2024-09-12T18:17:55.844194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":207,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834454+0000","last_change":"2024-09-12T18:17:43.861774+0000","last_active":"2024-09-12T18:17:55.834454+0000","last_peered":"2024-09-12T18:17:55.834454+0000","last_clean":"2024-09-12T18:17:55.834454+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:17:55.834454+0000","last_undegraded":"2024-09-12T18:17:55.834454+0000","last_fullsized":"2024-09-12T18:17:55.834454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:07.298644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280832,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091008,"statfs":{"total":96636764160,"available":96349192192,"internally_reserved":0,"allocated":1150976,"data_stored":1050347,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397368,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974472,"statfs":{"total":96636764160,"available":96229859328,"internally_reserved":0,"allocated":1077248,"data_stored":453953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285574,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46272,"kb_used_data":1128,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325568,"statfs":{"total":96636764160,"available":96589381632,"internally_reserved":0,"allocated":1155072,"data_stored":1049712,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:00.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:00.464 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:00.466 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:00.484 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-12T18:17:58.469448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724472,"kb_used_data":3304,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391048,"statfs":{"total":289910292480,"available":289168433152,"internally_reserved":0,"allocated":3383296,"data_stored":2554012,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.659265"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.193465+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:56.193465+0000","last_peered":"2024-09-12T18:17:56.193465+0000","last_clean":"2024-09-12T18:17:56.193465+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:56.193465+0000","last_undegraded":"2024-09-12T18:17:56.193465+0000","last_fullsized":"2024-09-12T18:17:56.193465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831649+0000","last_change":"2024-09-12T18:17:36.809622+0000","last_active":"2024-09-12T18:17:54.831649+0000","last_peered":"2024-09-12T18:17:54.831649+0000","last_clean":"2024-09-12T18:17:54.831649+0000","last_became_active":"2024-09-12T18:17:36.809003+0000","last_became_peered":"2024-09-12T18:17:36.809003+0000","last_unstale":"2024-09-12T18:17:54.831649+0000","last_undegraded":"2024-09-12T18:17:54.831649+0000","last_fullsized":"2024-09-12T18:17:54.831649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:06.382179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839554+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:55.839554+0000","last_peered":"2024-09-12T18:17:55.839554+0000","last_clean":"2024-09-12T18:17:55.839554+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:55.839554+0000","last_undegraded":"2024-09-12T18:17:55.839554+0000","last_fullsized":"2024-09-12T18:17:55.839554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841425+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:55.841425+0000","last_peered":"2024-09-12T18:17:55.841425+0000","last_clean":"2024-09-12T18:17:55.841425+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:55.841425+0000","last_undegraded":"2024-09-12T18:17:55.841425+0000","last_fullsized":"2024-09-12T18:17:55.841425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831863+0000","last_change":"2024-09-12T18:17:52.822116+0000","last_active":"2024-09-12T18:17:54.831863+0000","last_peered":"2024-09-12T18:17:54.831863+0000","last_clean":"2024-09-12T18:17:54.831863+0000","last_became_active":"2024-09-12T18:17:52.820092+0000","last_became_peered":"2024-09-12T18:17:52.820092+0000","last_unstale":"2024-09-12T18:17:54.831863+0000","last_undegraded":"2024-09-12T18:17:54.831863+0000","last_fullsized":"2024-09-12T18:17:54.831863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:46.011867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844144+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:55.844144+0000","last_peered":"2024-09-12T18:17:55.844144+0000","last_clean":"2024-09-12T18:17:55.844144+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:55.844144+0000","last_undegraded":"2024-09-12T18:17:55.844144+0000","last_fullsized":"2024-09-12T18:17:55.844144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837979+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:55.837979+0000","last_peered":"2024-09-12T18:17:55.837979+0000","last_clean":"2024-09-12T18:17:55.837979+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:55.837979+0000","last_undegraded":"2024-09-12T18:17:55.837979+0000","last_fullsized":"2024-09-12T18:17:55.837979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841664+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:55.841664+0000","last_peered":"2024-09-12T18:17:55.841664+0000","last_clean":"2024-09-12T18:17:55.841664+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:55.841664+0000","last_undegraded":"2024-09-12T18:17:55.841664+0000","last_fullsized":"2024-09-12T18:17:55.841664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832653+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:55.832653+0000","last_peered":"2024-09-12T18:17:55.832653+0000","last_clean":"2024-09-12T18:17:55.832653+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:55.832653+0000","last_undegraded":"2024-09-12T18:17:55.832653+0000","last_fullsized":"2024-09-12T18:17:55.832653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831390+0000","last_change":"2024-09-12T18:17:36.806954+0000","last_active":"2024-09-12T18:17:54.831390+0000","last_peered":"2024-09-12T18:17:54.831390+0000","last_clean":"2024-09-12T18:17:54.831390+0000","last_became_active":"2024-09-12T18:17:36.804438+0000","last_became_peered":"2024-09-12T18:17:36.804438+0000","last_unstale":"2024-09-12T18:17:54.831390+0000","last_undegraded":"2024-09-12T18:17:54.831390+0000","last_fullsized":"2024-09-12T18:17:54.831390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:47.122325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839824+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:55.839824+0000","last_peered":"2024-09-12T18:17:55.839824+0000","last_clean":"2024-09-12T18:17:55.839824+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:55.839824+0000","last_undegraded":"2024-09-12T18:17:55.839824+0000","last_fullsized":"2024-09-12T18:17:55.839824+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.843464+0000","last_change":"2024-09-12T18:17:36.776701+0000","last_active":"2024-09-12T18:17:54.843464+0000","last_peered":"2024-09-12T18:17:54.843464+0000","last_clean":"2024-09-12T18:17:54.843464+0000","last_became_active":"2024-09-12T18:17:36.775273+0000","last_became_peered":"2024-09-12T18:17:36.775273+0000","last_unstale":"2024-09-12T18:17:54.843464+0000","last_undegraded":"2024-09-12T18:17:54.843464+0000","last_fullsized":"2024-09-12T18:17:54.843464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:10.775150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.831802+0000","last_change":"2024-09-12T18:17:52.822675+0000","last_active":"2024-09-12T18:17:54.831802+0000","last_peered":"2024-09-12T18:17:54.831802+0000","last_clean":"2024-09-12T18:17:54.831802+0000","last_became_active":"2024-09-12T18:17:52.819135+0000","last_became_peered":"2024-09-12T18:17:52.819135+0000","last_unstale":"2024-09-12T18:17:54.831802+0000","last_undegraded":"2024-09-12T18:17:54.831802+0000","last_fullsized":"2024-09-12T18:17:54.831802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:08.684352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844403+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:55.844403+0000","last_peered":"2024-09-12T18:17:55.844403+0000","last_clean":"2024-09-12T18:17:55.844403+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:55.844403+0000","last_undegraded":"2024-09-12T18:17:55.844403+0000","last_fullsized":"2024-09-12T18:17:55.844403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837492+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:55.837492+0000","last_peered":"2024-09-12T18:17:55.837492+0000","last_clean":"2024-09-12T18:17:55.837492+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:55.837492+0000","last_undegraded":"2024-09-12T18:17:55.837492+0000","last_fullsized":"2024-09-12T18:17:55.837492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842341+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:55.842341+0000","last_peered":"2024-09-12T18:17:55.842341+0000","last_clean":"2024-09-12T18:17:55.842341+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:55.842341+0000","last_undegraded":"2024-09-12T18:17:55.842341+0000","last_fullsized":"2024-09-12T18:17:55.842341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833940+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:55.833940+0000","last_peered":"2024-09-12T18:17:55.833940+0000","last_clean":"2024-09-12T18:17:55.833940+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:55.833940+0000","last_undegraded":"2024-09-12T18:17:55.833940+0000","last_fullsized":"2024-09-12T18:17:55.833940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.830385+0000","last_change":"2024-09-12T18:17:36.806316+0000","last_active":"2024-09-12T18:17:54.830385+0000","last_peered":"2024-09-12T18:17:54.830385+0000","last_clean":"2024-09-12T18:17:54.830385+0000","last_became_active":"2024-09-12T18:17:36.803934+0000","last_became_peered":"2024-09-12T18:17:36.803934+0000","last_unstale":"2024-09-12T18:17:54.830385+0000","last_undegraded":"2024-09-12T18:17:54.830385+0000","last_fullsized":"2024-09-12T18:17:54.830385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.182845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832908+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:55.832908+0000","last_peered":"2024-09-12T18:17:55.832908+0000","last_clean":"2024-09-12T18:17:55.832908+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:55.832908+0000","last_undegraded":"2024-09-12T18:17:55.832908+0000","last_fullsized":"2024-09-12T18:17:55.832908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841740+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:55.841740+0000","last_peered":"2024-09-12T18:17:55.841740+0000","last_clean":"2024-09-12T18:17:55.841740+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:55.841740+0000","last_undegraded":"2024-09-12T18:17:55.841740+0000","last_fullsized":"2024-09-12T18:17:55.841740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842094+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:55.842094+0000","last_peered":"2024-09-12T18:17:55.842094+0000","last_clean":"2024-09-12T18:17:55.842094+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:55.842094+0000","last_undegraded":"2024-09-12T18:17:55.842094+0000","last_fullsized":"2024-09-12T18:17:55.842094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.851702+0000","last_change":"2024-09-12T18:17:54.851444+0000","last_active":"2024-09-12T18:17:54.851702+0000","last_peered":"2024-09-12T18:17:54.851702+0000","last_clean":"2024-09-12T18:17:54.851702+0000","last_became_active":"2024-09-12T18:17:54.850490+0000","last_became_peered":"2024-09-12T18:17:54.850490+0000","last_unstale":"2024-09-12T18:17:54.851702+0000","last_undegraded":"2024-09-12T18:17:54.851702+0000","last_fullsized":"2024-09-12T18:17:54.851702+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.077010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833863+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:55.833863+0000","last_peered":"2024-09-12T18:17:55.833863+0000","last_clean":"2024-09-12T18:17:55.833863+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:55.833863+0000","last_undegraded":"2024-09-12T18:17:55.833863+0000","last_fullsized":"2024-09-12T18:17:55.833863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.828437+0000","last_change":"2024-09-12T18:17:52.823337+0000","last_active":"2024-09-12T18:17:54.828437+0000","last_peered":"2024-09-12T18:17:54.828437+0000","last_clean":"2024-09-12T18:17:54.828437+0000","last_became_active":"2024-09-12T18:17:52.822059+0000","last_became_peered":"2024-09-12T18:17:52.822059+0000","last_unstale":"2024-09-12T18:17:54.828437+0000","last_undegraded":"2024-09-12T18:17:54.828437+0000","last_fullsized":"2024-09-12T18:17:54.828437+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:51.273134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.191338+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:56.191338+0000","last_peered":"2024-09-12T18:17:56.191338+0000","last_clean":"2024-09-12T18:17:56.191338+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:56.191338+0000","last_undegraded":"2024-09-12T18:17:56.191338+0000","last_fullsized":"2024-09-12T18:17:56.191338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834825+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:55.834825+0000","last_peered":"2024-09-12T18:17:55.834825+0000","last_clean":"2024-09-12T18:17:55.834825+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:55.834825+0000","last_undegraded":"2024-09-12T18:17:55.834825+0000","last_fullsized":"2024-09-12T18:17:55.834825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838677+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:55.838677+0000","last_peered":"2024-09-12T18:17:55.838677+0000","last_clean":"2024-09-12T18:17:55.838677+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:55.838677+0000","last_undegraded":"2024-09-12T18:17:55.838677+0000","last_fullsized":"2024-09-12T18:17:55.838677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.853093+0000","last_change":"2024-09-12T18:17:54.852838+0000","last_active":"2024-09-12T18:17:54.853093+0000","last_peered":"2024-09-12T18:17:54.853093+0000","last_clean":"2024-09-12T18:17:54.853093+0000","last_became_active":"2024-09-12T18:17:54.848172+0000","last_became_peered":"2024-09-12T18:17:54.848172+0000","last_unstale":"2024-09-12T18:17:54.853093+0000","last_undegraded":"2024-09-12T18:17:54.853093+0000","last_fullsized":"2024-09-12T18:17:54.853093+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:46.151762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832341+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:55.832341+0000","last_peered":"2024-09-12T18:17:55.832341+0000","last_clean":"2024-09-12T18:17:55.832341+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:55.832341+0000","last_undegraded":"2024-09-12T18:17:55.832341+0000","last_fullsized":"2024-09-12T18:17:55.832341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.837701+0000","last_change":"2024-09-12T18:17:36.779132+0000","last_active":"2024-09-12T18:17:54.837701+0000","last_peered":"2024-09-12T18:17:54.837701+0000","last_clean":"2024-09-12T18:17:54.837701+0000","last_became_active":"2024-09-12T18:17:36.777003+0000","last_became_peered":"2024-09-12T18:17:36.777003+0000","last_unstale":"2024-09-12T18:17:54.837701+0000","last_undegraded":"2024-09-12T18:17:54.837701+0000","last_fullsized":"2024-09-12T18:17:54.837701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:28.699621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832906+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:55.832906+0000","last_peered":"2024-09-12T18:17:55.832906+0000","last_clean":"2024-09-12T18:17:55.832906+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:55.832906+0000","last_undegraded":"2024-09-12T18:17:55.832906+0000","last_fullsized":"2024-09-12T18:17:55.832906+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.843987+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:55.843987+0000","last_peered":"2024-09-12T18:17:55.843987+0000","last_clean":"2024-09-12T18:17:55.843987+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:55.843987+0000","last_undegraded":"2024-09-12T18:17:55.843987+0000","last_fullsized":"2024-09-12T18:17:55.843987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829556+0000","last_change":"2024-09-12T18:17:52.819277+0000","last_active":"2024-09-12T18:17:54.829556+0000","last_peered":"2024-09-12T18:17:54.829556+0000","last_clean":"2024-09-12T18:17:54.829556+0000","last_became_active":"2024-09-12T18:17:52.817513+0000","last_became_peered":"2024-09-12T18:17:52.817513+0000","last_unstale":"2024-09-12T18:17:54.829556+0000","last_undegraded":"2024-09-12T18:17:54.829556+0000","last_fullsized":"2024-09-12T18:17:54.829556+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:44.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":176,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842381+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:55.842381+0000","last_peered":"2024-09-12T18:17:55.842381+0000","last_clean":"2024-09-12T18:17:55.842381+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:55.842381+0000","last_undegraded":"2024-09-12T18:17:55.842381+0000","last_fullsized":"2024-09-12T18:17:55.842381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.830353+0000","last_change":"2024-09-12T18:17:52.826137+0000","last_active":"2024-09-12T18:17:54.830353+0000","last_peered":"2024-09-12T18:17:54.830353+0000","last_clean":"2024-09-12T18:17:54.830353+0000","last_became_active":"2024-09-12T18:17:52.822058+0000","last_became_peered":"2024-09-12T18:17:52.822058+0000","last_unstale":"2024-09-12T18:17:54.830353+0000","last_undegraded":"2024-09-12T18:17:54.830353+0000","last_fullsized":"2024-09-12T18:17:54.830353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:47.237661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832603+0000","last_change":"2024-09-12T18:17:52.825472+0000","last_active":"2024-09-12T18:17:55.832603+0000","last_peered":"2024-09-12T18:17:55.832603+0000","last_clean":"2024-09-12T18:17:55.832603+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:17:55.832603+0000","last_undegraded":"2024-09-12T18:17:55.832603+0000","last_fullsized":"2024-09-12T18:17:55.832603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:11.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832539+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:55.832539+0000","last_peered":"2024-09-12T18:17:55.832539+0000","last_clean":"2024-09-12T18:17:55.832539+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:55.832539+0000","last_undegraded":"2024-09-12T18:17:55.832539+0000","last_fullsized":"2024-09-12T18:17:55.832539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.198910+0000","last_change":"2024-09-12T18:17:44.195812+0000","last_active":"2024-09-12T18:17:56.198910+0000","last_peered":"2024-09-12T18:17:56.198910+0000","last_clean":"2024-09-12T18:17:56.198910+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:17:56.198910+0000","last_undegraded":"2024-09-12T18:17:56.198910+0000","last_fullsized":"2024-09-12T18:17:56.198910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:15.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832918+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:55.832918+0000","last_peered":"2024-09-12T18:17:55.832918+0000","last_clean":"2024-09-12T18:17:55.832918+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:55.832918+0000","last_undegraded":"2024-09-12T18:17:55.832918+0000","last_fullsized":"2024-09-12T18:17:55.832918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:37.804558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":165,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844029+0000","last_change":"2024-09-12T18:17:54.850651+0000","last_active":"2024-09-12T18:17:55.844029+0000","last_peered":"2024-09-12T18:17:55.844029+0000","last_clean":"2024-09-12T18:17:55.844029+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:17:55.844029+0000","last_undegraded":"2024-09-12T18:17:55.844029+0000","last_fullsized":"2024-09-12T18:17:55.844029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:21.588951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839732+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:55.839732+0000","last_peered":"2024-09-12T18:17:55.839732+0000","last_clean":"2024-09-12T18:17:55.839732+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:55.839732+0000","last_undegraded":"2024-09-12T18:17:55.839732+0000","last_fullsized":"2024-09-12T18:17:55.839732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.853079+0000","last_change":"2024-09-12T18:17:54.852825+0000","last_active":"2024-09-12T18:17:54.853079+0000","last_peered":"2024-09-12T18:17:54.853079+0000","last_clean":"2024-09-12T18:17:54.853079+0000","last_became_active":"2024-09-12T18:17:54.851363+0000","last_became_peered":"2024-09-12T18:17:54.851363+0000","last_unstale":"2024-09-12T18:17:54.853079+0000","last_undegraded":"2024-09-12T18:17:54.853079+0000","last_fullsized":"2024-09-12T18:17:54.853079+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.642954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.847973+0000","last_change":"2024-09-12T18:17:54.840724+0000","last_active":"2024-09-12T18:17:54.847973+0000","last_peered":"2024-09-12T18:17:54.847973+0000","last_clean":"2024-09-12T18:17:54.847973+0000","last_became_active":"2024-09-12T18:17:54.838294+0000","last_became_peered":"2024-09-12T18:17:54.838294+0000","last_unstale":"2024-09-12T18:17:54.847973+0000","last_undegraded":"2024-09-12T18:17:54.847973+0000","last_fullsized":"2024-09-12T18:17:54.847973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:06.293356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829018+0000","last_change":"2024-09-12T18:17:52.825440+0000","last_active":"2024-09-12T18:17:54.829018+0000","last_peered":"2024-09-12T18:17:54.829018+0000","last_clean":"2024-09-12T18:17:54.829018+0000","last_became_active":"2024-09-12T18:17:52.817863+0000","last_became_peered":"2024-09-12T18:17:52.817863+0000","last_unstale":"2024-09-12T18:17:54.829018+0000","last_undegraded":"2024-09-12T18:17:54.829018+0000","last_fullsized":"2024-09-12T18:17:54.829018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:29.482320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842056+0000","last_change":"2024-09-12T18:17:43.850032+0000","last_active":"2024-09-12T18:17:55.842056+0000","last_peered":"2024-09-12T18:17:55.842056+0000","last_clean":"2024-09-12T18:17:55.842056+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:17:55.842056+0000","last_undegraded":"2024-09-12T18:17:55.842056+0000","last_fullsized":"2024-09-12T18:17:55.842056+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837482+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:55.837482+0000","last_peered":"2024-09-12T18:17:55.837482+0000","last_clean":"2024-09-12T18:17:55.837482+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:55.837482+0000","last_undegraded":"2024-09-12T18:17:55.837482+0000","last_fullsized":"2024-09-12T18:17:55.837482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842562+0000","last_change":"2024-09-12T18:17:54.848137+0000","last_active":"2024-09-12T18:17:55.842562+0000","last_peered":"2024-09-12T18:17:55.842562+0000","last_clean":"2024-09-12T18:17:55.842562+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:17:55.842562+0000","last_undegraded":"2024-09-12T18:17:55.842562+0000","last_fullsized":"2024-09-12T18:17:55.842562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:47.582059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832054+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:55.832054+0000","last_peered":"2024-09-12T18:17:55.832054+0000","last_clean":"2024-09-12T18:17:55.832054+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:55.832054+0000","last_undegraded":"2024-09-12T18:17:55.832054+0000","last_fullsized":"2024-09-12T18:17:55.832054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834047+0000","last_change":"2024-09-12T18:17:43.846663+0000","last_active":"2024-09-12T18:17:55.834047+0000","last_peered":"2024-09-12T18:17:55.834047+0000","last_clean":"2024-09-12T18:17:55.834047+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:17:55.834047+0000","last_undegraded":"2024-09-12T18:17:55.834047+0000","last_fullsized":"2024-09-12T18:17:55.834047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:52.288114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838202+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:55.838202+0000","last_peered":"2024-09-12T18:17:55.838202+0000","last_clean":"2024-09-12T18:17:55.838202+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:55.838202+0000","last_undegraded":"2024-09-12T18:17:55.838202+0000","last_fullsized":"2024-09-12T18:17:55.838202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844793+0000","last_change":"2024-09-12T18:17:54.844194+0000","last_active":"2024-09-12T18:17:55.844793+0000","last_peered":"2024-09-12T18:17:55.844793+0000","last_clean":"2024-09-12T18:17:55.844793+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:17:55.844793+0000","last_undegraded":"2024-09-12T18:17:55.844793+0000","last_fullsized":"2024-09-12T18:17:55.844793+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:26.010260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840710+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:55.840710+0000","last_peered":"2024-09-12T18:17:55.840710+0000","last_clean":"2024-09-12T18:17:55.840710+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:55.840710+0000","last_undegraded":"2024-09-12T18:17:55.840710+0000","last_fullsized":"2024-09-12T18:17:55.840710+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.834072+0000","last_change":"2024-09-12T18:17:36.782758+0000","last_active":"2024-09-12T18:17:54.834072+0000","last_peered":"2024-09-12T18:17:54.834072+0000","last_clean":"2024-09-12T18:17:54.834072+0000","last_became_active":"2024-09-12T18:17:36.780017+0000","last_became_peered":"2024-09-12T18:17:36.780017+0000","last_unstale":"2024-09-12T18:17:54.834072+0000","last_undegraded":"2024-09-12T18:17:54.834072+0000","last_fullsized":"2024-09-12T18:17:54.834072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:11.394054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.828911+0000","last_change":"2024-09-12T18:17:36.793762+0000","last_active":"2024-09-12T18:17:54.828911+0000","last_peered":"2024-09-12T18:17:54.828911+0000","last_clean":"2024-09-12T18:17:54.828911+0000","last_became_active":"2024-09-12T18:17:36.790151+0000","last_became_peered":"2024-09-12T18:17:36.790151+0000","last_unstale":"2024-09-12T18:17:54.828911+0000","last_undegraded":"2024-09-12T18:17:54.828911+0000","last_fullsized":"2024-09-12T18:17:54.828911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:29.545701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833175+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:55.833175+0000","last_peered":"2024-09-12T18:17:55.833175+0000","last_clean":"2024-09-12T18:17:55.833175+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:55.833175+0000","last_undegraded":"2024-09-12T18:17:55.833175+0000","last_fullsized":"2024-09-12T18:17:55.833175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839718+0000","last_change":"2024-09-12T18:17:46.785093+0000","last_active":"2024-09-12T18:17:55.839718+0000","last_peered":"2024-09-12T18:17:55.839718+0000","last_clean":"2024-09-12T18:17:55.839718+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:17:55.839718+0000","last_undegraded":"2024-09-12T18:17:55.839718+0000","last_fullsized":"2024-09-12T18:17:55.839718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:07.703117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844012+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:55.844012+0000","last_peered":"2024-09-12T18:17:55.844012+0000","last_clean":"2024-09-12T18:17:55.844012+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:55.844012+0000","last_undegraded":"2024-09-12T18:17:55.844012+0000","last_fullsized":"2024-09-12T18:17:55.844012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833432+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:55.833432+0000","last_peered":"2024-09-12T18:17:55.833432+0000","last_clean":"2024-09-12T18:17:55.833432+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:55.833432+0000","last_undegraded":"2024-09-12T18:17:55.833432+0000","last_fullsized":"2024-09-12T18:17:55.833432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842366+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:55.842366+0000","last_peered":"2024-09-12T18:17:55.842366+0000","last_clean":"2024-09-12T18:17:55.842366+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:55.842366+0000","last_undegraded":"2024-09-12T18:17:55.842366+0000","last_fullsized":"2024-09-12T18:17:55.842366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844328+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:55.844328+0000","last_peered":"2024-09-12T18:17:55.844328+0000","last_clean":"2024-09-12T18:17:55.844328+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:55.844328+0000","last_undegraded":"2024-09-12T18:17:55.844328+0000","last_fullsized":"2024-09-12T18:17:55.844328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":191,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831259+0000","last_change":"2024-09-12T18:17:43.837153+0000","last_active":"2024-09-12T18:17:55.831259+0000","last_peered":"2024-09-12T18:17:55.831259+0000","last_clean":"2024-09-12T18:17:55.831259+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:17:55.831259+0000","last_undegraded":"2024-09-12T18:17:55.831259+0000","last_fullsized":"2024-09-12T18:17:55.831259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:44.908861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.196443+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:56.196443+0000","last_peered":"2024-09-12T18:17:56.196443+0000","last_clean":"2024-09-12T18:17:56.196443+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:56.196443+0000","last_undegraded":"2024-09-12T18:17:56.196443+0000","last_fullsized":"2024-09-12T18:17:56.196443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834958+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:55.834958+0000","last_peered":"2024-09-12T18:17:55.834958+0000","last_clean":"2024-09-12T18:17:55.834958+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:55.834958+0000","last_undegraded":"2024-09-12T18:17:55.834958+0000","last_fullsized":"2024-09-12T18:17:55.834958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.856335+0000","last_change":"2024-09-12T18:17:54.854109+0000","last_active":"2024-09-12T18:17:54.856335+0000","last_peered":"2024-09-12T18:17:54.856335+0000","last_clean":"2024-09-12T18:17:54.856335+0000","last_became_active":"2024-09-12T18:17:54.851548+0000","last_became_peered":"2024-09-12T18:17:54.851548+0000","last_unstale":"2024-09-12T18:17:54.856335+0000","last_undegraded":"2024-09-12T18:17:54.856335+0000","last_fullsized":"2024-09-12T18:17:54.856335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:45.162841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833187+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:55.833187+0000","last_peered":"2024-09-12T18:17:55.833187+0000","last_clean":"2024-09-12T18:17:55.833187+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:55.833187+0000","last_undegraded":"2024-09-12T18:17:55.833187+0000","last_fullsized":"2024-09-12T18:17:55.833187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844868+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:55.844868+0000","last_peered":"2024-09-12T18:17:55.844868+0000","last_clean":"2024-09-12T18:17:55.844868+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:55.844868+0000","last_undegraded":"2024-09-12T18:17:55.844868+0000","last_fullsized":"2024-09-12T18:17:55.844868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842674+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:55.842674+0000","last_peered":"2024-09-12T18:17:55.842674+0000","last_clean":"2024-09-12T18:17:55.842674+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:55.842674+0000","last_undegraded":"2024-09-12T18:17:55.842674+0000","last_fullsized":"2024-09-12T18:17:55.842674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837309+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:55.837309+0000","last_peered":"2024-09-12T18:17:55.837309+0000","last_clean":"2024-09-12T18:17:55.837309+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:55.837309+0000","last_undegraded":"2024-09-12T18:17:55.837309+0000","last_fullsized":"2024-09-12T18:17:55.837309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842598+0000","last_change":"2024-09-12T18:17:54.845043+0000","last_active":"2024-09-12T18:17:55.842598+0000","last_peered":"2024-09-12T18:17:55.842598+0000","last_clean":"2024-09-12T18:17:55.842598+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:17:55.842598+0000","last_undegraded":"2024-09-12T18:17:55.842598+0000","last_fullsized":"2024-09-12T18:17:55.842598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:09.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837568+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:55.837568+0000","last_peered":"2024-09-12T18:17:55.837568+0000","last_clean":"2024-09-12T18:17:55.837568+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:55.837568+0000","last_undegraded":"2024-09-12T18:17:55.837568+0000","last_fullsized":"2024-09-12T18:17:55.837568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.835504+0000","last_change":"2024-09-12T18:17:43.833964+0000","last_active":"2024-09-12T18:17:54.835504+0000","last_peered":"2024-09-12T18:17:54.835504+0000","last_clean":"2024-09-12T18:17:54.835504+0000","last_became_active":"2024-09-12T18:17:43.832888+0000","last_became_peered":"2024-09-12T18:17:43.832888+0000","last_unstale":"2024-09-12T18:17:54.835504+0000","last_undegraded":"2024-09-12T18:17:54.835504+0000","last_fullsized":"2024-09-12T18:17:54.835504+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:40.373118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837464+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:55.837464+0000","last_peered":"2024-09-12T18:17:55.837464+0000","last_clean":"2024-09-12T18:17:55.837464+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:55.837464+0000","last_undegraded":"2024-09-12T18:17:55.837464+0000","last_fullsized":"2024-09-12T18:17:55.837464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.201796+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:56.201796+0000","last_peered":"2024-09-12T18:17:56.201796+0000","last_clean":"2024-09-12T18:17:56.201796+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:56.201796+0000","last_undegraded":"2024-09-12T18:17:56.201796+0000","last_fullsized":"2024-09-12T18:17:56.201796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.835009+0000","last_change":"2024-09-12T18:17:43.833456+0000","last_active":"2024-09-12T18:17:54.835009+0000","last_peered":"2024-09-12T18:17:54.835009+0000","last_clean":"2024-09-12T18:17:54.835009+0000","last_became_active":"2024-09-12T18:17:43.832672+0000","last_became_peered":"2024-09-12T18:17:43.832672+0000","last_unstale":"2024-09-12T18:17:54.835009+0000","last_undegraded":"2024-09-12T18:17:54.835009+0000","last_fullsized":"2024-09-12T18:17:54.835009+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:18.052747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834223+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:55.834223+0000","last_peered":"2024-09-12T18:17:55.834223+0000","last_clean":"2024-09-12T18:17:55.834223+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:55.834223+0000","last_undegraded":"2024-09-12T18:17:55.834223+0000","last_fullsized":"2024-09-12T18:17:55.834223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832472+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:55.832472+0000","last_peered":"2024-09-12T18:17:55.832472+0000","last_clean":"2024-09-12T18:17:55.832472+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:55.832472+0000","last_undegraded":"2024-09-12T18:17:55.832472+0000","last_fullsized":"2024-09-12T18:17:55.832472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833275+0000","last_change":"2024-09-12T18:17:43.838249+0000","last_active":"2024-09-12T18:17:55.833275+0000","last_peered":"2024-09-12T18:17:55.833275+0000","last_clean":"2024-09-12T18:17:55.833275+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:17:55.833275+0000","last_undegraded":"2024-09-12T18:17:55.833275+0000","last_fullsized":"2024-09-12T18:17:55.833275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:22.433973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":200,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834678+0000","last_change":"2024-09-12T18:17:43.870789+0000","last_active":"2024-09-12T18:17:55.834678+0000","last_peered":"2024-09-12T18:17:55.834678+0000","last_clean":"2024-09-12T18:17:55.834678+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:17:55.834678+0000","last_undegraded":"2024-09-12T18:17:55.834678+0000","last_fullsized":"2024-09-12T18:17:55.834678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:49.502247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840543+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:55.840543+0000","last_peered":"2024-09-12T18:17:55.840543+0000","last_clean":"2024-09-12T18:17:55.840543+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:55.840543+0000","last_undegraded":"2024-09-12T18:17:55.840543+0000","last_fullsized":"2024-09-12T18:17:55.840543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.847611+0000","last_change":"2024-09-12T18:17:54.840513+0000","last_active":"2024-09-12T18:17:54.847611+0000","last_peered":"2024-09-12T18:17:54.847611+0000","last_clean":"2024-09-12T18:17:54.847611+0000","last_became_active":"2024-09-12T18:17:54.838161+0000","last_became_peered":"2024-09-12T18:17:54.838161+0000","last_unstale":"2024-09-12T18:17:54.847611+0000","last_undegraded":"2024-09-12T18:17:54.847611+0000","last_fullsized":"2024-09-12T18:17:54.847611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:15.847135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841325+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:55.841325+0000","last_peered":"2024-09-12T18:17:55.841325+0000","last_clean":"2024-09-12T18:17:55.841325+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:55.841325+0000","last_undegraded":"2024-09-12T18:17:55.841325+0000","last_fullsized":"2024-09-12T18:17:55.841325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":163,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842264+0000","last_change":"2024-09-12T18:17:54.850699+0000","last_active":"2024-09-12T18:17:55.842264+0000","last_peered":"2024-09-12T18:17:55.842264+0000","last_clean":"2024-09-12T18:17:55.842264+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:17:55.842264+0000","last_undegraded":"2024-09-12T18:17:55.842264+0000","last_fullsized":"2024-09-12T18:17:55.842264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:42.033453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831765+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:55.831765+0000","last_peered":"2024-09-12T18:17:55.831765+0000","last_clean":"2024-09-12T18:17:55.831765+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:55.831765+0000","last_undegraded":"2024-09-12T18:17:55.831765+0000","last_fullsized":"2024-09-12T18:17:55.831765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":133,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.841720+0000","last_change":"2024-09-12T18:17:36.785578+0000","last_active":"2024-09-12T18:17:54.841720+0000","last_peered":"2024-09-12T18:17:54.841720+0000","last_clean":"2024-09-12T18:17:54.841720+0000","last_became_active":"2024-09-12T18:17:36.782643+0000","last_became_peered":"2024-09-12T18:17:36.782643+0000","last_unstale":"2024-09-12T18:17:54.841720+0000","last_undegraded":"2024-09-12T18:17:54.841720+0000","last_fullsized":"2024-09-12T18:17:54.841720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.694821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839256+0000","last_change":"2024-09-12T18:17:54.840249+0000","last_active":"2024-09-12T18:17:55.839256+0000","last_peered":"2024-09-12T18:17:55.839256+0000","last_clean":"2024-09-12T18:17:55.839256+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:17:55.839256+0000","last_undegraded":"2024-09-12T18:17:55.839256+0000","last_fullsized":"2024-09-12T18:17:55.839256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:47.078593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832620+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:55.832620+0000","last_peered":"2024-09-12T18:17:55.832620+0000","last_clean":"2024-09-12T18:17:55.832620+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:55.832620+0000","last_undegraded":"2024-09-12T18:17:55.832620+0000","last_fullsized":"2024-09-12T18:17:55.832620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833671+0000","last_change":"2024-09-12T18:17:52.823288+0000","last_active":"2024-09-12T18:17:55.833671+0000","last_peered":"2024-09-12T18:17:55.833671+0000","last_clean":"2024-09-12T18:17:55.833671+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:17:55.833671+0000","last_undegraded":"2024-09-12T18:17:55.833671+0000","last_fullsized":"2024-09-12T18:17:55.833671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:50.555729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833019+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:55.833019+0000","last_peered":"2024-09-12T18:17:55.833019+0000","last_clean":"2024-09-12T18:17:55.833019+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:55.833019+0000","last_undegraded":"2024-09-12T18:17:55.833019+0000","last_fullsized":"2024-09-12T18:17:55.833019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":122,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.835106+0000","last_change":"2024-09-12T18:17:36.781903+0000","last_active":"2024-09-12T18:17:54.835106+0000","last_peered":"2024-09-12T18:17:54.835106+0000","last_clean":"2024-09-12T18:17:54.835106+0000","last_became_active":"2024-09-12T18:17:36.780395+0000","last_became_peered":"2024-09-12T18:17:36.780395+0000","last_unstale":"2024-09-12T18:17:54.835106+0000","last_undegraded":"2024-09-12T18:17:54.835106+0000","last_fullsized":"2024-09-12T18:17:54.835106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:47.917209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833517+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:55.833517+0000","last_peered":"2024-09-12T18:17:55.833517+0000","last_clean":"2024-09-12T18:17:55.833517+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:55.833517+0000","last_undegraded":"2024-09-12T18:17:55.833517+0000","last_fullsized":"2024-09-12T18:17:55.833517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834514+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:55.834514+0000","last_peered":"2024-09-12T18:17:55.834514+0000","last_clean":"2024-09-12T18:17:55.834514+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:55.834514+0000","last_undegraded":"2024-09-12T18:17:55.834514+0000","last_fullsized":"2024-09-12T18:17:55.834514+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831562+0000","last_change":"2024-09-12T18:17:43.837788+0000","last_active":"2024-09-12T18:17:55.831562+0000","last_peered":"2024-09-12T18:17:55.831562+0000","last_clean":"2024-09-12T18:17:55.831562+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:17:55.831562+0000","last_undegraded":"2024-09-12T18:17:55.831562+0000","last_fullsized":"2024-09-12T18:17:55.831562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:27.702672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.199411+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:56.199411+0000","last_peered":"2024-09-12T18:17:56.199411+0000","last_clean":"2024-09-12T18:17:56.199411+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:56.199411+0000","last_undegraded":"2024-09-12T18:17:56.199411+0000","last_fullsized":"2024-09-12T18:17:56.199411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829047+0000","last_change":"2024-09-12T18:17:52.818955+0000","last_active":"2024-09-12T18:17:54.829047+0000","last_peered":"2024-09-12T18:17:54.829047+0000","last_clean":"2024-09-12T18:17:54.829047+0000","last_became_active":"2024-09-12T18:17:52.817406+0000","last_became_peered":"2024-09-12T18:17:52.817406+0000","last_unstale":"2024-09-12T18:17:54.829047+0000","last_undegraded":"2024-09-12T18:17:54.829047+0000","last_fullsized":"2024-09-12T18:17:54.829047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:45.648878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.829628+0000","last_change":"2024-09-12T18:17:52.819879+0000","last_active":"2024-09-12T18:17:54.829628+0000","last_peered":"2024-09-12T18:17:54.829628+0000","last_clean":"2024-09-12T18:17:54.829628+0000","last_became_active":"2024-09-12T18:17:52.817536+0000","last_became_peered":"2024-09-12T18:17:52.817536+0000","last_unstale":"2024-09-12T18:17:54.829628+0000","last_undegraded":"2024-09-12T18:17:54.829628+0000","last_fullsized":"2024-09-12T18:17:54.829628+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:34.143564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":27,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.851064+0000","last_change":"2024-09-12T18:17:54.846399+0000","last_active":"2024-09-12T18:17:54.851064+0000","last_peered":"2024-09-12T18:17:54.851064+0000","last_clean":"2024-09-12T18:17:54.851064+0000","last_became_active":"2024-09-12T18:17:54.844135+0000","last_became_peered":"2024-09-12T18:17:54.844135+0000","last_unstale":"2024-09-12T18:17:54.851064+0000","last_undegraded":"2024-09-12T18:17:54.851064+0000","last_fullsized":"2024-09-12T18:17:54.851064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:05.340600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837639+0000","last_change":"2024-09-12T18:17:54.854658+0000","last_active":"2024-09-12T18:17:55.837639+0000","last_peered":"2024-09-12T18:17:55.837639+0000","last_clean":"2024-09-12T18:17:55.837639+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:17:55.837639+0000","last_undegraded":"2024-09-12T18:17:55.837639+0000","last_fullsized":"2024-09-12T18:17:55.837639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.476487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844591+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:55.844591+0000","last_peered":"2024-09-12T18:17:55.844591+0000","last_clean":"2024-09-12T18:17:55.844591+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:55.844591+0000","last_undegraded":"2024-09-12T18:17:55.844591+0000","last_fullsized":"2024-09-12T18:17:55.844591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.850069+0000","last_change":"2024-09-12T18:17:54.849767+0000","last_active":"2024-09-12T18:17:54.850069+0000","last_peered":"2024-09-12T18:17:54.850069+0000","last_clean":"2024-09-12T18:17:54.850069+0000","last_became_active":"2024-09-12T18:17:54.847619+0000","last_became_peered":"2024-09-12T18:17:54.847619+0000","last_unstale":"2024-09-12T18:17:54.850069+0000","last_undegraded":"2024-09-12T18:17:54.850069+0000","last_fullsized":"2024-09-12T18:17:54.850069+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:19.089432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T18:17:54.828689+0000","last_change":"2024-09-12T18:17:52.818851+0000","last_active":"2024-09-12T18:17:54.828689+0000","last_peered":"2024-09-12T18:17:54.828689+0000","last_clean":"2024-09-12T18:17:54.828689+0000","last_became_active":"2024-09-12T18:17:52.817220+0000","last_became_peered":"2024-09-12T18:17:52.817220+0000","last_unstale":"2024-09-12T18:17:54.828689+0000","last_undegraded":"2024-09-12T18:17:54.828689+0000","last_fullsized":"2024-09-12T18:17:54.828689+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:53.284930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.836656+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:55.836656+0000","last_peered":"2024-09-12T18:17:55.836656+0000","last_clean":"2024-09-12T18:17:55.836656+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:55.836656+0000","last_undegraded":"2024-09-12T18:17:55.836656+0000","last_fullsized":"2024-09-12T18:17:55.836656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844194+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:55.844194+0000","last_peered":"2024-09-12T18:17:55.844194+0000","last_clean":"2024-09-12T18:17:55.844194+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:55.844194+0000","last_undegraded":"2024-09-12T18:17:55.844194+0000","last_fullsized":"2024-09-12T18:17:55.844194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":207,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834454+0000","last_change":"2024-09-12T18:17:43.861774+0000","last_active":"2024-09-12T18:17:55.834454+0000","last_peered":"2024-09-12T18:17:55.834454+0000","last_clean":"2024-09-12T18:17:55.834454+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:17:55.834454+0000","last_undegraded":"2024-09-12T18:17:55.834454+0000","last_fullsized":"2024-09-12T18:17:55.834454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:07.298644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280832,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091008,"statfs":{"total":96636764160,"available":96349192192,"internally_reserved":0,"allocated":1150976,"data_stored":1050347,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397368,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974472,"statfs":{"total":96636764160,"available":96229859328,"internally_reserved":0,"allocated":1077248,"data_stored":453953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285574,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46272,"kb_used_data":1128,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325568,"statfs":{"total":96636764160,"available":96589381632,"internally_reserved":0,"allocated":1155072,"data_stored":1049712,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:00.489 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:18:00.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T18:18:00.873 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:18:00.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:18:00.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:01.181 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:01.183 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:01.198 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-12T18:18:00.469910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724484,"kb_used_data":3312,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391036,"statfs":{"total":289910292480,"available":289168420864,"internally_reserved":0,"allocated":3391488,"data_stored":2558244,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001620"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216946+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:57.216946+0000","last_peered":"2024-09-12T18:17:57.216946+0000","last_clean":"2024-09-12T18:17:57.216946+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:57.216946+0000","last_undegraded":"2024-09-12T18:17:57.216946+0000","last_fullsized":"2024-09-12T18:17:57.216946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.230978+0000","last_change":"2024-09-12T18:17:57.230711+0000","last_active":"2024-09-12T18:17:57.230978+0000","last_peered":"2024-09-12T18:17:57.230978+0000","last_clean":"2024-09-12T18:17:57.230978+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:17:57.230978+0000","last_undegraded":"2024-09-12T18:17:57.230978+0000","last_fullsized":"2024-09-12T18:17:57.230978+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.119606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839554+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:55.839554+0000","last_peered":"2024-09-12T18:17:55.839554+0000","last_clean":"2024-09-12T18:17:55.839554+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:55.839554+0000","last_undegraded":"2024-09-12T18:17:55.839554+0000","last_fullsized":"2024-09-12T18:17:55.839554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841425+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:55.841425+0000","last_peered":"2024-09-12T18:17:55.841425+0000","last_clean":"2024-09-12T18:17:55.841425+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:55.841425+0000","last_undegraded":"2024-09-12T18:17:55.841425+0000","last_fullsized":"2024-09-12T18:17:55.841425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227088+0000","last_change":"2024-09-12T18:17:57.226865+0000","last_active":"2024-09-12T18:17:57.227088+0000","last_peered":"2024-09-12T18:17:57.227088+0000","last_clean":"2024-09-12T18:17:57.227088+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:17:57.227088+0000","last_undegraded":"2024-09-12T18:17:57.227088+0000","last_fullsized":"2024-09-12T18:17:57.227088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.312438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844144+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:55.844144+0000","last_peered":"2024-09-12T18:17:55.844144+0000","last_clean":"2024-09-12T18:17:55.844144+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:55.844144+0000","last_undegraded":"2024-09-12T18:17:55.844144+0000","last_fullsized":"2024-09-12T18:17:55.844144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837979+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:55.837979+0000","last_peered":"2024-09-12T18:17:55.837979+0000","last_clean":"2024-09-12T18:17:55.837979+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:55.837979+0000","last_undegraded":"2024-09-12T18:17:55.837979+0000","last_fullsized":"2024-09-12T18:17:55.837979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841664+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:55.841664+0000","last_peered":"2024-09-12T18:17:55.841664+0000","last_clean":"2024-09-12T18:17:55.841664+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:55.841664+0000","last_undegraded":"2024-09-12T18:17:55.841664+0000","last_fullsized":"2024-09-12T18:17:55.841664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832653+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:55.832653+0000","last_peered":"2024-09-12T18:17:55.832653+0000","last_clean":"2024-09-12T18:17:55.832653+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:55.832653+0000","last_undegraded":"2024-09-12T18:17:55.832653+0000","last_fullsized":"2024-09-12T18:17:55.832653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233648+0000","last_change":"2024-09-12T18:17:57.233340+0000","last_active":"2024-09-12T18:17:57.233648+0000","last_peered":"2024-09-12T18:17:57.233648+0000","last_clean":"2024-09-12T18:17:57.233648+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:17:57.233648+0000","last_undegraded":"2024-09-12T18:17:57.233648+0000","last_fullsized":"2024-09-12T18:17:57.233648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:33.474988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839824+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:55.839824+0000","last_peered":"2024-09-12T18:17:55.839824+0000","last_clean":"2024-09-12T18:17:55.839824+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:55.839824+0000","last_undegraded":"2024-09-12T18:17:55.839824+0000","last_fullsized":"2024-09-12T18:17:55.839824+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235182+0000","last_change":"2024-09-12T18:17:57.234956+0000","last_active":"2024-09-12T18:17:57.235182+0000","last_peered":"2024-09-12T18:17:57.235182+0000","last_clean":"2024-09-12T18:17:57.235182+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:17:57.235182+0000","last_undegraded":"2024-09-12T18:17:57.235182+0000","last_fullsized":"2024-09-12T18:17:57.235182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.824054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232361+0000","last_change":"2024-09-12T18:17:57.230917+0000","last_active":"2024-09-12T18:17:57.232361+0000","last_peered":"2024-09-12T18:17:57.232361+0000","last_clean":"2024-09-12T18:17:57.232361+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:17:57.232361+0000","last_undegraded":"2024-09-12T18:17:57.232361+0000","last_fullsized":"2024-09-12T18:17:57.232361+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:50.167605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844403+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:55.844403+0000","last_peered":"2024-09-12T18:17:55.844403+0000","last_clean":"2024-09-12T18:17:55.844403+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:55.844403+0000","last_undegraded":"2024-09-12T18:17:55.844403+0000","last_fullsized":"2024-09-12T18:17:55.844403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837492+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:55.837492+0000","last_peered":"2024-09-12T18:17:55.837492+0000","last_clean":"2024-09-12T18:17:55.837492+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:55.837492+0000","last_undegraded":"2024-09-12T18:17:55.837492+0000","last_fullsized":"2024-09-12T18:17:55.837492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842341+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:55.842341+0000","last_peered":"2024-09-12T18:17:55.842341+0000","last_clean":"2024-09-12T18:17:55.842341+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:55.842341+0000","last_undegraded":"2024-09-12T18:17:55.842341+0000","last_fullsized":"2024-09-12T18:17:55.842341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833940+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:55.833940+0000","last_peered":"2024-09-12T18:17:55.833940+0000","last_clean":"2024-09-12T18:17:55.833940+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:55.833940+0000","last_undegraded":"2024-09-12T18:17:55.833940+0000","last_fullsized":"2024-09-12T18:17:55.833940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227680+0000","last_change":"2024-09-12T18:17:57.227409+0000","last_active":"2024-09-12T18:17:57.227680+0000","last_peered":"2024-09-12T18:17:57.227680+0000","last_clean":"2024-09-12T18:17:57.227680+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:17:57.227680+0000","last_undegraded":"2024-09-12T18:17:57.227680+0000","last_fullsized":"2024-09-12T18:17:57.227680+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:53.730736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832908+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:55.832908+0000","last_peered":"2024-09-12T18:17:55.832908+0000","last_clean":"2024-09-12T18:17:55.832908+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:55.832908+0000","last_undegraded":"2024-09-12T18:17:55.832908+0000","last_fullsized":"2024-09-12T18:17:55.832908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841740+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:55.841740+0000","last_peered":"2024-09-12T18:17:55.841740+0000","last_clean":"2024-09-12T18:17:55.841740+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:55.841740+0000","last_undegraded":"2024-09-12T18:17:55.841740+0000","last_fullsized":"2024-09-12T18:17:55.841740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842094+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:55.842094+0000","last_peered":"2024-09-12T18:17:55.842094+0000","last_clean":"2024-09-12T18:17:55.842094+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:55.842094+0000","last_undegraded":"2024-09-12T18:17:55.842094+0000","last_fullsized":"2024-09-12T18:17:55.842094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220666+0000","last_change":"2024-09-12T18:17:57.220151+0000","last_active":"2024-09-12T18:17:57.220666+0000","last_peered":"2024-09-12T18:17:57.220666+0000","last_clean":"2024-09-12T18:17:57.220666+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:17:57.220666+0000","last_undegraded":"2024-09-12T18:17:57.220666+0000","last_fullsized":"2024-09-12T18:17:57.220666+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:02.044417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833863+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:55.833863+0000","last_peered":"2024-09-12T18:17:55.833863+0000","last_clean":"2024-09-12T18:17:55.833863+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:55.833863+0000","last_undegraded":"2024-09-12T18:17:55.833863+0000","last_fullsized":"2024-09-12T18:17:55.833863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220570+0000","last_change":"2024-09-12T18:17:57.220296+0000","last_active":"2024-09-12T18:17:57.220570+0000","last_peered":"2024-09-12T18:17:57.220570+0000","last_clean":"2024-09-12T18:17:57.220570+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:17:57.220570+0000","last_undegraded":"2024-09-12T18:17:57.220570+0000","last_fullsized":"2024-09-12T18:17:57.220570+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:21.286087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.214122+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:57.214122+0000","last_peered":"2024-09-12T18:17:57.214122+0000","last_clean":"2024-09-12T18:17:57.214122+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:57.214122+0000","last_undegraded":"2024-09-12T18:17:57.214122+0000","last_fullsized":"2024-09-12T18:17:57.214122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834825+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:55.834825+0000","last_peered":"2024-09-12T18:17:55.834825+0000","last_clean":"2024-09-12T18:17:55.834825+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:55.834825+0000","last_undegraded":"2024-09-12T18:17:55.834825+0000","last_fullsized":"2024-09-12T18:17:55.834825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838677+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:55.838677+0000","last_peered":"2024-09-12T18:17:55.838677+0000","last_clean":"2024-09-12T18:17:55.838677+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:55.838677+0000","last_undegraded":"2024-09-12T18:17:55.838677+0000","last_fullsized":"2024-09-12T18:17:55.838677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235784+0000","last_change":"2024-09-12T18:17:57.235643+0000","last_active":"2024-09-12T18:17:57.235784+0000","last_peered":"2024-09-12T18:17:57.235784+0000","last_clean":"2024-09-12T18:17:57.235784+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:17:57.235784+0000","last_undegraded":"2024-09-12T18:17:57.235784+0000","last_fullsized":"2024-09-12T18:17:57.235784+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:05.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832341+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:55.832341+0000","last_peered":"2024-09-12T18:17:55.832341+0000","last_clean":"2024-09-12T18:17:55.832341+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:55.832341+0000","last_undegraded":"2024-09-12T18:17:55.832341+0000","last_fullsized":"2024-09-12T18:17:55.832341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227093+0000","last_change":"2024-09-12T18:17:57.226832+0000","last_active":"2024-09-12T18:17:57.227093+0000","last_peered":"2024-09-12T18:17:57.227093+0000","last_clean":"2024-09-12T18:17:57.227093+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:17:57.227093+0000","last_undegraded":"2024-09-12T18:17:57.227093+0000","last_fullsized":"2024-09-12T18:17:57.227093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:59.362317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832906+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:55.832906+0000","last_peered":"2024-09-12T18:17:55.832906+0000","last_clean":"2024-09-12T18:17:55.832906+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:55.832906+0000","last_undegraded":"2024-09-12T18:17:55.832906+0000","last_fullsized":"2024-09-12T18:17:55.832906+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.843987+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:55.843987+0000","last_peered":"2024-09-12T18:17:55.843987+0000","last_clean":"2024-09-12T18:17:55.843987+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:55.843987+0000","last_undegraded":"2024-09-12T18:17:55.843987+0000","last_fullsized":"2024-09-12T18:17:55.843987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233319+0000","last_change":"2024-09-12T18:17:57.232930+0000","last_active":"2024-09-12T18:17:57.233319+0000","last_peered":"2024-09-12T18:17:57.233319+0000","last_clean":"2024-09-12T18:17:57.233319+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:17:57.233319+0000","last_undegraded":"2024-09-12T18:17:57.233319+0000","last_fullsized":"2024-09-12T18:17:57.233319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:01.904120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":176,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842381+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:55.842381+0000","last_peered":"2024-09-12T18:17:55.842381+0000","last_clean":"2024-09-12T18:17:55.842381+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:55.842381+0000","last_undegraded":"2024-09-12T18:17:55.842381+0000","last_fullsized":"2024-09-12T18:17:55.842381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224231+0000","last_change":"2024-09-12T18:17:57.223948+0000","last_active":"2024-09-12T18:17:57.224231+0000","last_peered":"2024-09-12T18:17:57.224231+0000","last_clean":"2024-09-12T18:17:57.224231+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:17:57.224231+0000","last_undegraded":"2024-09-12T18:17:57.224231+0000","last_fullsized":"2024-09-12T18:17:57.224231+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.983211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832603+0000","last_change":"2024-09-12T18:17:52.825472+0000","last_active":"2024-09-12T18:17:55.832603+0000","last_peered":"2024-09-12T18:17:55.832603+0000","last_clean":"2024-09-12T18:17:55.832603+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:17:55.832603+0000","last_undegraded":"2024-09-12T18:17:55.832603+0000","last_fullsized":"2024-09-12T18:17:55.832603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:11.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832539+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:55.832539+0000","last_peered":"2024-09-12T18:17:55.832539+0000","last_clean":"2024-09-12T18:17:55.832539+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:55.832539+0000","last_undegraded":"2024-09-12T18:17:55.832539+0000","last_fullsized":"2024-09-12T18:17:55.832539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.215322+0000","last_change":"2024-09-12T18:17:44.195812+0000","last_active":"2024-09-12T18:17:57.215322+0000","last_peered":"2024-09-12T18:17:57.215322+0000","last_clean":"2024-09-12T18:17:57.215322+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:17:57.215322+0000","last_undegraded":"2024-09-12T18:17:57.215322+0000","last_fullsized":"2024-09-12T18:17:57.215322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:15.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832918+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:55.832918+0000","last_peered":"2024-09-12T18:17:55.832918+0000","last_clean":"2024-09-12T18:17:55.832918+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:55.832918+0000","last_undegraded":"2024-09-12T18:17:55.832918+0000","last_fullsized":"2024-09-12T18:17:55.832918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:37.804558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":165,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844029+0000","last_change":"2024-09-12T18:17:54.850651+0000","last_active":"2024-09-12T18:17:55.844029+0000","last_peered":"2024-09-12T18:17:55.844029+0000","last_clean":"2024-09-12T18:17:55.844029+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:17:55.844029+0000","last_undegraded":"2024-09-12T18:17:55.844029+0000","last_fullsized":"2024-09-12T18:17:55.844029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:21.588951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839732+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:55.839732+0000","last_peered":"2024-09-12T18:17:55.839732+0000","last_clean":"2024-09-12T18:17:55.839732+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:55.839732+0000","last_undegraded":"2024-09-12T18:17:55.839732+0000","last_fullsized":"2024-09-12T18:17:55.839732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227511+0000","last_change":"2024-09-12T18:17:57.227263+0000","last_active":"2024-09-12T18:17:57.227511+0000","last_peered":"2024-09-12T18:17:57.227511+0000","last_clean":"2024-09-12T18:17:57.227511+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:17:57.227511+0000","last_undegraded":"2024-09-12T18:17:57.227511+0000","last_fullsized":"2024-09-12T18:17:57.227511+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:30.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226272+0000","last_change":"2024-09-12T18:17:57.225984+0000","last_active":"2024-09-12T18:17:57.226272+0000","last_peered":"2024-09-12T18:17:57.226272+0000","last_clean":"2024-09-12T18:17:57.226272+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:17:57.226272+0000","last_undegraded":"2024-09-12T18:17:57.226272+0000","last_fullsized":"2024-09-12T18:17:57.226272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:16.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.234686+0000","last_change":"2024-09-12T18:17:57.233612+0000","last_active":"2024-09-12T18:17:57.234686+0000","last_peered":"2024-09-12T18:17:57.234686+0000","last_clean":"2024-09-12T18:17:57.234686+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:17:57.234686+0000","last_undegraded":"2024-09-12T18:17:57.234686+0000","last_fullsized":"2024-09-12T18:17:57.234686+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:49.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842056+0000","last_change":"2024-09-12T18:17:43.850032+0000","last_active":"2024-09-12T18:17:55.842056+0000","last_peered":"2024-09-12T18:17:55.842056+0000","last_clean":"2024-09-12T18:17:55.842056+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:17:55.842056+0000","last_undegraded":"2024-09-12T18:17:55.842056+0000","last_fullsized":"2024-09-12T18:17:55.842056+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837482+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:55.837482+0000","last_peered":"2024-09-12T18:17:55.837482+0000","last_clean":"2024-09-12T18:17:55.837482+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:55.837482+0000","last_undegraded":"2024-09-12T18:17:55.837482+0000","last_fullsized":"2024-09-12T18:17:55.837482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842562+0000","last_change":"2024-09-12T18:17:54.848137+0000","last_active":"2024-09-12T18:17:55.842562+0000","last_peered":"2024-09-12T18:17:55.842562+0000","last_clean":"2024-09-12T18:17:55.842562+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:17:55.842562+0000","last_undegraded":"2024-09-12T18:17:55.842562+0000","last_fullsized":"2024-09-12T18:17:55.842562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:47.582059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832054+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:55.832054+0000","last_peered":"2024-09-12T18:17:55.832054+0000","last_clean":"2024-09-12T18:17:55.832054+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:55.832054+0000","last_undegraded":"2024-09-12T18:17:55.832054+0000","last_fullsized":"2024-09-12T18:17:55.832054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834047+0000","last_change":"2024-09-12T18:17:43.846663+0000","last_active":"2024-09-12T18:17:55.834047+0000","last_peered":"2024-09-12T18:17:55.834047+0000","last_clean":"2024-09-12T18:17:55.834047+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:17:55.834047+0000","last_undegraded":"2024-09-12T18:17:55.834047+0000","last_fullsized":"2024-09-12T18:17:55.834047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:52.288114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838202+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:55.838202+0000","last_peered":"2024-09-12T18:17:55.838202+0000","last_clean":"2024-09-12T18:17:55.838202+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:55.838202+0000","last_undegraded":"2024-09-12T18:17:55.838202+0000","last_fullsized":"2024-09-12T18:17:55.838202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844793+0000","last_change":"2024-09-12T18:17:54.844194+0000","last_active":"2024-09-12T18:17:55.844793+0000","last_peered":"2024-09-12T18:17:55.844793+0000","last_clean":"2024-09-12T18:17:55.844793+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:17:55.844793+0000","last_undegraded":"2024-09-12T18:17:55.844793+0000","last_fullsized":"2024-09-12T18:17:55.844793+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:26.010260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840710+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:55.840710+0000","last_peered":"2024-09-12T18:17:55.840710+0000","last_clean":"2024-09-12T18:17:55.840710+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:55.840710+0000","last_undegraded":"2024-09-12T18:17:55.840710+0000","last_fullsized":"2024-09-12T18:17:55.840710+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232120+0000","last_change":"2024-09-12T18:17:57.231837+0000","last_active":"2024-09-12T18:17:57.232120+0000","last_peered":"2024-09-12T18:17:57.232120+0000","last_clean":"2024-09-12T18:17:57.232120+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:17:57.232120+0000","last_undegraded":"2024-09-12T18:17:57.232120+0000","last_fullsized":"2024-09-12T18:17:57.232120+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:27.028425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232131+0000","last_change":"2024-09-12T18:17:57.231804+0000","last_active":"2024-09-12T18:17:57.232131+0000","last_peered":"2024-09-12T18:17:57.232131+0000","last_clean":"2024-09-12T18:17:57.232131+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:17:57.232131+0000","last_undegraded":"2024-09-12T18:17:57.232131+0000","last_fullsized":"2024-09-12T18:17:57.232131+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:56.591750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833175+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:55.833175+0000","last_peered":"2024-09-12T18:17:55.833175+0000","last_clean":"2024-09-12T18:17:55.833175+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:55.833175+0000","last_undegraded":"2024-09-12T18:17:55.833175+0000","last_fullsized":"2024-09-12T18:17:55.833175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839718+0000","last_change":"2024-09-12T18:17:46.785093+0000","last_active":"2024-09-12T18:17:55.839718+0000","last_peered":"2024-09-12T18:17:55.839718+0000","last_clean":"2024-09-12T18:17:55.839718+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:17:55.839718+0000","last_undegraded":"2024-09-12T18:17:55.839718+0000","last_fullsized":"2024-09-12T18:17:55.839718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:07.703117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844012+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:55.844012+0000","last_peered":"2024-09-12T18:17:55.844012+0000","last_clean":"2024-09-12T18:17:55.844012+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:55.844012+0000","last_undegraded":"2024-09-12T18:17:55.844012+0000","last_fullsized":"2024-09-12T18:17:55.844012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833432+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:55.833432+0000","last_peered":"2024-09-12T18:17:55.833432+0000","last_clean":"2024-09-12T18:17:55.833432+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:55.833432+0000","last_undegraded":"2024-09-12T18:17:55.833432+0000","last_fullsized":"2024-09-12T18:17:55.833432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842366+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:55.842366+0000","last_peered":"2024-09-12T18:17:55.842366+0000","last_clean":"2024-09-12T18:17:55.842366+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:55.842366+0000","last_undegraded":"2024-09-12T18:17:55.842366+0000","last_fullsized":"2024-09-12T18:17:55.842366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844328+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:55.844328+0000","last_peered":"2024-09-12T18:17:55.844328+0000","last_clean":"2024-09-12T18:17:55.844328+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:55.844328+0000","last_undegraded":"2024-09-12T18:17:55.844328+0000","last_fullsized":"2024-09-12T18:17:55.844328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":191,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831259+0000","last_change":"2024-09-12T18:17:43.837153+0000","last_active":"2024-09-12T18:17:55.831259+0000","last_peered":"2024-09-12T18:17:55.831259+0000","last_clean":"2024-09-12T18:17:55.831259+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:17:55.831259+0000","last_undegraded":"2024-09-12T18:17:55.831259+0000","last_fullsized":"2024-09-12T18:17:55.831259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:44.908861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216973+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:57.216973+0000","last_peered":"2024-09-12T18:17:57.216973+0000","last_clean":"2024-09-12T18:17:57.216973+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:57.216973+0000","last_undegraded":"2024-09-12T18:17:57.216973+0000","last_fullsized":"2024-09-12T18:17:57.216973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834958+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:55.834958+0000","last_peered":"2024-09-12T18:17:55.834958+0000","last_clean":"2024-09-12T18:17:55.834958+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:55.834958+0000","last_undegraded":"2024-09-12T18:17:55.834958+0000","last_fullsized":"2024-09-12T18:17:55.834958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229674+0000","last_change":"2024-09-12T18:17:57.229183+0000","last_active":"2024-09-12T18:17:57.229674+0000","last_peered":"2024-09-12T18:17:57.229674+0000","last_clean":"2024-09-12T18:17:57.229674+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:17:57.229674+0000","last_undegraded":"2024-09-12T18:17:57.229674+0000","last_fullsized":"2024-09-12T18:17:57.229674+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:49.982893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833187+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:55.833187+0000","last_peered":"2024-09-12T18:17:55.833187+0000","last_clean":"2024-09-12T18:17:55.833187+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:55.833187+0000","last_undegraded":"2024-09-12T18:17:55.833187+0000","last_fullsized":"2024-09-12T18:17:55.833187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844868+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:55.844868+0000","last_peered":"2024-09-12T18:17:55.844868+0000","last_clean":"2024-09-12T18:17:55.844868+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:55.844868+0000","last_undegraded":"2024-09-12T18:17:55.844868+0000","last_fullsized":"2024-09-12T18:17:55.844868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842674+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:55.842674+0000","last_peered":"2024-09-12T18:17:55.842674+0000","last_clean":"2024-09-12T18:17:55.842674+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:55.842674+0000","last_undegraded":"2024-09-12T18:17:55.842674+0000","last_fullsized":"2024-09-12T18:17:55.842674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837309+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:55.837309+0000","last_peered":"2024-09-12T18:17:55.837309+0000","last_clean":"2024-09-12T18:17:55.837309+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:55.837309+0000","last_undegraded":"2024-09-12T18:17:55.837309+0000","last_fullsized":"2024-09-12T18:17:55.837309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842598+0000","last_change":"2024-09-12T18:17:54.845043+0000","last_active":"2024-09-12T18:17:55.842598+0000","last_peered":"2024-09-12T18:17:55.842598+0000","last_clean":"2024-09-12T18:17:55.842598+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:17:55.842598+0000","last_undegraded":"2024-09-12T18:17:55.842598+0000","last_fullsized":"2024-09-12T18:17:55.842598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:09.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837568+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:55.837568+0000","last_peered":"2024-09-12T18:17:55.837568+0000","last_clean":"2024-09-12T18:17:55.837568+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:55.837568+0000","last_undegraded":"2024-09-12T18:17:55.837568+0000","last_fullsized":"2024-09-12T18:17:55.837568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220650+0000","last_change":"2024-09-12T18:17:57.220336+0000","last_active":"2024-09-12T18:17:57.220650+0000","last_peered":"2024-09-12T18:17:57.220650+0000","last_clean":"2024-09-12T18:17:57.220650+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:17:57.220650+0000","last_undegraded":"2024-09-12T18:17:57.220650+0000","last_fullsized":"2024-09-12T18:17:57.220650+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:32.842004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837464+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:55.837464+0000","last_peered":"2024-09-12T18:17:55.837464+0000","last_clean":"2024-09-12T18:17:55.837464+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:55.837464+0000","last_undegraded":"2024-09-12T18:17:55.837464+0000","last_fullsized":"2024-09-12T18:17:55.837464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.217254+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:57.217254+0000","last_peered":"2024-09-12T18:17:57.217254+0000","last_clean":"2024-09-12T18:17:57.217254+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:57.217254+0000","last_undegraded":"2024-09-12T18:17:57.217254+0000","last_fullsized":"2024-09-12T18:17:57.217254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232147+0000","last_change":"2024-09-12T18:17:57.231857+0000","last_active":"2024-09-12T18:17:57.232147+0000","last_peered":"2024-09-12T18:17:57.232147+0000","last_clean":"2024-09-12T18:17:57.232147+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:17:57.232147+0000","last_undegraded":"2024-09-12T18:17:57.232147+0000","last_fullsized":"2024-09-12T18:17:57.232147+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:28.991322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834223+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:55.834223+0000","last_peered":"2024-09-12T18:17:55.834223+0000","last_clean":"2024-09-12T18:17:55.834223+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:55.834223+0000","last_undegraded":"2024-09-12T18:17:55.834223+0000","last_fullsized":"2024-09-12T18:17:55.834223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832472+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:55.832472+0000","last_peered":"2024-09-12T18:17:55.832472+0000","last_clean":"2024-09-12T18:17:55.832472+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:55.832472+0000","last_undegraded":"2024-09-12T18:17:55.832472+0000","last_fullsized":"2024-09-12T18:17:55.832472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833275+0000","last_change":"2024-09-12T18:17:43.838249+0000","last_active":"2024-09-12T18:17:55.833275+0000","last_peered":"2024-09-12T18:17:55.833275+0000","last_clean":"2024-09-12T18:17:55.833275+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:17:55.833275+0000","last_undegraded":"2024-09-12T18:17:55.833275+0000","last_fullsized":"2024-09-12T18:17:55.833275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:22.433973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":200,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834678+0000","last_change":"2024-09-12T18:17:43.870789+0000","last_active":"2024-09-12T18:17:55.834678+0000","last_peered":"2024-09-12T18:17:55.834678+0000","last_clean":"2024-09-12T18:17:55.834678+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:17:55.834678+0000","last_undegraded":"2024-09-12T18:17:55.834678+0000","last_fullsized":"2024-09-12T18:17:55.834678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:49.502247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840543+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:55.840543+0000","last_peered":"2024-09-12T18:17:55.840543+0000","last_clean":"2024-09-12T18:17:55.840543+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:55.840543+0000","last_undegraded":"2024-09-12T18:17:55.840543+0000","last_fullsized":"2024-09-12T18:17:55.840543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226762+0000","last_change":"2024-09-12T18:17:57.226471+0000","last_active":"2024-09-12T18:17:57.226762+0000","last_peered":"2024-09-12T18:17:57.226762+0000","last_clean":"2024-09-12T18:17:57.226762+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:17:57.226762+0000","last_undegraded":"2024-09-12T18:17:57.226762+0000","last_fullsized":"2024-09-12T18:17:57.226762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:17.288097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841325+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:55.841325+0000","last_peered":"2024-09-12T18:17:55.841325+0000","last_clean":"2024-09-12T18:17:55.841325+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:55.841325+0000","last_undegraded":"2024-09-12T18:17:55.841325+0000","last_fullsized":"2024-09-12T18:17:55.841325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":163,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842264+0000","last_change":"2024-09-12T18:17:54.850699+0000","last_active":"2024-09-12T18:17:55.842264+0000","last_peered":"2024-09-12T18:17:55.842264+0000","last_clean":"2024-09-12T18:17:55.842264+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:17:55.842264+0000","last_undegraded":"2024-09-12T18:17:55.842264+0000","last_fullsized":"2024-09-12T18:17:55.842264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:42.033453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831765+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:55.831765+0000","last_peered":"2024-09-12T18:17:55.831765+0000","last_clean":"2024-09-12T18:17:55.831765+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:55.831765+0000","last_undegraded":"2024-09-12T18:17:55.831765+0000","last_fullsized":"2024-09-12T18:17:55.831765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232331+0000","last_change":"2024-09-12T18:17:57.232052+0000","last_active":"2024-09-12T18:17:57.232331+0000","last_peered":"2024-09-12T18:17:57.232331+0000","last_clean":"2024-09-12T18:17:57.232331+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:17:57.232331+0000","last_undegraded":"2024-09-12T18:17:57.232331+0000","last_fullsized":"2024-09-12T18:17:57.232331+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:45.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839256+0000","last_change":"2024-09-12T18:17:54.840249+0000","last_active":"2024-09-12T18:17:55.839256+0000","last_peered":"2024-09-12T18:17:55.839256+0000","last_clean":"2024-09-12T18:17:55.839256+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:17:55.839256+0000","last_undegraded":"2024-09-12T18:17:55.839256+0000","last_fullsized":"2024-09-12T18:17:55.839256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:47.078593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832620+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:55.832620+0000","last_peered":"2024-09-12T18:17:55.832620+0000","last_clean":"2024-09-12T18:17:55.832620+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:55.832620+0000","last_undegraded":"2024-09-12T18:17:55.832620+0000","last_fullsized":"2024-09-12T18:17:55.832620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833671+0000","last_change":"2024-09-12T18:17:52.823288+0000","last_active":"2024-09-12T18:17:55.833671+0000","last_peered":"2024-09-12T18:17:55.833671+0000","last_clean":"2024-09-12T18:17:55.833671+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:17:55.833671+0000","last_undegraded":"2024-09-12T18:17:55.833671+0000","last_fullsized":"2024-09-12T18:17:55.833671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:50.555729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833019+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:55.833019+0000","last_peered":"2024-09-12T18:17:55.833019+0000","last_clean":"2024-09-12T18:17:55.833019+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:55.833019+0000","last_undegraded":"2024-09-12T18:17:55.833019+0000","last_fullsized":"2024-09-12T18:17:55.833019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224059+0000","last_change":"2024-09-12T18:17:57.223771+0000","last_active":"2024-09-12T18:17:57.224059+0000","last_peered":"2024-09-12T18:17:57.224059+0000","last_clean":"2024-09-12T18:17:57.224059+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:17:57.224059+0000","last_undegraded":"2024-09-12T18:17:57.224059+0000","last_fullsized":"2024-09-12T18:17:57.224059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:16.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833517+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:55.833517+0000","last_peered":"2024-09-12T18:17:55.833517+0000","last_clean":"2024-09-12T18:17:55.833517+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:55.833517+0000","last_undegraded":"2024-09-12T18:17:55.833517+0000","last_fullsized":"2024-09-12T18:17:55.833517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834514+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:55.834514+0000","last_peered":"2024-09-12T18:17:55.834514+0000","last_clean":"2024-09-12T18:17:55.834514+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:55.834514+0000","last_undegraded":"2024-09-12T18:17:55.834514+0000","last_fullsized":"2024-09-12T18:17:55.834514+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831562+0000","last_change":"2024-09-12T18:17:43.837788+0000","last_active":"2024-09-12T18:17:55.831562+0000","last_peered":"2024-09-12T18:17:55.831562+0000","last_clean":"2024-09-12T18:17:55.831562+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:17:55.831562+0000","last_undegraded":"2024-09-12T18:17:55.831562+0000","last_fullsized":"2024-09-12T18:17:55.831562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:27.702672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.213116+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:57.213116+0000","last_peered":"2024-09-12T18:17:57.213116+0000","last_clean":"2024-09-12T18:17:57.213116+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:57.213116+0000","last_undegraded":"2024-09-12T18:17:57.213116+0000","last_fullsized":"2024-09-12T18:17:57.213116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226092+0000","last_change":"2024-09-12T18:17:57.224877+0000","last_active":"2024-09-12T18:17:57.226092+0000","last_peered":"2024-09-12T18:17:57.226092+0000","last_clean":"2024-09-12T18:17:57.226092+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:17:57.226092+0000","last_undegraded":"2024-09-12T18:17:57.226092+0000","last_fullsized":"2024-09-12T18:17:57.226092+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:50.751782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229368+0000","last_change":"2024-09-12T18:17:57.227693+0000","last_active":"2024-09-12T18:17:57.229368+0000","last_peered":"2024-09-12T18:17:57.229368+0000","last_clean":"2024-09-12T18:17:57.229368+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:17:57.229368+0000","last_undegraded":"2024-09-12T18:17:57.229368+0000","last_fullsized":"2024-09-12T18:17:57.229368+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.861398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224859+0000","last_change":"2024-09-12T18:17:57.224577+0000","last_active":"2024-09-12T18:17:57.224859+0000","last_peered":"2024-09-12T18:17:57.224859+0000","last_clean":"2024-09-12T18:17:57.224859+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:17:57.224859+0000","last_undegraded":"2024-09-12T18:17:57.224859+0000","last_fullsized":"2024-09-12T18:17:57.224859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:27.343760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837639+0000","last_change":"2024-09-12T18:17:54.854658+0000","last_active":"2024-09-12T18:17:55.837639+0000","last_peered":"2024-09-12T18:17:55.837639+0000","last_clean":"2024-09-12T18:17:55.837639+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:17:55.837639+0000","last_undegraded":"2024-09-12T18:17:55.837639+0000","last_fullsized":"2024-09-12T18:17:55.837639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.476487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844591+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:55.844591+0000","last_peered":"2024-09-12T18:17:55.844591+0000","last_clean":"2024-09-12T18:17:55.844591+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:55.844591+0000","last_undegraded":"2024-09-12T18:17:55.844591+0000","last_fullsized":"2024-09-12T18:17:55.844591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224687+0000","last_change":"2024-09-12T18:17:57.224380+0000","last_active":"2024-09-12T18:17:57.224687+0000","last_peered":"2024-09-12T18:17:57.224687+0000","last_clean":"2024-09-12T18:17:57.224687+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:17:57.224687+0000","last_undegraded":"2024-09-12T18:17:57.224687+0000","last_fullsized":"2024-09-12T18:17:57.224687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:07.158110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224203+0000","last_change":"2024-09-12T18:17:57.223910+0000","last_active":"2024-09-12T18:17:57.224203+0000","last_peered":"2024-09-12T18:17:57.224203+0000","last_clean":"2024-09-12T18:17:57.224203+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:17:57.224203+0000","last_undegraded":"2024-09-12T18:17:57.224203+0000","last_fullsized":"2024-09-12T18:17:57.224203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:01.950899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.836656+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:55.836656+0000","last_peered":"2024-09-12T18:17:55.836656+0000","last_clean":"2024-09-12T18:17:55.836656+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:55.836656+0000","last_undegraded":"2024-09-12T18:17:55.836656+0000","last_fullsized":"2024-09-12T18:17:55.836656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844194+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:55.844194+0000","last_peered":"2024-09-12T18:17:55.844194+0000","last_clean":"2024-09-12T18:17:55.844194+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:55.844194+0000","last_undegraded":"2024-09-12T18:17:55.844194+0000","last_fullsized":"2024-09-12T18:17:55.844194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":207,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834454+0000","last_change":"2024-09-12T18:17:43.861774+0000","last_active":"2024-09-12T18:17:55.834454+0000","last_peered":"2024-09-12T18:17:55.834454+0000","last_clean":"2024-09-12T18:17:55.834454+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:17:55.834454+0000","last_undegraded":"2024-09-12T18:17:55.834454+0000","last_fullsized":"2024-09-12T18:17:55.834454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:07.298644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280832,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091008,"statfs":{"total":96636764160,"available":96349192192,"internally_reserved":0,"allocated":1150976,"data_stored":1050347,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397368,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974472,"statfs":{"total":96636764160,"available":96229859328,"internally_reserved":0,"allocated":1077248,"data_stored":453953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285575,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46284,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325556,"statfs":{"total":96636764160,"available":96589369344,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:01.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:01.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:01.553 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:01.570 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-12T18:18:00.469910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724484,"kb_used_data":3312,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391036,"statfs":{"total":289910292480,"available":289168420864,"internally_reserved":0,"allocated":3391488,"data_stored":2558244,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001620"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216946+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:57.216946+0000","last_peered":"2024-09-12T18:17:57.216946+0000","last_clean":"2024-09-12T18:17:57.216946+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:57.216946+0000","last_undegraded":"2024-09-12T18:17:57.216946+0000","last_fullsized":"2024-09-12T18:17:57.216946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.230978+0000","last_change":"2024-09-12T18:17:57.230711+0000","last_active":"2024-09-12T18:17:57.230978+0000","last_peered":"2024-09-12T18:17:57.230978+0000","last_clean":"2024-09-12T18:17:57.230978+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:17:57.230978+0000","last_undegraded":"2024-09-12T18:17:57.230978+0000","last_fullsized":"2024-09-12T18:17:57.230978+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.119606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839554+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:55.839554+0000","last_peered":"2024-09-12T18:17:55.839554+0000","last_clean":"2024-09-12T18:17:55.839554+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:55.839554+0000","last_undegraded":"2024-09-12T18:17:55.839554+0000","last_fullsized":"2024-09-12T18:17:55.839554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841425+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:55.841425+0000","last_peered":"2024-09-12T18:17:55.841425+0000","last_clean":"2024-09-12T18:17:55.841425+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:55.841425+0000","last_undegraded":"2024-09-12T18:17:55.841425+0000","last_fullsized":"2024-09-12T18:17:55.841425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227088+0000","last_change":"2024-09-12T18:17:57.226865+0000","last_active":"2024-09-12T18:17:57.227088+0000","last_peered":"2024-09-12T18:17:57.227088+0000","last_clean":"2024-09-12T18:17:57.227088+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:17:57.227088+0000","last_undegraded":"2024-09-12T18:17:57.227088+0000","last_fullsized":"2024-09-12T18:17:57.227088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.312438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844144+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:55.844144+0000","last_peered":"2024-09-12T18:17:55.844144+0000","last_clean":"2024-09-12T18:17:55.844144+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:55.844144+0000","last_undegraded":"2024-09-12T18:17:55.844144+0000","last_fullsized":"2024-09-12T18:17:55.844144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837979+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:55.837979+0000","last_peered":"2024-09-12T18:17:55.837979+0000","last_clean":"2024-09-12T18:17:55.837979+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:55.837979+0000","last_undegraded":"2024-09-12T18:17:55.837979+0000","last_fullsized":"2024-09-12T18:17:55.837979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841664+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:55.841664+0000","last_peered":"2024-09-12T18:17:55.841664+0000","last_clean":"2024-09-12T18:17:55.841664+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:55.841664+0000","last_undegraded":"2024-09-12T18:17:55.841664+0000","last_fullsized":"2024-09-12T18:17:55.841664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832653+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:55.832653+0000","last_peered":"2024-09-12T18:17:55.832653+0000","last_clean":"2024-09-12T18:17:55.832653+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:55.832653+0000","last_undegraded":"2024-09-12T18:17:55.832653+0000","last_fullsized":"2024-09-12T18:17:55.832653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233648+0000","last_change":"2024-09-12T18:17:57.233340+0000","last_active":"2024-09-12T18:17:57.233648+0000","last_peered":"2024-09-12T18:17:57.233648+0000","last_clean":"2024-09-12T18:17:57.233648+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:17:57.233648+0000","last_undegraded":"2024-09-12T18:17:57.233648+0000","last_fullsized":"2024-09-12T18:17:57.233648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:33.474988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839824+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:55.839824+0000","last_peered":"2024-09-12T18:17:55.839824+0000","last_clean":"2024-09-12T18:17:55.839824+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:55.839824+0000","last_undegraded":"2024-09-12T18:17:55.839824+0000","last_fullsized":"2024-09-12T18:17:55.839824+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235182+0000","last_change":"2024-09-12T18:17:57.234956+0000","last_active":"2024-09-12T18:17:57.235182+0000","last_peered":"2024-09-12T18:17:57.235182+0000","last_clean":"2024-09-12T18:17:57.235182+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:17:57.235182+0000","last_undegraded":"2024-09-12T18:17:57.235182+0000","last_fullsized":"2024-09-12T18:17:57.235182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.824054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232361+0000","last_change":"2024-09-12T18:17:57.230917+0000","last_active":"2024-09-12T18:17:57.232361+0000","last_peered":"2024-09-12T18:17:57.232361+0000","last_clean":"2024-09-12T18:17:57.232361+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:17:57.232361+0000","last_undegraded":"2024-09-12T18:17:57.232361+0000","last_fullsized":"2024-09-12T18:17:57.232361+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:50.167605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844403+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:55.844403+0000","last_peered":"2024-09-12T18:17:55.844403+0000","last_clean":"2024-09-12T18:17:55.844403+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:55.844403+0000","last_undegraded":"2024-09-12T18:17:55.844403+0000","last_fullsized":"2024-09-12T18:17:55.844403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837492+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:55.837492+0000","last_peered":"2024-09-12T18:17:55.837492+0000","last_clean":"2024-09-12T18:17:55.837492+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:55.837492+0000","last_undegraded":"2024-09-12T18:17:55.837492+0000","last_fullsized":"2024-09-12T18:17:55.837492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842341+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:55.842341+0000","last_peered":"2024-09-12T18:17:55.842341+0000","last_clean":"2024-09-12T18:17:55.842341+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:55.842341+0000","last_undegraded":"2024-09-12T18:17:55.842341+0000","last_fullsized":"2024-09-12T18:17:55.842341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833940+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:55.833940+0000","last_peered":"2024-09-12T18:17:55.833940+0000","last_clean":"2024-09-12T18:17:55.833940+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:55.833940+0000","last_undegraded":"2024-09-12T18:17:55.833940+0000","last_fullsized":"2024-09-12T18:17:55.833940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227680+0000","last_change":"2024-09-12T18:17:57.227409+0000","last_active":"2024-09-12T18:17:57.227680+0000","last_peered":"2024-09-12T18:17:57.227680+0000","last_clean":"2024-09-12T18:17:57.227680+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:17:57.227680+0000","last_undegraded":"2024-09-12T18:17:57.227680+0000","last_fullsized":"2024-09-12T18:17:57.227680+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:53.730736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832908+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:55.832908+0000","last_peered":"2024-09-12T18:17:55.832908+0000","last_clean":"2024-09-12T18:17:55.832908+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:55.832908+0000","last_undegraded":"2024-09-12T18:17:55.832908+0000","last_fullsized":"2024-09-12T18:17:55.832908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841740+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:55.841740+0000","last_peered":"2024-09-12T18:17:55.841740+0000","last_clean":"2024-09-12T18:17:55.841740+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:55.841740+0000","last_undegraded":"2024-09-12T18:17:55.841740+0000","last_fullsized":"2024-09-12T18:17:55.841740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842094+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:55.842094+0000","last_peered":"2024-09-12T18:17:55.842094+0000","last_clean":"2024-09-12T18:17:55.842094+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:55.842094+0000","last_undegraded":"2024-09-12T18:17:55.842094+0000","last_fullsized":"2024-09-12T18:17:55.842094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220666+0000","last_change":"2024-09-12T18:17:57.220151+0000","last_active":"2024-09-12T18:17:57.220666+0000","last_peered":"2024-09-12T18:17:57.220666+0000","last_clean":"2024-09-12T18:17:57.220666+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:17:57.220666+0000","last_undegraded":"2024-09-12T18:17:57.220666+0000","last_fullsized":"2024-09-12T18:17:57.220666+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:02.044417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833863+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:55.833863+0000","last_peered":"2024-09-12T18:17:55.833863+0000","last_clean":"2024-09-12T18:17:55.833863+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:55.833863+0000","last_undegraded":"2024-09-12T18:17:55.833863+0000","last_fullsized":"2024-09-12T18:17:55.833863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220570+0000","last_change":"2024-09-12T18:17:57.220296+0000","last_active":"2024-09-12T18:17:57.220570+0000","last_peered":"2024-09-12T18:17:57.220570+0000","last_clean":"2024-09-12T18:17:57.220570+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:17:57.220570+0000","last_undegraded":"2024-09-12T18:17:57.220570+0000","last_fullsized":"2024-09-12T18:17:57.220570+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:21.286087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.214122+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:57.214122+0000","last_peered":"2024-09-12T18:17:57.214122+0000","last_clean":"2024-09-12T18:17:57.214122+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:57.214122+0000","last_undegraded":"2024-09-12T18:17:57.214122+0000","last_fullsized":"2024-09-12T18:17:57.214122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834825+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:55.834825+0000","last_peered":"2024-09-12T18:17:55.834825+0000","last_clean":"2024-09-12T18:17:55.834825+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:55.834825+0000","last_undegraded":"2024-09-12T18:17:55.834825+0000","last_fullsized":"2024-09-12T18:17:55.834825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838677+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:55.838677+0000","last_peered":"2024-09-12T18:17:55.838677+0000","last_clean":"2024-09-12T18:17:55.838677+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:55.838677+0000","last_undegraded":"2024-09-12T18:17:55.838677+0000","last_fullsized":"2024-09-12T18:17:55.838677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235784+0000","last_change":"2024-09-12T18:17:57.235643+0000","last_active":"2024-09-12T18:17:57.235784+0000","last_peered":"2024-09-12T18:17:57.235784+0000","last_clean":"2024-09-12T18:17:57.235784+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:17:57.235784+0000","last_undegraded":"2024-09-12T18:17:57.235784+0000","last_fullsized":"2024-09-12T18:17:57.235784+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:05.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832341+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:55.832341+0000","last_peered":"2024-09-12T18:17:55.832341+0000","last_clean":"2024-09-12T18:17:55.832341+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:55.832341+0000","last_undegraded":"2024-09-12T18:17:55.832341+0000","last_fullsized":"2024-09-12T18:17:55.832341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227093+0000","last_change":"2024-09-12T18:17:57.226832+0000","last_active":"2024-09-12T18:17:57.227093+0000","last_peered":"2024-09-12T18:17:57.227093+0000","last_clean":"2024-09-12T18:17:57.227093+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:17:57.227093+0000","last_undegraded":"2024-09-12T18:17:57.227093+0000","last_fullsized":"2024-09-12T18:17:57.227093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:59.362317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832906+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:55.832906+0000","last_peered":"2024-09-12T18:17:55.832906+0000","last_clean":"2024-09-12T18:17:55.832906+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:55.832906+0000","last_undegraded":"2024-09-12T18:17:55.832906+0000","last_fullsized":"2024-09-12T18:17:55.832906+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.843987+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:55.843987+0000","last_peered":"2024-09-12T18:17:55.843987+0000","last_clean":"2024-09-12T18:17:55.843987+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:55.843987+0000","last_undegraded":"2024-09-12T18:17:55.843987+0000","last_fullsized":"2024-09-12T18:17:55.843987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233319+0000","last_change":"2024-09-12T18:17:57.232930+0000","last_active":"2024-09-12T18:17:57.233319+0000","last_peered":"2024-09-12T18:17:57.233319+0000","last_clean":"2024-09-12T18:17:57.233319+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:17:57.233319+0000","last_undegraded":"2024-09-12T18:17:57.233319+0000","last_fullsized":"2024-09-12T18:17:57.233319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:01.904120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":176,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842381+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:55.842381+0000","last_peered":"2024-09-12T18:17:55.842381+0000","last_clean":"2024-09-12T18:17:55.842381+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:55.842381+0000","last_undegraded":"2024-09-12T18:17:55.842381+0000","last_fullsized":"2024-09-12T18:17:55.842381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224231+0000","last_change":"2024-09-12T18:17:57.223948+0000","last_active":"2024-09-12T18:17:57.224231+0000","last_peered":"2024-09-12T18:17:57.224231+0000","last_clean":"2024-09-12T18:17:57.224231+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:17:57.224231+0000","last_undegraded":"2024-09-12T18:17:57.224231+0000","last_fullsized":"2024-09-12T18:17:57.224231+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.983211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832603+0000","last_change":"2024-09-12T18:17:52.825472+0000","last_active":"2024-09-12T18:17:55.832603+0000","last_peered":"2024-09-12T18:17:55.832603+0000","last_clean":"2024-09-12T18:17:55.832603+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:17:55.832603+0000","last_undegraded":"2024-09-12T18:17:55.832603+0000","last_fullsized":"2024-09-12T18:17:55.832603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:11.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832539+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:55.832539+0000","last_peered":"2024-09-12T18:17:55.832539+0000","last_clean":"2024-09-12T18:17:55.832539+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:55.832539+0000","last_undegraded":"2024-09-12T18:17:55.832539+0000","last_fullsized":"2024-09-12T18:17:55.832539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.215322+0000","last_change":"2024-09-12T18:17:44.195812+0000","last_active":"2024-09-12T18:17:57.215322+0000","last_peered":"2024-09-12T18:17:57.215322+0000","last_clean":"2024-09-12T18:17:57.215322+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:17:57.215322+0000","last_undegraded":"2024-09-12T18:17:57.215322+0000","last_fullsized":"2024-09-12T18:17:57.215322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:15.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832918+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:55.832918+0000","last_peered":"2024-09-12T18:17:55.832918+0000","last_clean":"2024-09-12T18:17:55.832918+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:55.832918+0000","last_undegraded":"2024-09-12T18:17:55.832918+0000","last_fullsized":"2024-09-12T18:17:55.832918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:37.804558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":165,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844029+0000","last_change":"2024-09-12T18:17:54.850651+0000","last_active":"2024-09-12T18:17:55.844029+0000","last_peered":"2024-09-12T18:17:55.844029+0000","last_clean":"2024-09-12T18:17:55.844029+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:17:55.844029+0000","last_undegraded":"2024-09-12T18:17:55.844029+0000","last_fullsized":"2024-09-12T18:17:55.844029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:21.588951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839732+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:55.839732+0000","last_peered":"2024-09-12T18:17:55.839732+0000","last_clean":"2024-09-12T18:17:55.839732+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:55.839732+0000","last_undegraded":"2024-09-12T18:17:55.839732+0000","last_fullsized":"2024-09-12T18:17:55.839732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227511+0000","last_change":"2024-09-12T18:17:57.227263+0000","last_active":"2024-09-12T18:17:57.227511+0000","last_peered":"2024-09-12T18:17:57.227511+0000","last_clean":"2024-09-12T18:17:57.227511+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:17:57.227511+0000","last_undegraded":"2024-09-12T18:17:57.227511+0000","last_fullsized":"2024-09-12T18:17:57.227511+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:30.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226272+0000","last_change":"2024-09-12T18:17:57.225984+0000","last_active":"2024-09-12T18:17:57.226272+0000","last_peered":"2024-09-12T18:17:57.226272+0000","last_clean":"2024-09-12T18:17:57.226272+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:17:57.226272+0000","last_undegraded":"2024-09-12T18:17:57.226272+0000","last_fullsized":"2024-09-12T18:17:57.226272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:16.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.234686+0000","last_change":"2024-09-12T18:17:57.233612+0000","last_active":"2024-09-12T18:17:57.234686+0000","last_peered":"2024-09-12T18:17:57.234686+0000","last_clean":"2024-09-12T18:17:57.234686+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:17:57.234686+0000","last_undegraded":"2024-09-12T18:17:57.234686+0000","last_fullsized":"2024-09-12T18:17:57.234686+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:49.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842056+0000","last_change":"2024-09-12T18:17:43.850032+0000","last_active":"2024-09-12T18:17:55.842056+0000","last_peered":"2024-09-12T18:17:55.842056+0000","last_clean":"2024-09-12T18:17:55.842056+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:17:55.842056+0000","last_undegraded":"2024-09-12T18:17:55.842056+0000","last_fullsized":"2024-09-12T18:17:55.842056+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837482+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:55.837482+0000","last_peered":"2024-09-12T18:17:55.837482+0000","last_clean":"2024-09-12T18:17:55.837482+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:55.837482+0000","last_undegraded":"2024-09-12T18:17:55.837482+0000","last_fullsized":"2024-09-12T18:17:55.837482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842562+0000","last_change":"2024-09-12T18:17:54.848137+0000","last_active":"2024-09-12T18:17:55.842562+0000","last_peered":"2024-09-12T18:17:55.842562+0000","last_clean":"2024-09-12T18:17:55.842562+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:17:55.842562+0000","last_undegraded":"2024-09-12T18:17:55.842562+0000","last_fullsized":"2024-09-12T18:17:55.842562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:47.582059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832054+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:55.832054+0000","last_peered":"2024-09-12T18:17:55.832054+0000","last_clean":"2024-09-12T18:17:55.832054+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:55.832054+0000","last_undegraded":"2024-09-12T18:17:55.832054+0000","last_fullsized":"2024-09-12T18:17:55.832054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834047+0000","last_change":"2024-09-12T18:17:43.846663+0000","last_active":"2024-09-12T18:17:55.834047+0000","last_peered":"2024-09-12T18:17:55.834047+0000","last_clean":"2024-09-12T18:17:55.834047+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:17:55.834047+0000","last_undegraded":"2024-09-12T18:17:55.834047+0000","last_fullsized":"2024-09-12T18:17:55.834047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:52.288114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838202+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:55.838202+0000","last_peered":"2024-09-12T18:17:55.838202+0000","last_clean":"2024-09-12T18:17:55.838202+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:55.838202+0000","last_undegraded":"2024-09-12T18:17:55.838202+0000","last_fullsized":"2024-09-12T18:17:55.838202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844793+0000","last_change":"2024-09-12T18:17:54.844194+0000","last_active":"2024-09-12T18:17:55.844793+0000","last_peered":"2024-09-12T18:17:55.844793+0000","last_clean":"2024-09-12T18:17:55.844793+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:17:55.844793+0000","last_undegraded":"2024-09-12T18:17:55.844793+0000","last_fullsized":"2024-09-12T18:17:55.844793+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:26.010260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840710+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:55.840710+0000","last_peered":"2024-09-12T18:17:55.840710+0000","last_clean":"2024-09-12T18:17:55.840710+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:55.840710+0000","last_undegraded":"2024-09-12T18:17:55.840710+0000","last_fullsized":"2024-09-12T18:17:55.840710+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232120+0000","last_change":"2024-09-12T18:17:57.231837+0000","last_active":"2024-09-12T18:17:57.232120+0000","last_peered":"2024-09-12T18:17:57.232120+0000","last_clean":"2024-09-12T18:17:57.232120+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:17:57.232120+0000","last_undegraded":"2024-09-12T18:17:57.232120+0000","last_fullsized":"2024-09-12T18:17:57.232120+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:27.028425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232131+0000","last_change":"2024-09-12T18:17:57.231804+0000","last_active":"2024-09-12T18:17:57.232131+0000","last_peered":"2024-09-12T18:17:57.232131+0000","last_clean":"2024-09-12T18:17:57.232131+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:17:57.232131+0000","last_undegraded":"2024-09-12T18:17:57.232131+0000","last_fullsized":"2024-09-12T18:17:57.232131+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:56.591750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833175+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:55.833175+0000","last_peered":"2024-09-12T18:17:55.833175+0000","last_clean":"2024-09-12T18:17:55.833175+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:55.833175+0000","last_undegraded":"2024-09-12T18:17:55.833175+0000","last_fullsized":"2024-09-12T18:17:55.833175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839718+0000","last_change":"2024-09-12T18:17:46.785093+0000","last_active":"2024-09-12T18:17:55.839718+0000","last_peered":"2024-09-12T18:17:55.839718+0000","last_clean":"2024-09-12T18:17:55.839718+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:17:55.839718+0000","last_undegraded":"2024-09-12T18:17:55.839718+0000","last_fullsized":"2024-09-12T18:17:55.839718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:07.703117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844012+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:55.844012+0000","last_peered":"2024-09-12T18:17:55.844012+0000","last_clean":"2024-09-12T18:17:55.844012+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:55.844012+0000","last_undegraded":"2024-09-12T18:17:55.844012+0000","last_fullsized":"2024-09-12T18:17:55.844012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833432+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:55.833432+0000","last_peered":"2024-09-12T18:17:55.833432+0000","last_clean":"2024-09-12T18:17:55.833432+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:55.833432+0000","last_undegraded":"2024-09-12T18:17:55.833432+0000","last_fullsized":"2024-09-12T18:17:55.833432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842366+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:55.842366+0000","last_peered":"2024-09-12T18:17:55.842366+0000","last_clean":"2024-09-12T18:17:55.842366+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:55.842366+0000","last_undegraded":"2024-09-12T18:17:55.842366+0000","last_fullsized":"2024-09-12T18:17:55.842366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844328+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:55.844328+0000","last_peered":"2024-09-12T18:17:55.844328+0000","last_clean":"2024-09-12T18:17:55.844328+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:55.844328+0000","last_undegraded":"2024-09-12T18:17:55.844328+0000","last_fullsized":"2024-09-12T18:17:55.844328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":191,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831259+0000","last_change":"2024-09-12T18:17:43.837153+0000","last_active":"2024-09-12T18:17:55.831259+0000","last_peered":"2024-09-12T18:17:55.831259+0000","last_clean":"2024-09-12T18:17:55.831259+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:17:55.831259+0000","last_undegraded":"2024-09-12T18:17:55.831259+0000","last_fullsized":"2024-09-12T18:17:55.831259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:44.908861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216973+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:57.216973+0000","last_peered":"2024-09-12T18:17:57.216973+0000","last_clean":"2024-09-12T18:17:57.216973+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:57.216973+0000","last_undegraded":"2024-09-12T18:17:57.216973+0000","last_fullsized":"2024-09-12T18:17:57.216973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834958+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:55.834958+0000","last_peered":"2024-09-12T18:17:55.834958+0000","last_clean":"2024-09-12T18:17:55.834958+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:55.834958+0000","last_undegraded":"2024-09-12T18:17:55.834958+0000","last_fullsized":"2024-09-12T18:17:55.834958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229674+0000","last_change":"2024-09-12T18:17:57.229183+0000","last_active":"2024-09-12T18:17:57.229674+0000","last_peered":"2024-09-12T18:17:57.229674+0000","last_clean":"2024-09-12T18:17:57.229674+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:17:57.229674+0000","last_undegraded":"2024-09-12T18:17:57.229674+0000","last_fullsized":"2024-09-12T18:17:57.229674+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:49.982893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833187+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:55.833187+0000","last_peered":"2024-09-12T18:17:55.833187+0000","last_clean":"2024-09-12T18:17:55.833187+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:55.833187+0000","last_undegraded":"2024-09-12T18:17:55.833187+0000","last_fullsized":"2024-09-12T18:17:55.833187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844868+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:55.844868+0000","last_peered":"2024-09-12T18:17:55.844868+0000","last_clean":"2024-09-12T18:17:55.844868+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:55.844868+0000","last_undegraded":"2024-09-12T18:17:55.844868+0000","last_fullsized":"2024-09-12T18:17:55.844868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842674+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:55.842674+0000","last_peered":"2024-09-12T18:17:55.842674+0000","last_clean":"2024-09-12T18:17:55.842674+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:55.842674+0000","last_undegraded":"2024-09-12T18:17:55.842674+0000","last_fullsized":"2024-09-12T18:17:55.842674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837309+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:55.837309+0000","last_peered":"2024-09-12T18:17:55.837309+0000","last_clean":"2024-09-12T18:17:55.837309+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:55.837309+0000","last_undegraded":"2024-09-12T18:17:55.837309+0000","last_fullsized":"2024-09-12T18:17:55.837309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842598+0000","last_change":"2024-09-12T18:17:54.845043+0000","last_active":"2024-09-12T18:17:55.842598+0000","last_peered":"2024-09-12T18:17:55.842598+0000","last_clean":"2024-09-12T18:17:55.842598+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:17:55.842598+0000","last_undegraded":"2024-09-12T18:17:55.842598+0000","last_fullsized":"2024-09-12T18:17:55.842598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:09.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837568+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:55.837568+0000","last_peered":"2024-09-12T18:17:55.837568+0000","last_clean":"2024-09-12T18:17:55.837568+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:55.837568+0000","last_undegraded":"2024-09-12T18:17:55.837568+0000","last_fullsized":"2024-09-12T18:17:55.837568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220650+0000","last_change":"2024-09-12T18:17:57.220336+0000","last_active":"2024-09-12T18:17:57.220650+0000","last_peered":"2024-09-12T18:17:57.220650+0000","last_clean":"2024-09-12T18:17:57.220650+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:17:57.220650+0000","last_undegraded":"2024-09-12T18:17:57.220650+0000","last_fullsized":"2024-09-12T18:17:57.220650+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:32.842004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837464+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:55.837464+0000","last_peered":"2024-09-12T18:17:55.837464+0000","last_clean":"2024-09-12T18:17:55.837464+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:55.837464+0000","last_undegraded":"2024-09-12T18:17:55.837464+0000","last_fullsized":"2024-09-12T18:17:55.837464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.217254+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:57.217254+0000","last_peered":"2024-09-12T18:17:57.217254+0000","last_clean":"2024-09-12T18:17:57.217254+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:57.217254+0000","last_undegraded":"2024-09-12T18:17:57.217254+0000","last_fullsized":"2024-09-12T18:17:57.217254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232147+0000","last_change":"2024-09-12T18:17:57.231857+0000","last_active":"2024-09-12T18:17:57.232147+0000","last_peered":"2024-09-12T18:17:57.232147+0000","last_clean":"2024-09-12T18:17:57.232147+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:17:57.232147+0000","last_undegraded":"2024-09-12T18:17:57.232147+0000","last_fullsized":"2024-09-12T18:17:57.232147+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:28.991322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834223+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:55.834223+0000","last_peered":"2024-09-12T18:17:55.834223+0000","last_clean":"2024-09-12T18:17:55.834223+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:55.834223+0000","last_undegraded":"2024-09-12T18:17:55.834223+0000","last_fullsized":"2024-09-12T18:17:55.834223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832472+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:55.832472+0000","last_peered":"2024-09-12T18:17:55.832472+0000","last_clean":"2024-09-12T18:17:55.832472+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:55.832472+0000","last_undegraded":"2024-09-12T18:17:55.832472+0000","last_fullsized":"2024-09-12T18:17:55.832472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833275+0000","last_change":"2024-09-12T18:17:43.838249+0000","last_active":"2024-09-12T18:17:55.833275+0000","last_peered":"2024-09-12T18:17:55.833275+0000","last_clean":"2024-09-12T18:17:55.833275+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:17:55.833275+0000","last_undegraded":"2024-09-12T18:17:55.833275+0000","last_fullsized":"2024-09-12T18:17:55.833275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:22.433973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":200,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834678+0000","last_change":"2024-09-12T18:17:43.870789+0000","last_active":"2024-09-12T18:17:55.834678+0000","last_peered":"2024-09-12T18:17:55.834678+0000","last_clean":"2024-09-12T18:17:55.834678+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:17:55.834678+0000","last_undegraded":"2024-09-12T18:17:55.834678+0000","last_fullsized":"2024-09-12T18:17:55.834678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:49.502247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840543+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:55.840543+0000","last_peered":"2024-09-12T18:17:55.840543+0000","last_clean":"2024-09-12T18:17:55.840543+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:55.840543+0000","last_undegraded":"2024-09-12T18:17:55.840543+0000","last_fullsized":"2024-09-12T18:17:55.840543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226762+0000","last_change":"2024-09-12T18:17:57.226471+0000","last_active":"2024-09-12T18:17:57.226762+0000","last_peered":"2024-09-12T18:17:57.226762+0000","last_clean":"2024-09-12T18:17:57.226762+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:17:57.226762+0000","last_undegraded":"2024-09-12T18:17:57.226762+0000","last_fullsized":"2024-09-12T18:17:57.226762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:17.288097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841325+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:55.841325+0000","last_peered":"2024-09-12T18:17:55.841325+0000","last_clean":"2024-09-12T18:17:55.841325+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:55.841325+0000","last_undegraded":"2024-09-12T18:17:55.841325+0000","last_fullsized":"2024-09-12T18:17:55.841325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":163,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842264+0000","last_change":"2024-09-12T18:17:54.850699+0000","last_active":"2024-09-12T18:17:55.842264+0000","last_peered":"2024-09-12T18:17:55.842264+0000","last_clean":"2024-09-12T18:17:55.842264+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:17:55.842264+0000","last_undegraded":"2024-09-12T18:17:55.842264+0000","last_fullsized":"2024-09-12T18:17:55.842264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:42.033453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831765+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:55.831765+0000","last_peered":"2024-09-12T18:17:55.831765+0000","last_clean":"2024-09-12T18:17:55.831765+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:55.831765+0000","last_undegraded":"2024-09-12T18:17:55.831765+0000","last_fullsized":"2024-09-12T18:17:55.831765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232331+0000","last_change":"2024-09-12T18:17:57.232052+0000","last_active":"2024-09-12T18:17:57.232331+0000","last_peered":"2024-09-12T18:17:57.232331+0000","last_clean":"2024-09-12T18:17:57.232331+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:17:57.232331+0000","last_undegraded":"2024-09-12T18:17:57.232331+0000","last_fullsized":"2024-09-12T18:17:57.232331+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:45.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839256+0000","last_change":"2024-09-12T18:17:54.840249+0000","last_active":"2024-09-12T18:17:55.839256+0000","last_peered":"2024-09-12T18:17:55.839256+0000","last_clean":"2024-09-12T18:17:55.839256+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:17:55.839256+0000","last_undegraded":"2024-09-12T18:17:55.839256+0000","last_fullsized":"2024-09-12T18:17:55.839256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:47.078593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832620+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:55.832620+0000","last_peered":"2024-09-12T18:17:55.832620+0000","last_clean":"2024-09-12T18:17:55.832620+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:55.832620+0000","last_undegraded":"2024-09-12T18:17:55.832620+0000","last_fullsized":"2024-09-12T18:17:55.832620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833671+0000","last_change":"2024-09-12T18:17:52.823288+0000","last_active":"2024-09-12T18:17:55.833671+0000","last_peered":"2024-09-12T18:17:55.833671+0000","last_clean":"2024-09-12T18:17:55.833671+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:17:55.833671+0000","last_undegraded":"2024-09-12T18:17:55.833671+0000","last_fullsized":"2024-09-12T18:17:55.833671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:50.555729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833019+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:55.833019+0000","last_peered":"2024-09-12T18:17:55.833019+0000","last_clean":"2024-09-12T18:17:55.833019+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:55.833019+0000","last_undegraded":"2024-09-12T18:17:55.833019+0000","last_fullsized":"2024-09-12T18:17:55.833019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224059+0000","last_change":"2024-09-12T18:17:57.223771+0000","last_active":"2024-09-12T18:17:57.224059+0000","last_peered":"2024-09-12T18:17:57.224059+0000","last_clean":"2024-09-12T18:17:57.224059+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:17:57.224059+0000","last_undegraded":"2024-09-12T18:17:57.224059+0000","last_fullsized":"2024-09-12T18:17:57.224059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:16.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833517+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:55.833517+0000","last_peered":"2024-09-12T18:17:55.833517+0000","last_clean":"2024-09-12T18:17:55.833517+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:55.833517+0000","last_undegraded":"2024-09-12T18:17:55.833517+0000","last_fullsized":"2024-09-12T18:17:55.833517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834514+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:55.834514+0000","last_peered":"2024-09-12T18:17:55.834514+0000","last_clean":"2024-09-12T18:17:55.834514+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:55.834514+0000","last_undegraded":"2024-09-12T18:17:55.834514+0000","last_fullsized":"2024-09-12T18:17:55.834514+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831562+0000","last_change":"2024-09-12T18:17:43.837788+0000","last_active":"2024-09-12T18:17:55.831562+0000","last_peered":"2024-09-12T18:17:55.831562+0000","last_clean":"2024-09-12T18:17:55.831562+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:17:55.831562+0000","last_undegraded":"2024-09-12T18:17:55.831562+0000","last_fullsized":"2024-09-12T18:17:55.831562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:27.702672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.213116+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:57.213116+0000","last_peered":"2024-09-12T18:17:57.213116+0000","last_clean":"2024-09-12T18:17:57.213116+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:57.213116+0000","last_undegraded":"2024-09-12T18:17:57.213116+0000","last_fullsized":"2024-09-12T18:17:57.213116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226092+0000","last_change":"2024-09-12T18:17:57.224877+0000","last_active":"2024-09-12T18:17:57.226092+0000","last_peered":"2024-09-12T18:17:57.226092+0000","last_clean":"2024-09-12T18:17:57.226092+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:17:57.226092+0000","last_undegraded":"2024-09-12T18:17:57.226092+0000","last_fullsized":"2024-09-12T18:17:57.226092+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:50.751782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229368+0000","last_change":"2024-09-12T18:17:57.227693+0000","last_active":"2024-09-12T18:17:57.229368+0000","last_peered":"2024-09-12T18:17:57.229368+0000","last_clean":"2024-09-12T18:17:57.229368+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:17:57.229368+0000","last_undegraded":"2024-09-12T18:17:57.229368+0000","last_fullsized":"2024-09-12T18:17:57.229368+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.861398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224859+0000","last_change":"2024-09-12T18:17:57.224577+0000","last_active":"2024-09-12T18:17:57.224859+0000","last_peered":"2024-09-12T18:17:57.224859+0000","last_clean":"2024-09-12T18:17:57.224859+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:17:57.224859+0000","last_undegraded":"2024-09-12T18:17:57.224859+0000","last_fullsized":"2024-09-12T18:17:57.224859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:27.343760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837639+0000","last_change":"2024-09-12T18:17:54.854658+0000","last_active":"2024-09-12T18:17:55.837639+0000","last_peered":"2024-09-12T18:17:55.837639+0000","last_clean":"2024-09-12T18:17:55.837639+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:17:55.837639+0000","last_undegraded":"2024-09-12T18:17:55.837639+0000","last_fullsized":"2024-09-12T18:17:55.837639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.476487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844591+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:55.844591+0000","last_peered":"2024-09-12T18:17:55.844591+0000","last_clean":"2024-09-12T18:17:55.844591+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:55.844591+0000","last_undegraded":"2024-09-12T18:17:55.844591+0000","last_fullsized":"2024-09-12T18:17:55.844591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224687+0000","last_change":"2024-09-12T18:17:57.224380+0000","last_active":"2024-09-12T18:17:57.224687+0000","last_peered":"2024-09-12T18:17:57.224687+0000","last_clean":"2024-09-12T18:17:57.224687+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:17:57.224687+0000","last_undegraded":"2024-09-12T18:17:57.224687+0000","last_fullsized":"2024-09-12T18:17:57.224687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:07.158110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224203+0000","last_change":"2024-09-12T18:17:57.223910+0000","last_active":"2024-09-12T18:17:57.224203+0000","last_peered":"2024-09-12T18:17:57.224203+0000","last_clean":"2024-09-12T18:17:57.224203+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:17:57.224203+0000","last_undegraded":"2024-09-12T18:17:57.224203+0000","last_fullsized":"2024-09-12T18:17:57.224203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:01.950899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.836656+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:55.836656+0000","last_peered":"2024-09-12T18:17:55.836656+0000","last_clean":"2024-09-12T18:17:55.836656+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:55.836656+0000","last_undegraded":"2024-09-12T18:17:55.836656+0000","last_fullsized":"2024-09-12T18:17:55.836656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844194+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:55.844194+0000","last_peered":"2024-09-12T18:17:55.844194+0000","last_clean":"2024-09-12T18:17:55.844194+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:55.844194+0000","last_undegraded":"2024-09-12T18:17:55.844194+0000","last_fullsized":"2024-09-12T18:17:55.844194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":207,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834454+0000","last_change":"2024-09-12T18:17:43.861774+0000","last_active":"2024-09-12T18:17:55.834454+0000","last_peered":"2024-09-12T18:17:55.834454+0000","last_clean":"2024-09-12T18:17:55.834454+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:17:55.834454+0000","last_undegraded":"2024-09-12T18:17:55.834454+0000","last_fullsized":"2024-09-12T18:17:55.834454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:07.298644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280832,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091008,"statfs":{"total":96636764160,"available":96349192192,"internally_reserved":0,"allocated":1150976,"data_stored":1050347,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397368,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974472,"statfs":{"total":96636764160,"available":96229859328,"internally_reserved":0,"allocated":1077248,"data_stored":453953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285575,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46284,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325556,"statfs":{"total":96636764160,"available":96589369344,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:01.576 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:18:01.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:01.928 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:02.063 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:02.065 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-12T18:18:00.469910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724484,"kb_used_data":3312,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391036,"statfs":{"total":289910292480,"available":289168420864,"internally_reserved":0,"allocated":3391488,"data_stored":2558244,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001620"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216946+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:57.216946+0000","last_peered":"2024-09-12T18:17:57.216946+0000","last_clean":"2024-09-12T18:17:57.216946+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:57.216946+0000","last_undegraded":"2024-09-12T18:17:57.216946+0000","last_fullsized":"2024-09-12T18:17:57.216946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.230978+0000","last_change":"2024-09-12T18:17:57.230711+0000","last_active":"2024-09-12T18:17:57.230978+0000","last_peered":"2024-09-12T18:17:57.230978+0000","last_clean":"2024-09-12T18:17:57.230978+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:17:57.230978+0000","last_undegraded":"2024-09-12T18:17:57.230978+0000","last_fullsized":"2024-09-12T18:17:57.230978+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.119606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839554+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:55.839554+0000","last_peered":"2024-09-12T18:17:55.839554+0000","last_clean":"2024-09-12T18:17:55.839554+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:55.839554+0000","last_undegraded":"2024-09-12T18:17:55.839554+0000","last_fullsized":"2024-09-12T18:17:55.839554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841425+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:55.841425+0000","last_peered":"2024-09-12T18:17:55.841425+0000","last_clean":"2024-09-12T18:17:55.841425+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:55.841425+0000","last_undegraded":"2024-09-12T18:17:55.841425+0000","last_fullsized":"2024-09-12T18:17:55.841425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227088+0000","last_change":"2024-09-12T18:17:57.226865+0000","last_active":"2024-09-12T18:17:57.227088+0000","last_peered":"2024-09-12T18:17:57.227088+0000","last_clean":"2024-09-12T18:17:57.227088+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:17:57.227088+0000","last_undegraded":"2024-09-12T18:17:57.227088+0000","last_fullsized":"2024-09-12T18:17:57.227088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.312438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844144+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:55.844144+0000","last_peered":"2024-09-12T18:17:55.844144+0000","last_clean":"2024-09-12T18:17:55.844144+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:55.844144+0000","last_undegraded":"2024-09-12T18:17:55.844144+0000","last_fullsized":"2024-09-12T18:17:55.844144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837979+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:55.837979+0000","last_peered":"2024-09-12T18:17:55.837979+0000","last_clean":"2024-09-12T18:17:55.837979+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:55.837979+0000","last_undegraded":"2024-09-12T18:17:55.837979+0000","last_fullsized":"2024-09-12T18:17:55.837979+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841664+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:55.841664+0000","last_peered":"2024-09-12T18:17:55.841664+0000","last_clean":"2024-09-12T18:17:55.841664+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:55.841664+0000","last_undegraded":"2024-09-12T18:17:55.841664+0000","last_fullsized":"2024-09-12T18:17:55.841664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832653+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:55.832653+0000","last_peered":"2024-09-12T18:17:55.832653+0000","last_clean":"2024-09-12T18:17:55.832653+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:55.832653+0000","last_undegraded":"2024-09-12T18:17:55.832653+0000","last_fullsized":"2024-09-12T18:17:55.832653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233648+0000","last_change":"2024-09-12T18:17:57.233340+0000","last_active":"2024-09-12T18:17:57.233648+0000","last_peered":"2024-09-12T18:17:57.233648+0000","last_clean":"2024-09-12T18:17:57.233648+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:17:57.233648+0000","last_undegraded":"2024-09-12T18:17:57.233648+0000","last_fullsized":"2024-09-12T18:17:57.233648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:33.474988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839824+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:55.839824+0000","last_peered":"2024-09-12T18:17:55.839824+0000","last_clean":"2024-09-12T18:17:55.839824+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:55.839824+0000","last_undegraded":"2024-09-12T18:17:55.839824+0000","last_fullsized":"2024-09-12T18:17:55.839824+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235182+0000","last_change":"2024-09-12T18:17:57.234956+0000","last_active":"2024-09-12T18:17:57.235182+0000","last_peered":"2024-09-12T18:17:57.235182+0000","last_clean":"2024-09-12T18:17:57.235182+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:17:57.235182+0000","last_undegraded":"2024-09-12T18:17:57.235182+0000","last_fullsized":"2024-09-12T18:17:57.235182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.824054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232361+0000","last_change":"2024-09-12T18:17:57.230917+0000","last_active":"2024-09-12T18:17:57.232361+0000","last_peered":"2024-09-12T18:17:57.232361+0000","last_clean":"2024-09-12T18:17:57.232361+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:17:57.232361+0000","last_undegraded":"2024-09-12T18:17:57.232361+0000","last_fullsized":"2024-09-12T18:17:57.232361+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:50.167605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844403+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:55.844403+0000","last_peered":"2024-09-12T18:17:55.844403+0000","last_clean":"2024-09-12T18:17:55.844403+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:55.844403+0000","last_undegraded":"2024-09-12T18:17:55.844403+0000","last_fullsized":"2024-09-12T18:17:55.844403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837492+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:55.837492+0000","last_peered":"2024-09-12T18:17:55.837492+0000","last_clean":"2024-09-12T18:17:55.837492+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:55.837492+0000","last_undegraded":"2024-09-12T18:17:55.837492+0000","last_fullsized":"2024-09-12T18:17:55.837492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842341+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:55.842341+0000","last_peered":"2024-09-12T18:17:55.842341+0000","last_clean":"2024-09-12T18:17:55.842341+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:55.842341+0000","last_undegraded":"2024-09-12T18:17:55.842341+0000","last_fullsized":"2024-09-12T18:17:55.842341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833940+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:55.833940+0000","last_peered":"2024-09-12T18:17:55.833940+0000","last_clean":"2024-09-12T18:17:55.833940+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:55.833940+0000","last_undegraded":"2024-09-12T18:17:55.833940+0000","last_fullsized":"2024-09-12T18:17:55.833940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227680+0000","last_change":"2024-09-12T18:17:57.227409+0000","last_active":"2024-09-12T18:17:57.227680+0000","last_peered":"2024-09-12T18:17:57.227680+0000","last_clean":"2024-09-12T18:17:57.227680+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:17:57.227680+0000","last_undegraded":"2024-09-12T18:17:57.227680+0000","last_fullsized":"2024-09-12T18:17:57.227680+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:53.730736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832908+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:55.832908+0000","last_peered":"2024-09-12T18:17:55.832908+0000","last_clean":"2024-09-12T18:17:55.832908+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:55.832908+0000","last_undegraded":"2024-09-12T18:17:55.832908+0000","last_fullsized":"2024-09-12T18:17:55.832908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841740+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:55.841740+0000","last_peered":"2024-09-12T18:17:55.841740+0000","last_clean":"2024-09-12T18:17:55.841740+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:55.841740+0000","last_undegraded":"2024-09-12T18:17:55.841740+0000","last_fullsized":"2024-09-12T18:17:55.841740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842094+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:55.842094+0000","last_peered":"2024-09-12T18:17:55.842094+0000","last_clean":"2024-09-12T18:17:55.842094+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:55.842094+0000","last_undegraded":"2024-09-12T18:17:55.842094+0000","last_fullsized":"2024-09-12T18:17:55.842094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220666+0000","last_change":"2024-09-12T18:17:57.220151+0000","last_active":"2024-09-12T18:17:57.220666+0000","last_peered":"2024-09-12T18:17:57.220666+0000","last_clean":"2024-09-12T18:17:57.220666+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:17:57.220666+0000","last_undegraded":"2024-09-12T18:17:57.220666+0000","last_fullsized":"2024-09-12T18:17:57.220666+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:02.044417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833863+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:55.833863+0000","last_peered":"2024-09-12T18:17:55.833863+0000","last_clean":"2024-09-12T18:17:55.833863+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:55.833863+0000","last_undegraded":"2024-09-12T18:17:55.833863+0000","last_fullsized":"2024-09-12T18:17:55.833863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220570+0000","last_change":"2024-09-12T18:17:57.220296+0000","last_active":"2024-09-12T18:17:57.220570+0000","last_peered":"2024-09-12T18:17:57.220570+0000","last_clean":"2024-09-12T18:17:57.220570+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:17:57.220570+0000","last_undegraded":"2024-09-12T18:17:57.220570+0000","last_fullsized":"2024-09-12T18:17:57.220570+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:21.286087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.214122+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:57.214122+0000","last_peered":"2024-09-12T18:17:57.214122+0000","last_clean":"2024-09-12T18:17:57.214122+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:57.214122+0000","last_undegraded":"2024-09-12T18:17:57.214122+0000","last_fullsized":"2024-09-12T18:17:57.214122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834825+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:55.834825+0000","last_peered":"2024-09-12T18:17:55.834825+0000","last_clean":"2024-09-12T18:17:55.834825+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:55.834825+0000","last_undegraded":"2024-09-12T18:17:55.834825+0000","last_fullsized":"2024-09-12T18:17:55.834825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838677+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:55.838677+0000","last_peered":"2024-09-12T18:17:55.838677+0000","last_clean":"2024-09-12T18:17:55.838677+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:55.838677+0000","last_undegraded":"2024-09-12T18:17:55.838677+0000","last_fullsized":"2024-09-12T18:17:55.838677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235784+0000","last_change":"2024-09-12T18:17:57.235643+0000","last_active":"2024-09-12T18:17:57.235784+0000","last_peered":"2024-09-12T18:17:57.235784+0000","last_clean":"2024-09-12T18:17:57.235784+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:17:57.235784+0000","last_undegraded":"2024-09-12T18:17:57.235784+0000","last_fullsized":"2024-09-12T18:17:57.235784+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:05.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832341+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:55.832341+0000","last_peered":"2024-09-12T18:17:55.832341+0000","last_clean":"2024-09-12T18:17:55.832341+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:55.832341+0000","last_undegraded":"2024-09-12T18:17:55.832341+0000","last_fullsized":"2024-09-12T18:17:55.832341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227093+0000","last_change":"2024-09-12T18:17:57.226832+0000","last_active":"2024-09-12T18:17:57.227093+0000","last_peered":"2024-09-12T18:17:57.227093+0000","last_clean":"2024-09-12T18:17:57.227093+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:17:57.227093+0000","last_undegraded":"2024-09-12T18:17:57.227093+0000","last_fullsized":"2024-09-12T18:17:57.227093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:59.362317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832906+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:55.832906+0000","last_peered":"2024-09-12T18:17:55.832906+0000","last_clean":"2024-09-12T18:17:55.832906+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:55.832906+0000","last_undegraded":"2024-09-12T18:17:55.832906+0000","last_fullsized":"2024-09-12T18:17:55.832906+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.843987+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:55.843987+0000","last_peered":"2024-09-12T18:17:55.843987+0000","last_clean":"2024-09-12T18:17:55.843987+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:55.843987+0000","last_undegraded":"2024-09-12T18:17:55.843987+0000","last_fullsized":"2024-09-12T18:17:55.843987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233319+0000","last_change":"2024-09-12T18:17:57.232930+0000","last_active":"2024-09-12T18:17:57.233319+0000","last_peered":"2024-09-12T18:17:57.233319+0000","last_clean":"2024-09-12T18:17:57.233319+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:17:57.233319+0000","last_undegraded":"2024-09-12T18:17:57.233319+0000","last_fullsized":"2024-09-12T18:17:57.233319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:01.904120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":176,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842381+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:55.842381+0000","last_peered":"2024-09-12T18:17:55.842381+0000","last_clean":"2024-09-12T18:17:55.842381+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:55.842381+0000","last_undegraded":"2024-09-12T18:17:55.842381+0000","last_fullsized":"2024-09-12T18:17:55.842381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224231+0000","last_change":"2024-09-12T18:17:57.223948+0000","last_active":"2024-09-12T18:17:57.224231+0000","last_peered":"2024-09-12T18:17:57.224231+0000","last_clean":"2024-09-12T18:17:57.224231+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:17:57.224231+0000","last_undegraded":"2024-09-12T18:17:57.224231+0000","last_fullsized":"2024-09-12T18:17:57.224231+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.983211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832603+0000","last_change":"2024-09-12T18:17:52.825472+0000","last_active":"2024-09-12T18:17:55.832603+0000","last_peered":"2024-09-12T18:17:55.832603+0000","last_clean":"2024-09-12T18:17:55.832603+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:17:55.832603+0000","last_undegraded":"2024-09-12T18:17:55.832603+0000","last_fullsized":"2024-09-12T18:17:55.832603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:11.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832539+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:55.832539+0000","last_peered":"2024-09-12T18:17:55.832539+0000","last_clean":"2024-09-12T18:17:55.832539+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:55.832539+0000","last_undegraded":"2024-09-12T18:17:55.832539+0000","last_fullsized":"2024-09-12T18:17:55.832539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.215322+0000","last_change":"2024-09-12T18:17:44.195812+0000","last_active":"2024-09-12T18:17:57.215322+0000","last_peered":"2024-09-12T18:17:57.215322+0000","last_clean":"2024-09-12T18:17:57.215322+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:17:57.215322+0000","last_undegraded":"2024-09-12T18:17:57.215322+0000","last_fullsized":"2024-09-12T18:17:57.215322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:15.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832918+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:55.832918+0000","last_peered":"2024-09-12T18:17:55.832918+0000","last_clean":"2024-09-12T18:17:55.832918+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:55.832918+0000","last_undegraded":"2024-09-12T18:17:55.832918+0000","last_fullsized":"2024-09-12T18:17:55.832918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:37.804558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":165,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844029+0000","last_change":"2024-09-12T18:17:54.850651+0000","last_active":"2024-09-12T18:17:55.844029+0000","last_peered":"2024-09-12T18:17:55.844029+0000","last_clean":"2024-09-12T18:17:55.844029+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:17:55.844029+0000","last_undegraded":"2024-09-12T18:17:55.844029+0000","last_fullsized":"2024-09-12T18:17:55.844029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:21.588951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839732+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:55.839732+0000","last_peered":"2024-09-12T18:17:55.839732+0000","last_clean":"2024-09-12T18:17:55.839732+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:55.839732+0000","last_undegraded":"2024-09-12T18:17:55.839732+0000","last_fullsized":"2024-09-12T18:17:55.839732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227511+0000","last_change":"2024-09-12T18:17:57.227263+0000","last_active":"2024-09-12T18:17:57.227511+0000","last_peered":"2024-09-12T18:17:57.227511+0000","last_clean":"2024-09-12T18:17:57.227511+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:17:57.227511+0000","last_undegraded":"2024-09-12T18:17:57.227511+0000","last_fullsized":"2024-09-12T18:17:57.227511+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:30.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226272+0000","last_change":"2024-09-12T18:17:57.225984+0000","last_active":"2024-09-12T18:17:57.226272+0000","last_peered":"2024-09-12T18:17:57.226272+0000","last_clean":"2024-09-12T18:17:57.226272+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:17:57.226272+0000","last_undegraded":"2024-09-12T18:17:57.226272+0000","last_fullsized":"2024-09-12T18:17:57.226272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:16.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.234686+0000","last_change":"2024-09-12T18:17:57.233612+0000","last_active":"2024-09-12T18:17:57.234686+0000","last_peered":"2024-09-12T18:17:57.234686+0000","last_clean":"2024-09-12T18:17:57.234686+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:17:57.234686+0000","last_undegraded":"2024-09-12T18:17:57.234686+0000","last_fullsized":"2024-09-12T18:17:57.234686+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:49.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842056+0000","last_change":"2024-09-12T18:17:43.850032+0000","last_active":"2024-09-12T18:17:55.842056+0000","last_peered":"2024-09-12T18:17:55.842056+0000","last_clean":"2024-09-12T18:17:55.842056+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:17:55.842056+0000","last_undegraded":"2024-09-12T18:17:55.842056+0000","last_fullsized":"2024-09-12T18:17:55.842056+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837482+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:55.837482+0000","last_peered":"2024-09-12T18:17:55.837482+0000","last_clean":"2024-09-12T18:17:55.837482+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:55.837482+0000","last_undegraded":"2024-09-12T18:17:55.837482+0000","last_fullsized":"2024-09-12T18:17:55.837482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842562+0000","last_change":"2024-09-12T18:17:54.848137+0000","last_active":"2024-09-12T18:17:55.842562+0000","last_peered":"2024-09-12T18:17:55.842562+0000","last_clean":"2024-09-12T18:17:55.842562+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:17:55.842562+0000","last_undegraded":"2024-09-12T18:17:55.842562+0000","last_fullsized":"2024-09-12T18:17:55.842562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:47.582059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832054+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:55.832054+0000","last_peered":"2024-09-12T18:17:55.832054+0000","last_clean":"2024-09-12T18:17:55.832054+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:55.832054+0000","last_undegraded":"2024-09-12T18:17:55.832054+0000","last_fullsized":"2024-09-12T18:17:55.832054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834047+0000","last_change":"2024-09-12T18:17:43.846663+0000","last_active":"2024-09-12T18:17:55.834047+0000","last_peered":"2024-09-12T18:17:55.834047+0000","last_clean":"2024-09-12T18:17:55.834047+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:17:55.834047+0000","last_undegraded":"2024-09-12T18:17:55.834047+0000","last_fullsized":"2024-09-12T18:17:55.834047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:52.288114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838202+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:55.838202+0000","last_peered":"2024-09-12T18:17:55.838202+0000","last_clean":"2024-09-12T18:17:55.838202+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:55.838202+0000","last_undegraded":"2024-09-12T18:17:55.838202+0000","last_fullsized":"2024-09-12T18:17:55.838202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844793+0000","last_change":"2024-09-12T18:17:54.844194+0000","last_active":"2024-09-12T18:17:55.844793+0000","last_peered":"2024-09-12T18:17:55.844793+0000","last_clean":"2024-09-12T18:17:55.844793+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:17:55.844793+0000","last_undegraded":"2024-09-12T18:17:55.844793+0000","last_fullsized":"2024-09-12T18:17:55.844793+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:26.010260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840710+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:55.840710+0000","last_peered":"2024-09-12T18:17:55.840710+0000","last_clean":"2024-09-12T18:17:55.840710+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:55.840710+0000","last_undegraded":"2024-09-12T18:17:55.840710+0000","last_fullsized":"2024-09-12T18:17:55.840710+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232120+0000","last_change":"2024-09-12T18:17:57.231837+0000","last_active":"2024-09-12T18:17:57.232120+0000","last_peered":"2024-09-12T18:17:57.232120+0000","last_clean":"2024-09-12T18:17:57.232120+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:17:57.232120+0000","last_undegraded":"2024-09-12T18:17:57.232120+0000","last_fullsized":"2024-09-12T18:17:57.232120+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:27.028425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232131+0000","last_change":"2024-09-12T18:17:57.231804+0000","last_active":"2024-09-12T18:17:57.232131+0000","last_peered":"2024-09-12T18:17:57.232131+0000","last_clean":"2024-09-12T18:17:57.232131+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:17:57.232131+0000","last_undegraded":"2024-09-12T18:17:57.232131+0000","last_fullsized":"2024-09-12T18:17:57.232131+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:56.591750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833175+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:55.833175+0000","last_peered":"2024-09-12T18:17:55.833175+0000","last_clean":"2024-09-12T18:17:55.833175+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:55.833175+0000","last_undegraded":"2024-09-12T18:17:55.833175+0000","last_fullsized":"2024-09-12T18:17:55.833175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839718+0000","last_change":"2024-09-12T18:17:46.785093+0000","last_active":"2024-09-12T18:17:55.839718+0000","last_peered":"2024-09-12T18:17:55.839718+0000","last_clean":"2024-09-12T18:17:55.839718+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:17:55.839718+0000","last_undegraded":"2024-09-12T18:17:55.839718+0000","last_fullsized":"2024-09-12T18:17:55.839718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:07.703117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844012+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:55.844012+0000","last_peered":"2024-09-12T18:17:55.844012+0000","last_clean":"2024-09-12T18:17:55.844012+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:55.844012+0000","last_undegraded":"2024-09-12T18:17:55.844012+0000","last_fullsized":"2024-09-12T18:17:55.844012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833432+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:55.833432+0000","last_peered":"2024-09-12T18:17:55.833432+0000","last_clean":"2024-09-12T18:17:55.833432+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:55.833432+0000","last_undegraded":"2024-09-12T18:17:55.833432+0000","last_fullsized":"2024-09-12T18:17:55.833432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842366+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:55.842366+0000","last_peered":"2024-09-12T18:17:55.842366+0000","last_clean":"2024-09-12T18:17:55.842366+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:55.842366+0000","last_undegraded":"2024-09-12T18:17:55.842366+0000","last_fullsized":"2024-09-12T18:17:55.842366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844328+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:55.844328+0000","last_peered":"2024-09-12T18:17:55.844328+0000","last_clean":"2024-09-12T18:17:55.844328+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:55.844328+0000","last_undegraded":"2024-09-12T18:17:55.844328+0000","last_fullsized":"2024-09-12T18:17:55.844328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":191,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831259+0000","last_change":"2024-09-12T18:17:43.837153+0000","last_active":"2024-09-12T18:17:55.831259+0000","last_peered":"2024-09-12T18:17:55.831259+0000","last_clean":"2024-09-12T18:17:55.831259+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:17:55.831259+0000","last_undegraded":"2024-09-12T18:17:55.831259+0000","last_fullsized":"2024-09-12T18:17:55.831259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:44.908861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216973+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:57.216973+0000","last_peered":"2024-09-12T18:17:57.216973+0000","last_clean":"2024-09-12T18:17:57.216973+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:57.216973+0000","last_undegraded":"2024-09-12T18:17:57.216973+0000","last_fullsized":"2024-09-12T18:17:57.216973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834958+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:55.834958+0000","last_peered":"2024-09-12T18:17:55.834958+0000","last_clean":"2024-09-12T18:17:55.834958+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:55.834958+0000","last_undegraded":"2024-09-12T18:17:55.834958+0000","last_fullsized":"2024-09-12T18:17:55.834958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229674+0000","last_change":"2024-09-12T18:17:57.229183+0000","last_active":"2024-09-12T18:17:57.229674+0000","last_peered":"2024-09-12T18:17:57.229674+0000","last_clean":"2024-09-12T18:17:57.229674+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:17:57.229674+0000","last_undegraded":"2024-09-12T18:17:57.229674+0000","last_fullsized":"2024-09-12T18:17:57.229674+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:49.982893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833187+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:55.833187+0000","last_peered":"2024-09-12T18:17:55.833187+0000","last_clean":"2024-09-12T18:17:55.833187+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:55.833187+0000","last_undegraded":"2024-09-12T18:17:55.833187+0000","last_fullsized":"2024-09-12T18:17:55.833187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844868+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:55.844868+0000","last_peered":"2024-09-12T18:17:55.844868+0000","last_clean":"2024-09-12T18:17:55.844868+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:55.844868+0000","last_undegraded":"2024-09-12T18:17:55.844868+0000","last_fullsized":"2024-09-12T18:17:55.844868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842674+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:55.842674+0000","last_peered":"2024-09-12T18:17:55.842674+0000","last_clean":"2024-09-12T18:17:55.842674+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:55.842674+0000","last_undegraded":"2024-09-12T18:17:55.842674+0000","last_fullsized":"2024-09-12T18:17:55.842674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837309+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:55.837309+0000","last_peered":"2024-09-12T18:17:55.837309+0000","last_clean":"2024-09-12T18:17:55.837309+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:55.837309+0000","last_undegraded":"2024-09-12T18:17:55.837309+0000","last_fullsized":"2024-09-12T18:17:55.837309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842598+0000","last_change":"2024-09-12T18:17:54.845043+0000","last_active":"2024-09-12T18:17:55.842598+0000","last_peered":"2024-09-12T18:17:55.842598+0000","last_clean":"2024-09-12T18:17:55.842598+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:17:55.842598+0000","last_undegraded":"2024-09-12T18:17:55.842598+0000","last_fullsized":"2024-09-12T18:17:55.842598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:09.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837568+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:55.837568+0000","last_peered":"2024-09-12T18:17:55.837568+0000","last_clean":"2024-09-12T18:17:55.837568+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:55.837568+0000","last_undegraded":"2024-09-12T18:17:55.837568+0000","last_fullsized":"2024-09-12T18:17:55.837568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220650+0000","last_change":"2024-09-12T18:17:57.220336+0000","last_active":"2024-09-12T18:17:57.220650+0000","last_peered":"2024-09-12T18:17:57.220650+0000","last_clean":"2024-09-12T18:17:57.220650+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:17:57.220650+0000","last_undegraded":"2024-09-12T18:17:57.220650+0000","last_fullsized":"2024-09-12T18:17:57.220650+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:32.842004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":184,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837464+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:55.837464+0000","last_peered":"2024-09-12T18:17:55.837464+0000","last_clean":"2024-09-12T18:17:55.837464+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:55.837464+0000","last_undegraded":"2024-09-12T18:17:55.837464+0000","last_fullsized":"2024-09-12T18:17:55.837464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.217254+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:57.217254+0000","last_peered":"2024-09-12T18:17:57.217254+0000","last_clean":"2024-09-12T18:17:57.217254+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:57.217254+0000","last_undegraded":"2024-09-12T18:17:57.217254+0000","last_fullsized":"2024-09-12T18:17:57.217254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232147+0000","last_change":"2024-09-12T18:17:57.231857+0000","last_active":"2024-09-12T18:17:57.232147+0000","last_peered":"2024-09-12T18:17:57.232147+0000","last_clean":"2024-09-12T18:17:57.232147+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:17:57.232147+0000","last_undegraded":"2024-09-12T18:17:57.232147+0000","last_fullsized":"2024-09-12T18:17:57.232147+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:28.991322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834223+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:55.834223+0000","last_peered":"2024-09-12T18:17:55.834223+0000","last_clean":"2024-09-12T18:17:55.834223+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:55.834223+0000","last_undegraded":"2024-09-12T18:17:55.834223+0000","last_fullsized":"2024-09-12T18:17:55.834223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832472+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:55.832472+0000","last_peered":"2024-09-12T18:17:55.832472+0000","last_clean":"2024-09-12T18:17:55.832472+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:55.832472+0000","last_undegraded":"2024-09-12T18:17:55.832472+0000","last_fullsized":"2024-09-12T18:17:55.832472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833275+0000","last_change":"2024-09-12T18:17:43.838249+0000","last_active":"2024-09-12T18:17:55.833275+0000","last_peered":"2024-09-12T18:17:55.833275+0000","last_clean":"2024-09-12T18:17:55.833275+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:17:55.833275+0000","last_undegraded":"2024-09-12T18:17:55.833275+0000","last_fullsized":"2024-09-12T18:17:55.833275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:22.433973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":200,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834678+0000","last_change":"2024-09-12T18:17:43.870789+0000","last_active":"2024-09-12T18:17:55.834678+0000","last_peered":"2024-09-12T18:17:55.834678+0000","last_clean":"2024-09-12T18:17:55.834678+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:17:55.834678+0000","last_undegraded":"2024-09-12T18:17:55.834678+0000","last_fullsized":"2024-09-12T18:17:55.834678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:49.502247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.840543+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:55.840543+0000","last_peered":"2024-09-12T18:17:55.840543+0000","last_clean":"2024-09-12T18:17:55.840543+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:55.840543+0000","last_undegraded":"2024-09-12T18:17:55.840543+0000","last_fullsized":"2024-09-12T18:17:55.840543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226762+0000","last_change":"2024-09-12T18:17:57.226471+0000","last_active":"2024-09-12T18:17:57.226762+0000","last_peered":"2024-09-12T18:17:57.226762+0000","last_clean":"2024-09-12T18:17:57.226762+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:17:57.226762+0000","last_undegraded":"2024-09-12T18:17:57.226762+0000","last_fullsized":"2024-09-12T18:17:57.226762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:17.288097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.841325+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:55.841325+0000","last_peered":"2024-09-12T18:17:55.841325+0000","last_clean":"2024-09-12T18:17:55.841325+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:55.841325+0000","last_undegraded":"2024-09-12T18:17:55.841325+0000","last_fullsized":"2024-09-12T18:17:55.841325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":163,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.842264+0000","last_change":"2024-09-12T18:17:54.850699+0000","last_active":"2024-09-12T18:17:55.842264+0000","last_peered":"2024-09-12T18:17:55.842264+0000","last_clean":"2024-09-12T18:17:55.842264+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:17:55.842264+0000","last_undegraded":"2024-09-12T18:17:55.842264+0000","last_fullsized":"2024-09-12T18:17:55.842264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:42.033453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831765+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:55.831765+0000","last_peered":"2024-09-12T18:17:55.831765+0000","last_clean":"2024-09-12T18:17:55.831765+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:55.831765+0000","last_undegraded":"2024-09-12T18:17:55.831765+0000","last_fullsized":"2024-09-12T18:17:55.831765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232331+0000","last_change":"2024-09-12T18:17:57.232052+0000","last_active":"2024-09-12T18:17:57.232331+0000","last_peered":"2024-09-12T18:17:57.232331+0000","last_clean":"2024-09-12T18:17:57.232331+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:17:57.232331+0000","last_undegraded":"2024-09-12T18:17:57.232331+0000","last_fullsized":"2024-09-12T18:17:57.232331+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:45.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.839256+0000","last_change":"2024-09-12T18:17:54.840249+0000","last_active":"2024-09-12T18:17:55.839256+0000","last_peered":"2024-09-12T18:17:55.839256+0000","last_clean":"2024-09-12T18:17:55.839256+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:17:55.839256+0000","last_undegraded":"2024-09-12T18:17:55.839256+0000","last_fullsized":"2024-09-12T18:17:55.839256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:47.078593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.832620+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:55.832620+0000","last_peered":"2024-09-12T18:17:55.832620+0000","last_clean":"2024-09-12T18:17:55.832620+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:55.832620+0000","last_undegraded":"2024-09-12T18:17:55.832620+0000","last_fullsized":"2024-09-12T18:17:55.832620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833671+0000","last_change":"2024-09-12T18:17:52.823288+0000","last_active":"2024-09-12T18:17:55.833671+0000","last_peered":"2024-09-12T18:17:55.833671+0000","last_clean":"2024-09-12T18:17:55.833671+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:17:55.833671+0000","last_undegraded":"2024-09-12T18:17:55.833671+0000","last_fullsized":"2024-09-12T18:17:55.833671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:50.555729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833019+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:55.833019+0000","last_peered":"2024-09-12T18:17:55.833019+0000","last_clean":"2024-09-12T18:17:55.833019+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:55.833019+0000","last_undegraded":"2024-09-12T18:17:55.833019+0000","last_fullsized":"2024-09-12T18:17:55.833019+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224059+0000","last_change":"2024-09-12T18:17:57.223771+0000","last_active":"2024-09-12T18:17:57.224059+0000","last_peered":"2024-09-12T18:17:57.224059+0000","last_clean":"2024-09-12T18:17:57.224059+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:17:57.224059+0000","last_undegraded":"2024-09-12T18:17:57.224059+0000","last_fullsized":"2024-09-12T18:17:57.224059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:16.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.833517+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:55.833517+0000","last_peered":"2024-09-12T18:17:55.833517+0000","last_clean":"2024-09-12T18:17:55.833517+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:55.833517+0000","last_undegraded":"2024-09-12T18:17:55.833517+0000","last_fullsized":"2024-09-12T18:17:55.833517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":189,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834514+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:55.834514+0000","last_peered":"2024-09-12T18:17:55.834514+0000","last_clean":"2024-09-12T18:17:55.834514+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:55.834514+0000","last_undegraded":"2024-09-12T18:17:55.834514+0000","last_fullsized":"2024-09-12T18:17:55.834514+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.831562+0000","last_change":"2024-09-12T18:17:43.837788+0000","last_active":"2024-09-12T18:17:55.831562+0000","last_peered":"2024-09-12T18:17:55.831562+0000","last_clean":"2024-09-12T18:17:55.831562+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:17:55.831562+0000","last_undegraded":"2024-09-12T18:17:55.831562+0000","last_fullsized":"2024-09-12T18:17:55.831562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:27.702672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.213116+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:57.213116+0000","last_peered":"2024-09-12T18:17:57.213116+0000","last_clean":"2024-09-12T18:17:57.213116+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:57.213116+0000","last_undegraded":"2024-09-12T18:17:57.213116+0000","last_fullsized":"2024-09-12T18:17:57.213116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226092+0000","last_change":"2024-09-12T18:17:57.224877+0000","last_active":"2024-09-12T18:17:57.226092+0000","last_peered":"2024-09-12T18:17:57.226092+0000","last_clean":"2024-09-12T18:17:57.226092+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:17:57.226092+0000","last_undegraded":"2024-09-12T18:17:57.226092+0000","last_fullsized":"2024-09-12T18:17:57.226092+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:50.751782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229368+0000","last_change":"2024-09-12T18:17:57.227693+0000","last_active":"2024-09-12T18:17:57.229368+0000","last_peered":"2024-09-12T18:17:57.229368+0000","last_clean":"2024-09-12T18:17:57.229368+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:17:57.229368+0000","last_undegraded":"2024-09-12T18:17:57.229368+0000","last_fullsized":"2024-09-12T18:17:57.229368+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.861398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224859+0000","last_change":"2024-09-12T18:17:57.224577+0000","last_active":"2024-09-12T18:17:57.224859+0000","last_peered":"2024-09-12T18:17:57.224859+0000","last_clean":"2024-09-12T18:17:57.224859+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:17:57.224859+0000","last_undegraded":"2024-09-12T18:17:57.224859+0000","last_fullsized":"2024-09-12T18:17:57.224859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:27.343760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.838588+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:55.838588+0000","last_peered":"2024-09-12T18:17:55.838588+0000","last_clean":"2024-09-12T18:17:55.838588+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:55.838588+0000","last_undegraded":"2024-09-12T18:17:55.838588+0000","last_fullsized":"2024-09-12T18:17:55.838588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.837639+0000","last_change":"2024-09-12T18:17:54.854658+0000","last_active":"2024-09-12T18:17:55.837639+0000","last_peered":"2024-09-12T18:17:55.837639+0000","last_clean":"2024-09-12T18:17:55.837639+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:17:55.837639+0000","last_undegraded":"2024-09-12T18:17:55.837639+0000","last_fullsized":"2024-09-12T18:17:55.837639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.476487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844591+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:55.844591+0000","last_peered":"2024-09-12T18:17:55.844591+0000","last_clean":"2024-09-12T18:17:55.844591+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:55.844591+0000","last_undegraded":"2024-09-12T18:17:55.844591+0000","last_fullsized":"2024-09-12T18:17:55.844591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224687+0000","last_change":"2024-09-12T18:17:57.224380+0000","last_active":"2024-09-12T18:17:57.224687+0000","last_peered":"2024-09-12T18:17:57.224687+0000","last_clean":"2024-09-12T18:17:57.224687+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:17:57.224687+0000","last_undegraded":"2024-09-12T18:17:57.224687+0000","last_fullsized":"2024-09-12T18:17:57.224687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:07.158110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224203+0000","last_change":"2024-09-12T18:17:57.223910+0000","last_active":"2024-09-12T18:17:57.224203+0000","last_peered":"2024-09-12T18:17:57.224203+0000","last_clean":"2024-09-12T18:17:57.224203+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:17:57.224203+0000","last_undegraded":"2024-09-12T18:17:57.224203+0000","last_fullsized":"2024-09-12T18:17:57.224203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:01.950899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.836656+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:55.836656+0000","last_peered":"2024-09-12T18:17:55.836656+0000","last_clean":"2024-09-12T18:17:55.836656+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:55.836656+0000","last_undegraded":"2024-09-12T18:17:55.836656+0000","last_fullsized":"2024-09-12T18:17:55.836656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.844194+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:55.844194+0000","last_peered":"2024-09-12T18:17:55.844194+0000","last_clean":"2024-09-12T18:17:55.844194+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:55.844194+0000","last_undegraded":"2024-09-12T18:17:55.844194+0000","last_fullsized":"2024-09-12T18:17:55.844194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":207,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T18:17:55.834454+0000","last_change":"2024-09-12T18:17:43.861774+0000","last_active":"2024-09-12T18:17:55.834454+0000","last_peered":"2024-09-12T18:17:55.834454+0000","last_clean":"2024-09-12T18:17:55.834454+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:17:55.834454+0000","last_undegraded":"2024-09-12T18:17:55.834454+0000","last_fullsized":"2024-09-12T18:17:55.834454+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:07.298644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280832,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091008,"statfs":{"total":96636764160,"available":96349192192,"internally_reserved":0,"allocated":1150976,"data_stored":1050347,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397368,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974472,"statfs":{"total":96636764160,"available":96229859328,"internally_reserved":0,"allocated":1077248,"data_stored":453953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285575,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46284,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325556,"statfs":{"total":96636764160,"available":96589369344,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:02.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:18:02.380 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:02.380 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":99,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:17:56.837752+0000","last_up_change":"2024-09-12T18:17:35.753661+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":42,"up_from":83,"up_thru":98,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6801","nonce":2528869308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6803","nonce":2528869308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6807","nonce":2528869308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6805","nonce":2528869308}]},"public_addr":"172.21.15.129:6801/2528869308","cluster_addr":"172.21.15.129:6803/2528869308","heartbeat_back_addr":"172.21.15.129:6807/2528869308","heartbeat_front_addr":"172.21.15.129:6805/2528869308","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:18:03.399 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:18:03.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:18:03.570 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:18:03.570 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T18:18:03.570 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:18:03.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:18:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:18:03.899 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:18:03.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:18:04.049 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:18:04.049 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:18:04.049 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:18:04.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:18:04.366 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:18:04.385 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:18:04.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:18:04.537 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T18:18:04.537 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:18:04.537 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T18:18:04.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:18:04.852 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:18:04.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:05.171 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:05.173 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-12T18:18:04.471359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":724496,"kb_used_data":3336,"kb_used_omap":9,"kb_used_meta":721078,"kb_avail":282391024,"statfs":{"total":289910292480,"available":289168408576,"internally_reserved":0,"allocated":3416064,"data_stored":2570940,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":738384881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.640326"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216946+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:57.216946+0000","last_peered":"2024-09-12T18:17:57.216946+0000","last_clean":"2024-09-12T18:17:57.216946+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:57.216946+0000","last_undegraded":"2024-09-12T18:17:57.216946+0000","last_fullsized":"2024-09-12T18:17:57.216946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.230978+0000","last_change":"2024-09-12T18:17:57.230711+0000","last_active":"2024-09-12T18:17:57.230978+0000","last_peered":"2024-09-12T18:17:57.230978+0000","last_clean":"2024-09-12T18:17:57.230978+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:17:57.230978+0000","last_undegraded":"2024-09-12T18:17:57.230978+0000","last_fullsized":"2024-09-12T18:17:57.230978+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.119606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851715+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:56.851715+0000","last_peered":"2024-09-12T18:17:56.851715+0000","last_clean":"2024-09-12T18:17:56.851715+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:56.851715+0000","last_undegraded":"2024-09-12T18:17:56.851715+0000","last_fullsized":"2024-09-12T18:17:56.851715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851684+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:56.851684+0000","last_peered":"2024-09-12T18:17:56.851684+0000","last_clean":"2024-09-12T18:17:56.851684+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:56.851684+0000","last_undegraded":"2024-09-12T18:17:56.851684+0000","last_fullsized":"2024-09-12T18:17:56.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227088+0000","last_change":"2024-09-12T18:17:57.226865+0000","last_active":"2024-09-12T18:17:57.227088+0000","last_peered":"2024-09-12T18:17:57.227088+0000","last_clean":"2024-09-12T18:17:57.227088+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:17:57.227088+0000","last_undegraded":"2024-09-12T18:17:57.227088+0000","last_fullsized":"2024-09-12T18:17:57.227088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.312438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":86,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850463+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:56.850463+0000","last_peered":"2024-09-12T18:17:56.850463+0000","last_clean":"2024-09-12T18:17:56.850463+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:56.850463+0000","last_undegraded":"2024-09-12T18:17:56.850463+0000","last_fullsized":"2024-09-12T18:17:56.850463+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850411+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:56.850411+0000","last_peered":"2024-09-12T18:17:56.850411+0000","last_clean":"2024-09-12T18:17:56.850411+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:56.850411+0000","last_undegraded":"2024-09-12T18:17:56.850411+0000","last_fullsized":"2024-09-12T18:17:56.850411+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.849821+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:56.849821+0000","last_peered":"2024-09-12T18:17:56.849821+0000","last_clean":"2024-09-12T18:17:56.849821+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:56.849821+0000","last_undegraded":"2024-09-12T18:17:56.849821+0000","last_fullsized":"2024-09-12T18:17:56.849821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851379+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:56.851379+0000","last_peered":"2024-09-12T18:17:56.851379+0000","last_clean":"2024-09-12T18:17:56.851379+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:56.851379+0000","last_undegraded":"2024-09-12T18:17:56.851379+0000","last_fullsized":"2024-09-12T18:17:56.851379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:24.501214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233648+0000","last_change":"2024-09-12T18:17:57.233340+0000","last_active":"2024-09-12T18:17:57.233648+0000","last_peered":"2024-09-12T18:17:57.233648+0000","last_clean":"2024-09-12T18:17:57.233648+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:17:57.233648+0000","last_undegraded":"2024-09-12T18:17:57.233648+0000","last_fullsized":"2024-09-12T18:17:57.233648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:33.474988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851990+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:56.851990+0000","last_peered":"2024-09-12T18:17:56.851990+0000","last_clean":"2024-09-12T18:17:56.851990+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:56.851990+0000","last_undegraded":"2024-09-12T18:17:56.851990+0000","last_fullsized":"2024-09-12T18:17:56.851990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235182+0000","last_change":"2024-09-12T18:17:57.234956+0000","last_active":"2024-09-12T18:17:57.235182+0000","last_peered":"2024-09-12T18:17:57.235182+0000","last_clean":"2024-09-12T18:17:57.235182+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:17:57.235182+0000","last_undegraded":"2024-09-12T18:17:57.235182+0000","last_fullsized":"2024-09-12T18:17:57.235182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.824054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232361+0000","last_change":"2024-09-12T18:17:57.230917+0000","last_active":"2024-09-12T18:17:57.232361+0000","last_peered":"2024-09-12T18:17:57.232361+0000","last_clean":"2024-09-12T18:17:57.232361+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:17:57.232361+0000","last_undegraded":"2024-09-12T18:17:57.232361+0000","last_fullsized":"2024-09-12T18:17:57.232361+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:50.167605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850645+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:56.850645+0000","last_peered":"2024-09-12T18:17:56.850645+0000","last_clean":"2024-09-12T18:17:56.850645+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:56.850645+0000","last_undegraded":"2024-09-12T18:17:56.850645+0000","last_fullsized":"2024-09-12T18:17:56.850645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:39.610130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850143+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:56.850143+0000","last_peered":"2024-09-12T18:17:56.850143+0000","last_clean":"2024-09-12T18:17:56.850143+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:56.850143+0000","last_undegraded":"2024-09-12T18:17:56.850143+0000","last_fullsized":"2024-09-12T18:17:56.850143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850113+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:56.850113+0000","last_peered":"2024-09-12T18:17:56.850113+0000","last_clean":"2024-09-12T18:17:56.850113+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:56.850113+0000","last_undegraded":"2024-09-12T18:17:56.850113+0000","last_fullsized":"2024-09-12T18:17:56.850113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852998+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:56.852998+0000","last_peered":"2024-09-12T18:17:56.852998+0000","last_clean":"2024-09-12T18:17:56.852998+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:56.852998+0000","last_undegraded":"2024-09-12T18:17:56.852998+0000","last_fullsized":"2024-09-12T18:17:56.852998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:51.892500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227680+0000","last_change":"2024-09-12T18:17:57.227409+0000","last_active":"2024-09-12T18:17:57.227680+0000","last_peered":"2024-09-12T18:17:57.227680+0000","last_clean":"2024-09-12T18:17:57.227680+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:17:57.227680+0000","last_undegraded":"2024-09-12T18:17:57.227680+0000","last_fullsized":"2024-09-12T18:17:57.227680+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:53.730736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851901+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:56.851901+0000","last_peered":"2024-09-12T18:17:56.851901+0000","last_clean":"2024-09-12T18:17:56.851901+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:56.851901+0000","last_undegraded":"2024-09-12T18:17:56.851901+0000","last_fullsized":"2024-09-12T18:17:56.851901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851773+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:56.851773+0000","last_peered":"2024-09-12T18:17:56.851773+0000","last_clean":"2024-09-12T18:17:56.851773+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:56.851773+0000","last_undegraded":"2024-09-12T18:17:56.851773+0000","last_fullsized":"2024-09-12T18:17:56.851773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852236+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:56.852236+0000","last_peered":"2024-09-12T18:17:56.852236+0000","last_clean":"2024-09-12T18:17:56.852236+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:56.852236+0000","last_undegraded":"2024-09-12T18:17:56.852236+0000","last_fullsized":"2024-09-12T18:17:56.852236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220666+0000","last_change":"2024-09-12T18:17:57.220151+0000","last_active":"2024-09-12T18:17:57.220666+0000","last_peered":"2024-09-12T18:17:57.220666+0000","last_clean":"2024-09-12T18:17:57.220666+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:17:57.220666+0000","last_undegraded":"2024-09-12T18:17:57.220666+0000","last_fullsized":"2024-09-12T18:17:57.220666+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:02.044417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851051+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:56.851051+0000","last_peered":"2024-09-12T18:17:56.851051+0000","last_clean":"2024-09-12T18:17:56.851051+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:56.851051+0000","last_undegraded":"2024-09-12T18:17:56.851051+0000","last_fullsized":"2024-09-12T18:17:56.851051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220570+0000","last_change":"2024-09-12T18:17:57.220296+0000","last_active":"2024-09-12T18:17:57.220570+0000","last_peered":"2024-09-12T18:17:57.220570+0000","last_clean":"2024-09-12T18:17:57.220570+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:17:57.220570+0000","last_undegraded":"2024-09-12T18:17:57.220570+0000","last_fullsized":"2024-09-12T18:17:57.220570+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:21.286087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.214122+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:57.214122+0000","last_peered":"2024-09-12T18:17:57.214122+0000","last_clean":"2024-09-12T18:17:57.214122+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:57.214122+0000","last_undegraded":"2024-09-12T18:17:57.214122+0000","last_fullsized":"2024-09-12T18:17:57.214122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852858+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:56.852858+0000","last_peered":"2024-09-12T18:17:56.852858+0000","last_clean":"2024-09-12T18:17:56.852858+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:56.852858+0000","last_undegraded":"2024-09-12T18:17:56.852858+0000","last_fullsized":"2024-09-12T18:17:56.852858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850807+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:56.850807+0000","last_peered":"2024-09-12T18:17:56.850807+0000","last_clean":"2024-09-12T18:17:56.850807+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:56.850807+0000","last_undegraded":"2024-09-12T18:17:56.850807+0000","last_fullsized":"2024-09-12T18:17:56.850807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235784+0000","last_change":"2024-09-12T18:17:57.235643+0000","last_active":"2024-09-12T18:17:57.235784+0000","last_peered":"2024-09-12T18:17:57.235784+0000","last_clean":"2024-09-12T18:17:57.235784+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:17:57.235784+0000","last_undegraded":"2024-09-12T18:17:57.235784+0000","last_fullsized":"2024-09-12T18:17:57.235784+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:05.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851258+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:56.851258+0000","last_peered":"2024-09-12T18:17:56.851258+0000","last_clean":"2024-09-12T18:17:56.851258+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:56.851258+0000","last_undegraded":"2024-09-12T18:17:56.851258+0000","last_fullsized":"2024-09-12T18:17:56.851258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227093+0000","last_change":"2024-09-12T18:17:57.226832+0000","last_active":"2024-09-12T18:17:57.227093+0000","last_peered":"2024-09-12T18:17:57.227093+0000","last_clean":"2024-09-12T18:17:57.227093+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:17:57.227093+0000","last_undegraded":"2024-09-12T18:17:57.227093+0000","last_fullsized":"2024-09-12T18:17:57.227093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:59.362317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850846+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:56.850846+0000","last_peered":"2024-09-12T18:17:56.850846+0000","last_clean":"2024-09-12T18:17:56.850846+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:56.850846+0000","last_undegraded":"2024-09-12T18:17:56.850846+0000","last_fullsized":"2024-09-12T18:17:56.850846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850382+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:56.850382+0000","last_peered":"2024-09-12T18:17:56.850382+0000","last_clean":"2024-09-12T18:17:56.850382+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:56.850382+0000","last_undegraded":"2024-09-12T18:17:56.850382+0000","last_fullsized":"2024-09-12T18:17:56.850382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233319+0000","last_change":"2024-09-12T18:17:57.232930+0000","last_active":"2024-09-12T18:17:57.233319+0000","last_peered":"2024-09-12T18:17:57.233319+0000","last_clean":"2024-09-12T18:17:57.233319+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:17:57.233319+0000","last_undegraded":"2024-09-12T18:17:57.233319+0000","last_fullsized":"2024-09-12T18:17:57.233319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:01.904120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":178,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852254+0000","last_change":"2024-09-12T18:13:22.414603+0000","last_active":"2024-09-12T18:17:56.852254+0000","last_peered":"2024-09-12T18:17:56.852254+0000","last_clean":"2024-09-12T18:17:56.852254+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:17:56.852254+0000","last_undegraded":"2024-09-12T18:17:56.852254+0000","last_fullsized":"2024-09-12T18:17:56.852254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:15.782148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224231+0000","last_change":"2024-09-12T18:17:57.223948+0000","last_active":"2024-09-12T18:17:57.224231+0000","last_peered":"2024-09-12T18:17:57.224231+0000","last_clean":"2024-09-12T18:17:57.224231+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:17:57.224231+0000","last_undegraded":"2024-09-12T18:17:57.224231+0000","last_fullsized":"2024-09-12T18:17:57.224231+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.983211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":174,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852089+0000","last_change":"2024-09-12T18:17:52.825472+0000","last_active":"2024-09-12T18:17:56.852089+0000","last_peered":"2024-09-12T18:17:56.852089+0000","last_clean":"2024-09-12T18:17:56.852089+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:17:56.852089+0000","last_undegraded":"2024-09-12T18:17:56.852089+0000","last_fullsized":"2024-09-12T18:17:56.852089+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:11.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":174,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852112+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:56.852112+0000","last_peered":"2024-09-12T18:17:56.852112+0000","last_clean":"2024-09-12T18:17:56.852112+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:56.852112+0000","last_undegraded":"2024-09-12T18:17:56.852112+0000","last_fullsized":"2024-09-12T18:17:56.852112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:24.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.215322+0000","last_change":"2024-09-12T18:17:44.195812+0000","last_active":"2024-09-12T18:17:57.215322+0000","last_peered":"2024-09-12T18:17:57.215322+0000","last_clean":"2024-09-12T18:17:57.215322+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:17:57.215322+0000","last_undegraded":"2024-09-12T18:17:57.215322+0000","last_fullsized":"2024-09-12T18:17:57.215322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:15.358165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":172,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851500+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:56.851500+0000","last_peered":"2024-09-12T18:17:56.851500+0000","last_clean":"2024-09-12T18:17:56.851500+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:56.851500+0000","last_undegraded":"2024-09-12T18:17:56.851500+0000","last_fullsized":"2024-09-12T18:17:56.851500+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:37.804558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":167,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850656+0000","last_change":"2024-09-12T18:17:54.850651+0000","last_active":"2024-09-12T18:17:56.850656+0000","last_peered":"2024-09-12T18:17:56.850656+0000","last_clean":"2024-09-12T18:17:56.850656+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:17:56.850656+0000","last_undegraded":"2024-09-12T18:17:56.850656+0000","last_fullsized":"2024-09-12T18:17:56.850656+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:21.588951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":187,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852301+0000","last_change":"2024-09-12T18:17:36.785118+0000","last_active":"2024-09-12T18:17:56.852301+0000","last_peered":"2024-09-12T18:17:56.852301+0000","last_clean":"2024-09-12T18:17:56.852301+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:17:56.852301+0000","last_undegraded":"2024-09-12T18:17:56.852301+0000","last_fullsized":"2024-09-12T18:17:56.852301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:22.568034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227511+0000","last_change":"2024-09-12T18:17:57.227263+0000","last_active":"2024-09-12T18:17:57.227511+0000","last_peered":"2024-09-12T18:17:57.227511+0000","last_clean":"2024-09-12T18:17:57.227511+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:17:57.227511+0000","last_undegraded":"2024-09-12T18:17:57.227511+0000","last_fullsized":"2024-09-12T18:17:57.227511+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:30.897409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226272+0000","last_change":"2024-09-12T18:17:57.225984+0000","last_active":"2024-09-12T18:17:57.226272+0000","last_peered":"2024-09-12T18:17:57.226272+0000","last_clean":"2024-09-12T18:17:57.226272+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:17:57.226272+0000","last_undegraded":"2024-09-12T18:17:57.226272+0000","last_fullsized":"2024-09-12T18:17:57.226272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:16.533302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.234686+0000","last_change":"2024-09-12T18:17:57.233612+0000","last_active":"2024-09-12T18:17:57.234686+0000","last_peered":"2024-09-12T18:17:57.234686+0000","last_clean":"2024-09-12T18:17:57.234686+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:17:57.234686+0000","last_undegraded":"2024-09-12T18:17:57.234686+0000","last_fullsized":"2024-09-12T18:17:57.234686+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:49.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852823+0000","last_change":"2024-09-12T18:17:43.850032+0000","last_active":"2024-09-12T18:17:56.852823+0000","last_peered":"2024-09-12T18:17:56.852823+0000","last_clean":"2024-09-12T18:17:56.852823+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:17:56.852823+0000","last_undegraded":"2024-09-12T18:17:56.852823+0000","last_fullsized":"2024-09-12T18:17:56.852823+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:19.847834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.849922+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:56.849922+0000","last_peered":"2024-09-12T18:17:56.849922+0000","last_clean":"2024-09-12T18:17:56.849922+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:56.849922+0000","last_undegraded":"2024-09-12T18:17:56.849922+0000","last_fullsized":"2024-09-12T18:17:56.849922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852376+0000","last_change":"2024-09-12T18:17:54.848137+0000","last_active":"2024-09-12T18:17:56.852376+0000","last_peered":"2024-09-12T18:17:56.852376+0000","last_clean":"2024-09-12T18:17:56.852376+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:17:56.852376+0000","last_undegraded":"2024-09-12T18:17:56.852376+0000","last_fullsized":"2024-09-12T18:17:56.852376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:47.582059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851092+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:56.851092+0000","last_peered":"2024-09-12T18:17:56.851092+0000","last_clean":"2024-09-12T18:17:56.851092+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:56.851092+0000","last_undegraded":"2024-09-12T18:17:56.851092+0000","last_fullsized":"2024-09-12T18:17:56.851092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":203,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850804+0000","last_change":"2024-09-12T18:17:43.846663+0000","last_active":"2024-09-12T18:17:56.850804+0000","last_peered":"2024-09-12T18:17:56.850804+0000","last_clean":"2024-09-12T18:17:56.850804+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:17:56.850804+0000","last_undegraded":"2024-09-12T18:17:56.850804+0000","last_fullsized":"2024-09-12T18:17:56.850804+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:52.288114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":114,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851005+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:56.851005+0000","last_peered":"2024-09-12T18:17:56.851005+0000","last_clean":"2024-09-12T18:17:56.851005+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:56.851005+0000","last_undegraded":"2024-09-12T18:17:56.851005+0000","last_fullsized":"2024-09-12T18:17:56.851005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851788+0000","last_change":"2024-09-12T18:17:54.844194+0000","last_active":"2024-09-12T18:17:56.851788+0000","last_peered":"2024-09-12T18:17:56.851788+0000","last_clean":"2024-09-12T18:17:56.851788+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:17:56.851788+0000","last_undegraded":"2024-09-12T18:17:56.851788+0000","last_fullsized":"2024-09-12T18:17:56.851788+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:26.010260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852314+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:56.852314+0000","last_peered":"2024-09-12T18:17:56.852314+0000","last_clean":"2024-09-12T18:17:56.852314+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:56.852314+0000","last_undegraded":"2024-09-12T18:17:56.852314+0000","last_fullsized":"2024-09-12T18:17:56.852314+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232120+0000","last_change":"2024-09-12T18:17:57.231837+0000","last_active":"2024-09-12T18:17:57.232120+0000","last_peered":"2024-09-12T18:17:57.232120+0000","last_clean":"2024-09-12T18:17:57.232120+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:17:57.232120+0000","last_undegraded":"2024-09-12T18:17:57.232120+0000","last_fullsized":"2024-09-12T18:17:57.232120+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:27.028425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851299+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:56.851299+0000","last_peered":"2024-09-12T18:17:56.851299+0000","last_clean":"2024-09-12T18:17:56.851299+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:56.851299+0000","last_undegraded":"2024-09-12T18:17:56.851299+0000","last_fullsized":"2024-09-12T18:17:56.851299+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232131+0000","last_change":"2024-09-12T18:17:57.231804+0000","last_active":"2024-09-12T18:17:57.232131+0000","last_peered":"2024-09-12T18:17:57.232131+0000","last_clean":"2024-09-12T18:17:57.232131+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:17:57.232131+0000","last_undegraded":"2024-09-12T18:17:57.232131+0000","last_fullsized":"2024-09-12T18:17:57.232131+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:56.591750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851626+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:56.851626+0000","last_peered":"2024-09-12T18:17:56.851626+0000","last_clean":"2024-09-12T18:17:56.851626+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:56.851626+0000","last_undegraded":"2024-09-12T18:17:56.851626+0000","last_fullsized":"2024-09-12T18:17:56.851626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'112","reported_seq":176,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.849493+0000","last_change":"2024-09-12T18:17:46.785093+0000","last_active":"2024-09-12T18:17:56.849493+0000","last_peered":"2024-09-12T18:17:56.849493+0000","last_clean":"2024-09-12T18:17:56.849493+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:17:56.849493+0000","last_undegraded":"2024-09-12T18:17:56.849493+0000","last_fullsized":"2024-09-12T18:17:56.849493+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:11.271904+0000","last_clean_scrub_stamp":"2024-09-12T18:13:11.271904+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:07.703117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852560+0000","last_change":"2024-09-12T18:13:19.361027+0000","last_active":"2024-09-12T18:17:56.852560+0000","last_peered":"2024-09-12T18:17:56.852560+0000","last_clean":"2024-09-12T18:17:56.852560+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:17:56.852560+0000","last_undegraded":"2024-09-12T18:17:56.852560+0000","last_fullsized":"2024-09-12T18:17:56.852560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:33.797344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852491+0000","last_change":"2024-09-12T18:17:36.800387+0000","last_active":"2024-09-12T18:17:56.852491+0000","last_peered":"2024-09-12T18:17:56.852491+0000","last_clean":"2024-09-12T18:17:56.852491+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:17:56.852491+0000","last_undegraded":"2024-09-12T18:17:56.852491+0000","last_fullsized":"2024-09-12T18:17:56.852491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:59.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852972+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:56.852972+0000","last_peered":"2024-09-12T18:17:56.852972+0000","last_clean":"2024-09-12T18:17:56.852972+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:56.852972+0000","last_undegraded":"2024-09-12T18:17:56.852972+0000","last_fullsized":"2024-09-12T18:17:56.852972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851245+0000","last_change":"2024-09-12T18:17:36.783284+0000","last_active":"2024-09-12T18:17:56.851245+0000","last_peered":"2024-09-12T18:17:56.851245+0000","last_clean":"2024-09-12T18:17:56.851245+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:17:56.851245+0000","last_undegraded":"2024-09-12T18:17:56.851245+0000","last_fullsized":"2024-09-12T18:17:56.851245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:09.643657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":193,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850278+0000","last_change":"2024-09-12T18:17:43.837153+0000","last_active":"2024-09-12T18:17:56.850278+0000","last_peered":"2024-09-12T18:17:56.850278+0000","last_clean":"2024-09-12T18:17:56.850278+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:17:56.850278+0000","last_undegraded":"2024-09-12T18:17:56.850278+0000","last_fullsized":"2024-09-12T18:17:56.850278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:44.908861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216973+0000","last_change":"2024-09-12T18:17:37.170874+0000","last_active":"2024-09-12T18:17:57.216973+0000","last_peered":"2024-09-12T18:17:57.216973+0000","last_clean":"2024-09-12T18:17:57.216973+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:17:57.216973+0000","last_undegraded":"2024-09-12T18:17:57.216973+0000","last_fullsized":"2024-09-12T18:17:57.216973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:56.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851836+0000","last_change":"2024-09-12T18:17:36.808753+0000","last_active":"2024-09-12T18:17:56.851836+0000","last_peered":"2024-09-12T18:17:56.851836+0000","last_clean":"2024-09-12T18:17:56.851836+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:17:56.851836+0000","last_undegraded":"2024-09-12T18:17:56.851836+0000","last_fullsized":"2024-09-12T18:17:56.851836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:47.994123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229674+0000","last_change":"2024-09-12T18:17:57.229183+0000","last_active":"2024-09-12T18:17:57.229674+0000","last_peered":"2024-09-12T18:17:57.229674+0000","last_clean":"2024-09-12T18:17:57.229674+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:17:57.229674+0000","last_undegraded":"2024-09-12T18:17:57.229674+0000","last_fullsized":"2024-09-12T18:17:57.229674+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:49.982893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851886+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:56.851886+0000","last_peered":"2024-09-12T18:17:56.851886+0000","last_clean":"2024-09-12T18:17:56.851886+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:56.851886+0000","last_undegraded":"2024-09-12T18:17:56.851886+0000","last_fullsized":"2024-09-12T18:17:56.851886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852142+0000","last_change":"2024-09-12T18:13:19.362461+0000","last_active":"2024-09-12T18:17:56.852142+0000","last_peered":"2024-09-12T18:17:56.852142+0000","last_clean":"2024-09-12T18:17:56.852142+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:17:56.852142+0000","last_undegraded":"2024-09-12T18:17:56.852142+0000","last_fullsized":"2024-09-12T18:17:56.852142+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:03.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":177,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852485+0000","last_change":"2024-09-12T18:13:22.415899+0000","last_active":"2024-09-12T18:17:56.852485+0000","last_peered":"2024-09-12T18:17:56.852485+0000","last_clean":"2024-09-12T18:17:56.852485+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:17:56.852485+0000","last_undegraded":"2024-09-12T18:17:56.852485+0000","last_fullsized":"2024-09-12T18:17:56.852485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:50.790611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851823+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:56.851823+0000","last_peered":"2024-09-12T18:17:56.851823+0000","last_clean":"2024-09-12T18:17:56.851823+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:56.851823+0000","last_undegraded":"2024-09-12T18:17:56.851823+0000","last_fullsized":"2024-09-12T18:17:56.851823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.853133+0000","last_change":"2024-09-12T18:17:54.845043+0000","last_active":"2024-09-12T18:17:56.853133+0000","last_peered":"2024-09-12T18:17:56.853133+0000","last_clean":"2024-09-12T18:17:56.853133+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:17:56.853133+0000","last_undegraded":"2024-09-12T18:17:56.853133+0000","last_fullsized":"2024-09-12T18:17:56.853133+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:09.770075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852200+0000","last_change":"2024-09-12T18:17:36.801291+0000","last_active":"2024-09-12T18:17:56.852200+0000","last_peered":"2024-09-12T18:17:56.852200+0000","last_clean":"2024-09-12T18:17:56.852200+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:17:56.852200+0000","last_undegraded":"2024-09-12T18:17:56.852200+0000","last_fullsized":"2024-09-12T18:17:56.852200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:52.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220650+0000","last_change":"2024-09-12T18:17:57.220336+0000","last_active":"2024-09-12T18:17:57.220650+0000","last_peered":"2024-09-12T18:17:57.220650+0000","last_clean":"2024-09-12T18:17:57.220650+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:17:57.220650+0000","last_undegraded":"2024-09-12T18:17:57.220650+0000","last_fullsized":"2024-09-12T18:17:57.220650+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:32.842004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852108+0000","last_change":"2024-09-12T18:17:36.796896+0000","last_active":"2024-09-12T18:17:56.852108+0000","last_peered":"2024-09-12T18:17:56.852108+0000","last_clean":"2024-09-12T18:17:56.852108+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:17:56.852108+0000","last_undegraded":"2024-09-12T18:17:56.852108+0000","last_fullsized":"2024-09-12T18:17:56.852108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:46.283613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.217254+0000","last_change":"2024-09-12T18:17:37.170969+0000","last_active":"2024-09-12T18:17:57.217254+0000","last_peered":"2024-09-12T18:17:57.217254+0000","last_clean":"2024-09-12T18:17:57.217254+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:17:57.217254+0000","last_undegraded":"2024-09-12T18:17:57.217254+0000","last_fullsized":"2024-09-12T18:17:57.217254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:36.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232147+0000","last_change":"2024-09-12T18:17:57.231857+0000","last_active":"2024-09-12T18:17:57.232147+0000","last_peered":"2024-09-12T18:17:57.232147+0000","last_clean":"2024-09-12T18:17:57.232147+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:17:57.232147+0000","last_undegraded":"2024-09-12T18:17:57.232147+0000","last_fullsized":"2024-09-12T18:17:57.232147+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:28.991322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.853002+0000","last_change":"2024-09-12T18:17:36.801133+0000","last_active":"2024-09-12T18:17:56.853002+0000","last_peered":"2024-09-12T18:17:56.853002+0000","last_clean":"2024-09-12T18:17:56.853002+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:17:56.853002+0000","last_undegraded":"2024-09-12T18:17:56.853002+0000","last_fullsized":"2024-09-12T18:17:56.853002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:00.012060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851845+0000","last_change":"2024-09-12T18:17:36.805539+0000","last_active":"2024-09-12T18:17:56.851845+0000","last_peered":"2024-09-12T18:17:56.851845+0000","last_clean":"2024-09-12T18:17:56.851845+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:17:56.851845+0000","last_undegraded":"2024-09-12T18:17:56.851845+0000","last_fullsized":"2024-09-12T18:17:56.851845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:08.540232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851036+0000","last_change":"2024-09-12T18:17:43.838249+0000","last_active":"2024-09-12T18:17:56.851036+0000","last_peered":"2024-09-12T18:17:56.851036+0000","last_clean":"2024-09-12T18:17:56.851036+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:17:56.851036+0000","last_undegraded":"2024-09-12T18:17:56.851036+0000","last_fullsized":"2024-09-12T18:17:56.851036+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:22.433973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":202,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852710+0000","last_change":"2024-09-12T18:17:43.870789+0000","last_active":"2024-09-12T18:17:56.852710+0000","last_peered":"2024-09-12T18:17:56.852710+0000","last_clean":"2024-09-12T18:17:56.852710+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:17:56.852710+0000","last_undegraded":"2024-09-12T18:17:56.852710+0000","last_fullsized":"2024-09-12T18:17:56.852710+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:49.502247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852321+0000","last_change":"2024-09-12T18:17:36.785038+0000","last_active":"2024-09-12T18:17:56.852321+0000","last_peered":"2024-09-12T18:17:56.852321+0000","last_clean":"2024-09-12T18:17:56.852321+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:17:56.852321+0000","last_undegraded":"2024-09-12T18:17:56.852321+0000","last_fullsized":"2024-09-12T18:17:56.852321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:16.311210+0000","last_clean_scrub_stamp":"2024-09-12T18:13:16.311210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:16.239019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":104,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226762+0000","last_change":"2024-09-12T18:17:57.226471+0000","last_active":"2024-09-12T18:17:57.226762+0000","last_peered":"2024-09-12T18:17:57.226762+0000","last_clean":"2024-09-12T18:17:57.226762+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:17:57.226762+0000","last_undegraded":"2024-09-12T18:17:57.226762+0000","last_fullsized":"2024-09-12T18:17:57.226762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:17.288097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850879+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:56.850879+0000","last_peered":"2024-09-12T18:17:56.850879+0000","last_clean":"2024-09-12T18:17:56.850879+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:56.850879+0000","last_undegraded":"2024-09-12T18:17:56.850879+0000","last_fullsized":"2024-09-12T18:17:56.850879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":165,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852061+0000","last_change":"2024-09-12T18:17:54.850699+0000","last_active":"2024-09-12T18:17:56.852061+0000","last_peered":"2024-09-12T18:17:56.852061+0000","last_clean":"2024-09-12T18:17:56.852061+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:17:56.852061+0000","last_undegraded":"2024-09-12T18:17:56.852061+0000","last_fullsized":"2024-09-12T18:17:56.852061+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:42.033453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850897+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:56.850897+0000","last_peered":"2024-09-12T18:17:56.850897+0000","last_clean":"2024-09-12T18:17:56.850897+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:56.850897+0000","last_undegraded":"2024-09-12T18:17:56.850897+0000","last_fullsized":"2024-09-12T18:17:56.850897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.157499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232331+0000","last_change":"2024-09-12T18:17:57.232052+0000","last_active":"2024-09-12T18:17:57.232331+0000","last_peered":"2024-09-12T18:17:57.232331+0000","last_clean":"2024-09-12T18:17:57.232331+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:17:57.232331+0000","last_undegraded":"2024-09-12T18:17:57.232331+0000","last_fullsized":"2024-09-12T18:17:57.232331+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:45.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":128,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851691+0000","last_change":"2024-09-12T18:17:54.840249+0000","last_active":"2024-09-12T18:17:56.851691+0000","last_peered":"2024-09-12T18:17:56.851691+0000","last_clean":"2024-09-12T18:17:56.851691+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:17:56.851691+0000","last_undegraded":"2024-09-12T18:17:56.851691+0000","last_fullsized":"2024-09-12T18:17:56.851691+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:47.078593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":174,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850787+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:56.850787+0000","last_peered":"2024-09-12T18:17:56.850787+0000","last_clean":"2024-09-12T18:17:56.850787+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:56.850787+0000","last_undegraded":"2024-09-12T18:17:56.850787+0000","last_fullsized":"2024-09-12T18:17:56.850787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.211628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852732+0000","last_change":"2024-09-12T18:17:52.823288+0000","last_active":"2024-09-12T18:17:56.852732+0000","last_peered":"2024-09-12T18:17:56.852732+0000","last_clean":"2024-09-12T18:17:56.852732+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:17:56.852732+0000","last_undegraded":"2024-09-12T18:17:56.852732+0000","last_fullsized":"2024-09-12T18:17:56.852732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:50.555729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850588+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:56.850588+0000","last_peered":"2024-09-12T18:17:56.850588+0000","last_clean":"2024-09-12T18:17:56.850588+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:56.850588+0000","last_undegraded":"2024-09-12T18:17:56.850588+0000","last_fullsized":"2024-09-12T18:17:56.850588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:42.086552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224059+0000","last_change":"2024-09-12T18:17:57.223771+0000","last_active":"2024-09-12T18:17:57.224059+0000","last_peered":"2024-09-12T18:17:57.224059+0000","last_clean":"2024-09-12T18:17:57.224059+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:17:57.224059+0000","last_undegraded":"2024-09-12T18:17:57.224059+0000","last_fullsized":"2024-09-12T18:17:57.224059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:16.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851415+0000","last_change":"2024-09-12T18:17:36.799768+0000","last_active":"2024-09-12T18:17:56.851415+0000","last_peered":"2024-09-12T18:17:56.851415+0000","last_clean":"2024-09-12T18:17:56.851415+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:17:56.851415+0000","last_undegraded":"2024-09-12T18:17:56.851415+0000","last_fullsized":"2024-09-12T18:17:56.851415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.019966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852569+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:56.852569+0000","last_peered":"2024-09-12T18:17:56.852569+0000","last_clean":"2024-09-12T18:17:56.852569+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:56.852569+0000","last_undegraded":"2024-09-12T18:17:56.852569+0000","last_fullsized":"2024-09-12T18:17:56.852569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850518+0000","last_change":"2024-09-12T18:17:43.837788+0000","last_active":"2024-09-12T18:17:56.850518+0000","last_peered":"2024-09-12T18:17:56.850518+0000","last_clean":"2024-09-12T18:17:56.850518+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:17:56.850518+0000","last_undegraded":"2024-09-12T18:17:56.850518+0000","last_fullsized":"2024-09-12T18:17:56.850518+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:27.702672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.213116+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:57.213116+0000","last_peered":"2024-09-12T18:17:57.213116+0000","last_clean":"2024-09-12T18:17:57.213116+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:57.213116+0000","last_undegraded":"2024-09-12T18:17:57.213116+0000","last_fullsized":"2024-09-12T18:17:57.213116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.226092+0000","last_change":"2024-09-12T18:17:57.224877+0000","last_active":"2024-09-12T18:17:57.226092+0000","last_peered":"2024-09-12T18:17:57.226092+0000","last_clean":"2024-09-12T18:17:57.226092+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:17:57.226092+0000","last_undegraded":"2024-09-12T18:17:57.226092+0000","last_fullsized":"2024-09-12T18:17:57.226092+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:50.751782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229368+0000","last_change":"2024-09-12T18:17:57.227693+0000","last_active":"2024-09-12T18:17:57.229368+0000","last_peered":"2024-09-12T18:17:57.229368+0000","last_clean":"2024-09-12T18:17:57.229368+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:17:57.229368+0000","last_undegraded":"2024-09-12T18:17:57.229368+0000","last_fullsized":"2024-09-12T18:17:57.229368+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.861398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224859+0000","last_change":"2024-09-12T18:17:57.224577+0000","last_active":"2024-09-12T18:17:57.224859+0000","last_peered":"2024-09-12T18:17:57.224859+0000","last_clean":"2024-09-12T18:17:57.224859+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:17:57.224859+0000","last_undegraded":"2024-09-12T18:17:57.224859+0000","last_fullsized":"2024-09-12T18:17:57.224859+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:27.343760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":114,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850191+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:56.850191+0000","last_peered":"2024-09-12T18:17:56.850191+0000","last_clean":"2024-09-12T18:17:56.850191+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:56.850191+0000","last_undegraded":"2024-09-12T18:17:56.850191+0000","last_fullsized":"2024-09-12T18:17:56.850191+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":143,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850986+0000","last_change":"2024-09-12T18:17:54.854658+0000","last_active":"2024-09-12T18:17:56.850986+0000","last_peered":"2024-09-12T18:17:56.850986+0000","last_clean":"2024-09-12T18:17:56.850986+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:17:56.850986+0000","last_undegraded":"2024-09-12T18:17:56.850986+0000","last_fullsized":"2024-09-12T18:17:56.850986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:40.476487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":114,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850709+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:56.850709+0000","last_peered":"2024-09-12T18:17:56.850709+0000","last_clean":"2024-09-12T18:17:56.850709+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:56.850709+0000","last_undegraded":"2024-09-12T18:17:56.850709+0000","last_fullsized":"2024-09-12T18:17:56.850709+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224687+0000","last_change":"2024-09-12T18:17:57.224380+0000","last_active":"2024-09-12T18:17:57.224687+0000","last_peered":"2024-09-12T18:17:57.224687+0000","last_clean":"2024-09-12T18:17:57.224687+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:17:57.224687+0000","last_undegraded":"2024-09-12T18:17:57.224687+0000","last_fullsized":"2024-09-12T18:17:57.224687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:07.158110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224203+0000","last_change":"2024-09-12T18:17:57.223910+0000","last_active":"2024-09-12T18:17:57.224203+0000","last_peered":"2024-09-12T18:17:57.224203+0000","last_clean":"2024-09-12T18:17:57.224203+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:17:57.224203+0000","last_undegraded":"2024-09-12T18:17:57.224203+0000","last_fullsized":"2024-09-12T18:17:57.224203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:01.950899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":187,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.853396+0000","last_change":"2024-09-12T18:17:36.809163+0000","last_active":"2024-09-12T18:17:56.853396+0000","last_peered":"2024-09-12T18:17:56.853396+0000","last_clean":"2024-09-12T18:17:56.853396+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:17:56.853396+0000","last_undegraded":"2024-09-12T18:17:56.853396+0000","last_fullsized":"2024-09-12T18:17:56.853396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:32.132781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":174,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850972+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:56.850972+0000","last_peered":"2024-09-12T18:17:56.850972+0000","last_clean":"2024-09-12T18:17:56.850972+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:56.850972+0000","last_undegraded":"2024-09-12T18:17:56.850972+0000","last_fullsized":"2024-09-12T18:17:56.850972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:16.234172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":209,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852148+0000","last_change":"2024-09-12T18:17:43.861774+0000","last_active":"2024-09-12T18:17:56.852148+0000","last_peered":"2024-09-12T18:17:56.852148+0000","last_clean":"2024-09-12T18:17:56.852148+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:17:56.852148+0000","last_undegraded":"2024-09-12T18:17:56.852148+0000","last_fullsized":"2024-09-12T18:17:56.852148+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:21.360759+0000","last_clean_scrub_stamp":"2024-09-12T18:13:21.360759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:07.298644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280832,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091008,"statfs":{"total":96636764160,"available":96349192192,"internally_reserved":0,"allocated":1159168,"data_stored":1054579,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397380,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974460,"statfs":{"total":96636764160,"available":96229847040,"internally_reserved":0,"allocated":1093632,"data_stored":462417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285575,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46284,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":45114,"kb_avail":94325556,"statfs":{"total":96636764160,"available":96589369344,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":46196839},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:05.196 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.196 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.196 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.197 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.198 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.199 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.200 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.201 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.202 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.202 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.202 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.202 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.202 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.202 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T18:13:11.271904+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.203 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.204 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.205 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T18:13:16.311210+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.206 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.207 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.208 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.209 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.209 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.209 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T18:13:21.360759+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:05.209 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:18:25.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:25.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:25.541 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:25.557 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-12T18:18:24.478588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":728632,"kb_used_data":3336,"kb_used_omap":9,"kb_used_meta":725238,"kb_avail":282386888,"statfs":{"total":289910292480,"available":289164173312,"internally_reserved":0,"allocated":3416064,"data_stored":2570940,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":742644721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004493"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.216946+0000","last_change":"2024-09-12T18:17:37.157936+0000","last_active":"2024-09-12T18:17:57.216946+0000","last_peered":"2024-09-12T18:17:57.216946+0000","last_clean":"2024-09-12T18:17:57.216946+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:17:57.216946+0000","last_undegraded":"2024-09-12T18:17:57.216946+0000","last_fullsized":"2024-09-12T18:17:57.216946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:24.471880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.230978+0000","last_change":"2024-09-12T18:17:57.230711+0000","last_active":"2024-09-12T18:17:57.230978+0000","last_peered":"2024-09-12T18:17:57.230978+0000","last_clean":"2024-09-12T18:17:57.230978+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:17:57.230978+0000","last_undegraded":"2024-09-12T18:17:57.230978+0000","last_fullsized":"2024-09-12T18:17:57.230978+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:03.119606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851715+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:56.851715+0000","last_peered":"2024-09-12T18:17:56.851715+0000","last_clean":"2024-09-12T18:17:56.851715+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:56.851715+0000","last_undegraded":"2024-09-12T18:17:56.851715+0000","last_fullsized":"2024-09-12T18:17:56.851715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851684+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:56.851684+0000","last_peered":"2024-09-12T18:17:56.851684+0000","last_clean":"2024-09-12T18:17:56.851684+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:56.851684+0000","last_undegraded":"2024-09-12T18:17:56.851684+0000","last_fullsized":"2024-09-12T18:17:56.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227088+0000","last_change":"2024-09-12T18:17:57.226865+0000","last_active":"2024-09-12T18:17:57.227088+0000","last_peered":"2024-09-12T18:17:57.227088+0000","last_clean":"2024-09-12T18:17:57.227088+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:17:57.227088+0000","last_undegraded":"2024-09-12T18:17:57.227088+0000","last_fullsized":"2024-09-12T18:17:57.227088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.312438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":86,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850463+0000","last_change":"2024-09-12T18:17:54.846588+0000","last_active":"2024-09-12T18:17:56.850463+0000","last_peered":"2024-09-12T18:17:56.850463+0000","last_clean":"2024-09-12T18:17:56.850463+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:17:56.850463+0000","last_undegraded":"2024-09-12T18:17:56.850463+0000","last_fullsized":"2024-09-12T18:17:56.850463+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:50.655428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":109,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850411+0000","last_change":"2024-09-12T18:17:54.841128+0000","last_active":"2024-09-12T18:17:56.850411+0000","last_peered":"2024-09-12T18:17:56.850411+0000","last_clean":"2024-09-12T18:17:56.850411+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:17:56.850411+0000","last_undegraded":"2024-09-12T18:17:56.850411+0000","last_fullsized":"2024-09-12T18:17:56.850411+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:09.836126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.849821+0000","last_change":"2024-09-12T18:17:43.829973+0000","last_active":"2024-09-12T18:17:56.849821+0000","last_peered":"2024-09-12T18:17:56.849821+0000","last_clean":"2024-09-12T18:17:56.849821+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:17:56.849821+0000","last_undegraded":"2024-09-12T18:17:56.849821+0000","last_fullsized":"2024-09-12T18:17:56.849821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:45.894342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851492+0000","last_change":"2024-09-12T18:17:36.787103+0000","last_active":"2024-09-12T18:17:56.851492+0000","last_peered":"2024-09-12T18:17:56.851492+0000","last_clean":"2024-09-12T18:17:56.851492+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:17:56.851492+0000","last_undegraded":"2024-09-12T18:17:56.851492+0000","last_fullsized":"2024-09-12T18:17:56.851492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233648+0000","last_change":"2024-09-12T18:17:57.233340+0000","last_active":"2024-09-12T18:17:57.233648+0000","last_peered":"2024-09-12T18:17:57.233648+0000","last_clean":"2024-09-12T18:17:57.233648+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:17:57.233648+0000","last_undegraded":"2024-09-12T18:17:57.233648+0000","last_fullsized":"2024-09-12T18:17:57.233648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:33.474988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851990+0000","last_change":"2024-09-12T18:17:54.852551+0000","last_active":"2024-09-12T18:17:56.851990+0000","last_peered":"2024-09-12T18:17:56.851990+0000","last_clean":"2024-09-12T18:17:56.851990+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:17:56.851990+0000","last_undegraded":"2024-09-12T18:17:56.851990+0000","last_fullsized":"2024-09-12T18:17:56.851990+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:58.685257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235182+0000","last_change":"2024-09-12T18:17:57.234956+0000","last_active":"2024-09-12T18:17:57.235182+0000","last_peered":"2024-09-12T18:17:57.235182+0000","last_clean":"2024-09-12T18:17:57.235182+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:17:57.235182+0000","last_undegraded":"2024-09-12T18:17:57.235182+0000","last_fullsized":"2024-09-12T18:17:57.235182+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.824054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.232361+0000","last_change":"2024-09-12T18:17:57.230917+0000","last_active":"2024-09-12T18:17:57.232361+0000","last_peered":"2024-09-12T18:17:57.232361+0000","last_clean":"2024-09-12T18:17:57.232361+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:17:57.232361+0000","last_undegraded":"2024-09-12T18:17:57.232361+0000","last_fullsized":"2024-09-12T18:17:57.232361+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:50.167605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850768+0000","last_change":"2024-09-12T18:17:36.784945+0000","last_active":"2024-09-12T18:17:56.850768+0000","last_peered":"2024-09-12T18:17:56.850768+0000","last_clean":"2024-09-12T18:17:56.850768+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:17:56.850768+0000","last_undegraded":"2024-09-12T18:17:56.850768+0000","last_fullsized":"2024-09-12T18:17:56.850768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850143+0000","last_change":"2024-09-12T18:17:43.833598+0000","last_active":"2024-09-12T18:17:56.850143+0000","last_peered":"2024-09-12T18:17:56.850143+0000","last_clean":"2024-09-12T18:17:56.850143+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:17:56.850143+0000","last_undegraded":"2024-09-12T18:17:56.850143+0000","last_fullsized":"2024-09-12T18:17:56.850143+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:55.968464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850113+0000","last_change":"2024-09-12T18:17:54.850518+0000","last_active":"2024-09-12T18:17:56.850113+0000","last_peered":"2024-09-12T18:17:56.850113+0000","last_clean":"2024-09-12T18:17:56.850113+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:17:56.850113+0000","last_undegraded":"2024-09-12T18:17:56.850113+0000","last_fullsized":"2024-09-12T18:17:56.850113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:45.655319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.853123+0000","last_change":"2024-09-12T18:17:36.801529+0000","last_active":"2024-09-12T18:17:56.853123+0000","last_peered":"2024-09-12T18:17:56.853123+0000","last_clean":"2024-09-12T18:17:56.853123+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:17:56.853123+0000","last_undegraded":"2024-09-12T18:17:56.853123+0000","last_fullsized":"2024-09-12T18:17:56.853123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227680+0000","last_change":"2024-09-12T18:17:57.227409+0000","last_active":"2024-09-12T18:17:57.227680+0000","last_peered":"2024-09-12T18:17:57.227680+0000","last_clean":"2024-09-12T18:17:57.227680+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:17:57.227680+0000","last_undegraded":"2024-09-12T18:17:57.227680+0000","last_fullsized":"2024-09-12T18:17:57.227680+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:53.730736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851901+0000","last_change":"2024-09-12T18:17:36.800277+0000","last_active":"2024-09-12T18:17:56.851901+0000","last_peered":"2024-09-12T18:17:56.851901+0000","last_clean":"2024-09-12T18:17:56.851901+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:17:56.851901+0000","last_undegraded":"2024-09-12T18:17:56.851901+0000","last_fullsized":"2024-09-12T18:17:56.851901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:17.400854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":107,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851773+0000","last_change":"2024-09-12T18:17:54.851661+0000","last_active":"2024-09-12T18:17:56.851773+0000","last_peered":"2024-09-12T18:17:56.851773+0000","last_clean":"2024-09-12T18:17:56.851773+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:17:56.851773+0000","last_undegraded":"2024-09-12T18:17:56.851773+0000","last_fullsized":"2024-09-12T18:17:56.851773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:07.800044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852236+0000","last_change":"2024-09-12T18:17:43.833448+0000","last_active":"2024-09-12T18:17:56.852236+0000","last_peered":"2024-09-12T18:17:56.852236+0000","last_clean":"2024-09-12T18:17:56.852236+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:17:56.852236+0000","last_undegraded":"2024-09-12T18:17:56.852236+0000","last_fullsized":"2024-09-12T18:17:56.852236+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:13.324960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220666+0000","last_change":"2024-09-12T18:17:57.220151+0000","last_active":"2024-09-12T18:17:57.220666+0000","last_peered":"2024-09-12T18:17:57.220666+0000","last_clean":"2024-09-12T18:17:57.220666+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:17:57.220666+0000","last_undegraded":"2024-09-12T18:17:57.220666+0000","last_fullsized":"2024-09-12T18:17:57.220666+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:02.044417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851051+0000","last_change":"2024-09-12T18:17:43.841177+0000","last_active":"2024-09-12T18:17:56.851051+0000","last_peered":"2024-09-12T18:17:56.851051+0000","last_clean":"2024-09-12T18:17:56.851051+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:17:56.851051+0000","last_undegraded":"2024-09-12T18:17:56.851051+0000","last_fullsized":"2024-09-12T18:17:56.851051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:52.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.220570+0000","last_change":"2024-09-12T18:17:57.220296+0000","last_active":"2024-09-12T18:17:57.220570+0000","last_peered":"2024-09-12T18:17:57.220570+0000","last_clean":"2024-09-12T18:17:57.220570+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:17:57.220570+0000","last_undegraded":"2024-09-12T18:17:57.220570+0000","last_fullsized":"2024-09-12T18:17:57.220570+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:21.286087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.214122+0000","last_change":"2024-09-12T18:17:44.199915+0000","last_active":"2024-09-12T18:17:57.214122+0000","last_peered":"2024-09-12T18:17:57.214122+0000","last_clean":"2024-09-12T18:17:57.214122+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:17:57.214122+0000","last_undegraded":"2024-09-12T18:17:57.214122+0000","last_fullsized":"2024-09-12T18:17:57.214122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.925518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852858+0000","last_change":"2024-09-12T18:13:23.417471+0000","last_active":"2024-09-12T18:17:56.852858+0000","last_peered":"2024-09-12T18:17:56.852858+0000","last_clean":"2024-09-12T18:17:56.852858+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:17:56.852858+0000","last_undegraded":"2024-09-12T18:17:56.852858+0000","last_fullsized":"2024-09-12T18:17:56.852858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:39.139814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850807+0000","last_change":"2024-09-12T18:17:43.842170+0000","last_active":"2024-09-12T18:17:56.850807+0000","last_peered":"2024-09-12T18:17:56.850807+0000","last_clean":"2024-09-12T18:17:56.850807+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:17:56.850807+0000","last_undegraded":"2024-09-12T18:17:56.850807+0000","last_fullsized":"2024-09-12T18:17:56.850807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:57.613666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.235784+0000","last_change":"2024-09-12T18:17:57.235643+0000","last_active":"2024-09-12T18:17:57.235784+0000","last_peered":"2024-09-12T18:17:57.235784+0000","last_clean":"2024-09-12T18:17:57.235784+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:17:57.235784+0000","last_undegraded":"2024-09-12T18:17:57.235784+0000","last_fullsized":"2024-09-12T18:17:57.235784+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:05.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851258+0000","last_change":"2024-09-12T18:17:36.798410+0000","last_active":"2024-09-12T18:17:56.851258+0000","last_peered":"2024-09-12T18:17:56.851258+0000","last_clean":"2024-09-12T18:17:56.851258+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:17:56.851258+0000","last_undegraded":"2024-09-12T18:17:56.851258+0000","last_fullsized":"2024-09-12T18:17:56.851258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:30.151503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.227093+0000","last_change":"2024-09-12T18:17:57.226832+0000","last_active":"2024-09-12T18:17:57.227093+0000","last_peered":"2024-09-12T18:17:57.227093+0000","last_clean":"2024-09-12T18:17:57.227093+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:17:57.227093+0000","last_undegraded":"2024-09-12T18:17:57.227093+0000","last_fullsized":"2024-09-12T18:17:57.227093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:59.362317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850846+0000","last_change":"2024-09-12T18:17:36.805897+0000","last_active":"2024-09-12T18:17:56.850846+0000","last_peered":"2024-09-12T18:17:56.850846+0000","last_clean":"2024-09-12T18:17:56.850846+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:17:56.850846+0000","last_undegraded":"2024-09-12T18:17:56.850846+0000","last_fullsized":"2024-09-12T18:17:56.850846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:00.978611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850382+0000","last_change":"2024-09-12T18:13:23.411137+0000","last_active":"2024-09-12T18:17:56.850382+0000","last_peered":"2024-09-12T18:17:56.850382+0000","last_clean":"2024-09-12T18:17:56.850382+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:17:56.850382+0000","last_undegraded":"2024-09-12T18:17:56.850382+0000","last_fullsized":"2024-09-12T18:17:56.850382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:49.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.233319+0000","last_change":"2024-09-12T18:17:57.232930+0000","last_active":"2024-09-12T18:17:57.233319+0000","last_peered":"2024-09-12T18:17:57.233319+0000","last_clean":"2024-09-12T18:17:57.233319+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:17:57.233319+0000","last_undegraded":"2024-09-12T18:17:57.233319+0000","last_fullsized":"2024-09-12T18:17:57.233319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:01.904120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"99'4","reported_seq":189,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.956999+0000","last_change":"2024-09-12T18:18:16.956999+0000","last_active":"2024-09-12T18:18:16.956999+0000","last_peered":"2024-09-12T18:18:16.956999+0000","last_clean":"2024-09-12T18:18:16.956999+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:18:16.956999+0000","last_undegraded":"2024-09-12T18:18:16.956999+0000","last_fullsized":"2024-09-12T18:18:16.956999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'4","last_scrub_stamp":"2024-09-12T18:18:16.956813+0000","last_deep_scrub":"99'4","last_deep_scrub_stamp":"2024-09-12T18:18:16.956813+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.956813+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:41.709536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224231+0000","last_change":"2024-09-12T18:17:57.223948+0000","last_active":"2024-09-12T18:17:57.224231+0000","last_peered":"2024-09-12T18:17:57.224231+0000","last_clean":"2024-09-12T18:17:57.224231+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:17:57.224231+0000","last_undegraded":"2024-09-12T18:17:57.224231+0000","last_fullsized":"2024-09-12T18:17:57.224231+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:08.983211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.738586+0000","last_change":"2024-09-12T18:18:13.738586+0000","last_active":"2024-09-12T18:18:13.738586+0000","last_peered":"2024-09-12T18:18:13.738586+0000","last_clean":"2024-09-12T18:18:13.738586+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:18:13.738586+0000","last_undegraded":"2024-09-12T18:18:13.738586+0000","last_fullsized":"2024-09-12T18:18:13.738586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:13.738413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:13.738413+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.738413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:28.196009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852240+0000","last_change":"2024-09-12T18:13:23.413722+0000","last_active":"2024-09-12T18:17:56.852240+0000","last_peered":"2024-09-12T18:17:56.852240+0000","last_clean":"2024-09-12T18:17:56.852240+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:17:56.852240+0000","last_undegraded":"2024-09-12T18:17:56.852240+0000","last_fullsized":"2024-09-12T18:17:56.852240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.337008+0000","last_change":"2024-09-12T18:18:09.337008+0000","last_active":"2024-09-12T18:18:09.337008+0000","last_peered":"2024-09-12T18:18:09.337008+0000","last_clean":"2024-09-12T18:18:09.337008+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:18:09.337008+0000","last_undegraded":"2024-09-12T18:18:09.337008+0000","last_fullsized":"2024-09-12T18:18:09.337008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.336830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.336830+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.336830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:48.864757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":173,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851628+0000","last_change":"2024-09-12T18:17:52.822140+0000","last_active":"2024-09-12T18:17:56.851628+0000","last_peered":"2024-09-12T18:17:56.851628+0000","last_clean":"2024-09-12T18:17:56.851628+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:17:56.851628+0000","last_undegraded":"2024-09-12T18:17:56.851628+0000","last_fullsized":"2024-09-12T18:17:56.851628+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"99'12","reported_seq":180,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.935351+0000","last_change":"2024-09-12T18:18:15.935351+0000","last_active":"2024-09-12T18:18:15.935351+0000","last_peered":"2024-09-12T18:18:15.935351+0000","last_clean":"2024-09-12T18:18:15.935351+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:18:15.935351+0000","last_undegraded":"2024-09-12T18:18:15.935351+0000","last_fullsized":"2024-09-12T18:18:15.935351+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'12","last_scrub_stamp":"2024-09-12T18:18:15.935145+0000","last_deep_scrub":"99'12","last_deep_scrub_stamp":"2024-09-12T18:18:15.935145+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.935145+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.212455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"99'2","reported_seq":196,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.939382+0000","last_change":"2024-09-12T18:18:14.939382+0000","last_active":"2024-09-12T18:18:14.939382+0000","last_peered":"2024-09-12T18:18:14.939382+0000","last_clean":"2024-09-12T18:18:14.939382+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:18:14.939382+0000","last_undegraded":"2024-09-12T18:18:14.939382+0000","last_fullsized":"2024-09-12T18:18:14.939382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:14.939141+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:14.939141+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.939141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:54.752385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:18.380542+0000","last_change":"2024-09-12T18:18:18.380542+0000","last_active":"2024-09-12T18:18:18.380542+0000","last_peered":"2024-09-12T18:18:18.380542+0000","last_clean":"2024-09-12T18:18:18.380542+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:18:18.380542+0000","last_undegraded":"2024-09-12T18:18:18.380542+0000","last_fullsized":"2024-09-12T18:18:18.380542+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:18.380370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:18.380370+0000","last_clean_scrub_stamp":"2024-09-12T18:18:18.380370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:51.949885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"99'3","reported_seq":59,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.379041+0000","last_change":"2024-09-12T18:18:07.379041+0000","last_active":"2024-09-12T18:18:07.379041+0000","last_peered":"2024-09-12T18:18:07.379041+0000","last_clean":"2024-09-12T18:18:07.379041+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:18:07.379041+0000","last_undegraded":"2024-09-12T18:18:07.379041+0000","last_fullsized":"2024-09-12T18:18:07.379041+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:07.378868+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:07.378868+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.378868+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:26.083806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.364635+0000","last_change":"2024-09-12T18:18:19.364635+0000","last_active":"2024-09-12T18:18:19.364635+0000","last_peered":"2024-09-12T18:18:19.364635+0000","last_clean":"2024-09-12T18:18:19.364635+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:18:19.364635+0000","last_undegraded":"2024-09-12T18:18:19.364635+0000","last_fullsized":"2024-09-12T18:18:19.364635+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.364463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.364463+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.364463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:04.018914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"99'2","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.971616+0000","last_change":"2024-09-12T18:18:13.971616+0000","last_active":"2024-09-12T18:18:13.971616+0000","last_peered":"2024-09-12T18:18:13.971616+0000","last_clean":"2024-09-12T18:18:13.971616+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:18:13.971616+0000","last_undegraded":"2024-09-12T18:18:13.971616+0000","last_fullsized":"2024-09-12T18:18:13.971616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:13.971421+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:13.971421+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.971421+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:09.949210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.849922+0000","last_change":"2024-09-12T18:17:43.835902+0000","last_active":"2024-09-12T18:17:56.849922+0000","last_peered":"2024-09-12T18:17:56.849922+0000","last_clean":"2024-09-12T18:17:56.849922+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:17:56.849922+0000","last_undegraded":"2024-09-12T18:17:56.849922+0000","last_fullsized":"2024-09-12T18:17:56.849922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.009051+0000","last_change":"2024-09-12T18:18:13.009051+0000","last_active":"2024-09-12T18:18:13.009051+0000","last_peered":"2024-09-12T18:18:13.009051+0000","last_clean":"2024-09-12T18:18:13.009051+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:18:13.009051+0000","last_undegraded":"2024-09-12T18:18:13.009051+0000","last_fullsized":"2024-09-12T18:18:13.009051+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:13.008879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:13.008879+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.008879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.617889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851092+0000","last_change":"2024-09-12T18:17:43.843794+0000","last_active":"2024-09-12T18:17:56.851092+0000","last_peered":"2024-09-12T18:17:56.851092+0000","last_clean":"2024-09-12T18:17:56.851092+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:17:56.851092+0000","last_undegraded":"2024-09-12T18:17:56.851092+0000","last_fullsized":"2024-09-12T18:17:56.851092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:25.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"99'3","reported_seq":212,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:12.706325+0000","last_change":"2024-09-12T18:18:12.706325+0000","last_active":"2024-09-12T18:18:12.706325+0000","last_peered":"2024-09-12T18:18:12.706325+0000","last_clean":"2024-09-12T18:18:12.706325+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:18:12.706325+0000","last_undegraded":"2024-09-12T18:18:12.706325+0000","last_fullsized":"2024-09-12T18:18:12.706325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:12.706141+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:12.706141+0000","last_clean_scrub_stamp":"2024-09-12T18:18:12.706141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:52.994231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":114,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851005+0000","last_change":"2024-09-12T18:17:54.854577+0000","last_active":"2024-09-12T18:17:56.851005+0000","last_peered":"2024-09-12T18:17:56.851005+0000","last_clean":"2024-09-12T18:17:56.851005+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:17:56.851005+0000","last_undegraded":"2024-09-12T18:17:56.851005+0000","last_fullsized":"2024-09-12T18:17:56.851005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:49.115047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.990149+0000","last_change":"2024-09-12T18:18:11.990149+0000","last_active":"2024-09-12T18:18:11.990149+0000","last_peered":"2024-09-12T18:18:11.990149+0000","last_clean":"2024-09-12T18:18:11.990149+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:18:11.990149+0000","last_undegraded":"2024-09-12T18:18:11.990149+0000","last_fullsized":"2024-09-12T18:18:11.990149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:11.989951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:11.989951+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.989951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:04.218973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852314+0000","last_change":"2024-09-12T18:17:43.830696+0000","last_active":"2024-09-12T18:17:56.852314+0000","last_peered":"2024-09-12T18:17:56.852314+0000","last_clean":"2024-09-12T18:17:56.852314+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:17:56.852314+0000","last_undegraded":"2024-09-12T18:17:56.852314+0000","last_fullsized":"2024-09-12T18:17:56.852314+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:30.735745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.423022+0000","last_change":"2024-09-12T18:18:06.423022+0000","last_active":"2024-09-12T18:18:06.423022+0000","last_peered":"2024-09-12T18:18:06.423022+0000","last_clean":"2024-09-12T18:18:06.423022+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:18:06.423022+0000","last_undegraded":"2024-09-12T18:18:06.423022+0000","last_fullsized":"2024-09-12T18:18:06.423022+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.422852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.422852+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.422852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:32.660307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851299+0000","last_change":"2024-09-12T18:17:43.836681+0000","last_active":"2024-09-12T18:17:56.851299+0000","last_peered":"2024-09-12T18:17:56.851299+0000","last_clean":"2024-09-12T18:17:56.851299+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:17:56.851299+0000","last_undegraded":"2024-09-12T18:17:56.851299+0000","last_fullsized":"2024-09-12T18:17:56.851299+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:57.646708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.360640+0000","last_change":"2024-09-12T18:18:08.360640+0000","last_active":"2024-09-12T18:18:08.360640+0000","last_peered":"2024-09-12T18:18:08.360640+0000","last_clean":"2024-09-12T18:18:08.360640+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:18:08.360640+0000","last_undegraded":"2024-09-12T18:18:08.360640+0000","last_fullsized":"2024-09-12T18:18:08.360640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.360470+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.360470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:12.127089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851626+0000","last_change":"2024-09-12T18:17:36.788081+0000","last_active":"2024-09-12T18:17:56.851626+0000","last_peered":"2024-09-12T18:17:56.851626+0000","last_clean":"2024-09-12T18:17:56.851626+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:17:56.851626+0000","last_undegraded":"2024-09-12T18:17:56.851626+0000","last_fullsized":"2024-09-12T18:17:56.851626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'114","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.038010+0000","last_change":"2024-09-12T18:18:07.038010+0000","last_active":"2024-09-12T18:18:07.038010+0000","last_peered":"2024-09-12T18:18:07.038010+0000","last_clean":"2024-09-12T18:18:07.038010+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:18:07.038010+0000","last_undegraded":"2024-09-12T18:18:07.038010+0000","last_fullsized":"2024-09-12T18:18:07.038010+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'114","last_scrub_stamp":"2024-09-12T18:18:07.037826+0000","last_deep_scrub":"99'114","last_deep_scrub_stamp":"2024-09-12T18:18:07.037826+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.037826+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:09.956193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"99'2","reported_seq":200,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.044603+0000","last_change":"2024-09-12T18:18:05.044603+0000","last_active":"2024-09-12T18:18:05.044603+0000","last_peered":"2024-09-12T18:18:05.044603+0000","last_clean":"2024-09-12T18:18:05.044603+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:18:05.044603+0000","last_undegraded":"2024-09-12T18:18:05.044603+0000","last_fullsized":"2024-09-12T18:18:05.044603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:05.044409+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:05.044409+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.044409+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:50.507868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.675158+0000","last_change":"2024-09-12T18:18:08.675158+0000","last_active":"2024-09-12T18:18:08.675158+0000","last_peered":"2024-09-12T18:18:08.675158+0000","last_clean":"2024-09-12T18:18:08.675158+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:18:08.675158+0000","last_undegraded":"2024-09-12T18:18:08.675158+0000","last_fullsized":"2024-09-12T18:18:08.675158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.674968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.674968+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.674968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:01.989940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852972+0000","last_change":"2024-09-12T18:17:36.786213+0000","last_active":"2024-09-12T18:17:56.852972+0000","last_peered":"2024-09-12T18:17:56.852972+0000","last_clean":"2024-09-12T18:17:56.852972+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:17:56.852972+0000","last_undegraded":"2024-09-12T18:17:56.852972+0000","last_fullsized":"2024-09-12T18:17:56.852972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:13.937791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.037952+0000","last_change":"2024-09-12T18:18:08.037952+0000","last_active":"2024-09-12T18:18:08.037952+0000","last_peered":"2024-09-12T18:18:08.037952+0000","last_clean":"2024-09-12T18:18:08.037952+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:18:08.037952+0000","last_undegraded":"2024-09-12T18:18:08.037952+0000","last_fullsized":"2024-09-12T18:18:08.037952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.037776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.037776+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.037776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:16.887981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.647761+0000","last_change":"2024-09-12T18:18:07.647761+0000","last_active":"2024-09-12T18:18:07.647761+0000","last_peered":"2024-09-12T18:18:07.647761+0000","last_clean":"2024-09-12T18:18:07.647761+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:18:07.647761+0000","last_undegraded":"2024-09-12T18:18:07.647761+0000","last_fullsized":"2024-09-12T18:18:07.647761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:07.647588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:07.647588+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.647588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:16.251601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.392490+0000","last_change":"2024-09-12T18:18:17.392490+0000","last_active":"2024-09-12T18:18:17.392490+0000","last_peered":"2024-09-12T18:18:17.392490+0000","last_clean":"2024-09-12T18:18:17.392490+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:18:17.392490+0000","last_undegraded":"2024-09-12T18:18:17.392490+0000","last_fullsized":"2024-09-12T18:18:17.392490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:17.392315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:17.392315+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.392315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:52.091171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:04.671886+0000","last_change":"2024-09-12T18:18:04.671886+0000","last_active":"2024-09-12T18:18:04.671886+0000","last_peered":"2024-09-12T18:18:04.671886+0000","last_clean":"2024-09-12T18:18:04.671886+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:18:04.671886+0000","last_undegraded":"2024-09-12T18:18:04.671886+0000","last_fullsized":"2024-09-12T18:18:04.671886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:04.671711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:04.671711+0000","last_clean_scrub_stamp":"2024-09-12T18:18:04.671711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:11.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":112,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.439014+0000","last_change":"2024-09-12T18:18:05.439014+0000","last_active":"2024-09-12T18:18:05.439014+0000","last_peered":"2024-09-12T18:18:05.439014+0000","last_clean":"2024-09-12T18:18:05.439014+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:18:05.439014+0000","last_undegraded":"2024-09-12T18:18:05.439014+0000","last_fullsized":"2024-09-12T18:18:05.439014+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:05.438827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:05.438827+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.438827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.465649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851886+0000","last_change":"2024-09-12T18:17:36.802866+0000","last_active":"2024-09-12T18:17:56.851886+0000","last_peered":"2024-09-12T18:17:56.851886+0000","last_clean":"2024-09-12T18:17:56.851886+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:17:56.851886+0000","last_undegraded":"2024-09-12T18:17:56.851886+0000","last_fullsized":"2024-09-12T18:17:56.851886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:32.520337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"99'3","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.969224+0000","last_change":"2024-09-12T18:18:10.969224+0000","last_active":"2024-09-12T18:18:10.969224+0000","last_peered":"2024-09-12T18:18:10.969224+0000","last_clean":"2024-09-12T18:18:10.969224+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:18:10.969224+0000","last_undegraded":"2024-09-12T18:18:10.969224+0000","last_fullsized":"2024-09-12T18:18:10.969224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:10.969049+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:10.969049+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.969049+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:26.882435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.011049+0000","last_change":"2024-09-12T18:18:10.011049+0000","last_active":"2024-09-12T18:18:10.011049+0000","last_peered":"2024-09-12T18:18:10.011049+0000","last_clean":"2024-09-12T18:18:10.011049+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:18:10.011049+0000","last_undegraded":"2024-09-12T18:18:10.011049+0000","last_fullsized":"2024-09-12T18:18:10.011049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:10.010962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:10.010962+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.010962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:28.945378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851823+0000","last_change":"2024-09-12T18:17:36.803820+0000","last_active":"2024-09-12T18:17:56.851823+0000","last_peered":"2024-09-12T18:17:56.851823+0000","last_clean":"2024-09-12T18:17:56.851823+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:17:56.851823+0000","last_undegraded":"2024-09-12T18:17:56.851823+0000","last_fullsized":"2024-09-12T18:17:56.851823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:26.734460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.034397+0000","last_change":"2024-09-12T18:18:09.034397+0000","last_active":"2024-09-12T18:18:09.034397+0000","last_peered":"2024-09-12T18:18:09.034397+0000","last_clean":"2024-09-12T18:18:09.034397+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:18:09.034397+0000","last_undegraded":"2024-09-12T18:18:09.034397+0000","last_fullsized":"2024-09-12T18:18:09.034397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.034224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.034224+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.034224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:04.477551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.627437+0000","last_change":"2024-09-12T18:18:05.627437+0000","last_active":"2024-09-12T18:18:05.627437+0000","last_peered":"2024-09-12T18:18:05.627437+0000","last_clean":"2024-09-12T18:18:05.627437+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:18:05.627437+0000","last_undegraded":"2024-09-12T18:18:05.627437+0000","last_fullsized":"2024-09-12T18:18:05.627437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:05.627265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:05.627265+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.627265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.270385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.344720+0000","last_change":"2024-09-12T18:18:16.344720+0000","last_active":"2024-09-12T18:18:16.344720+0000","last_peered":"2024-09-12T18:18:16.344720+0000","last_clean":"2024-09-12T18:18:16.344720+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:18:16.344720+0000","last_undegraded":"2024-09-12T18:18:16.344720+0000","last_fullsized":"2024-09-12T18:18:16.344720+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:16.344552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:16.344552+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.344552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:12.171461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.716740+0000","last_change":"2024-09-12T18:18:09.716740+0000","last_active":"2024-09-12T18:18:09.716740+0000","last_peered":"2024-09-12T18:18:09.716740+0000","last_clean":"2024-09-12T18:18:09.716740+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:18:09.716740+0000","last_undegraded":"2024-09-12T18:18:09.716740+0000","last_fullsized":"2024-09-12T18:18:09.716740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.716563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.716563+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.716563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:17.402291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:04.392697+0000","last_change":"2024-09-12T18:18:04.392697+0000","last_active":"2024-09-12T18:18:04.392697+0000","last_peered":"2024-09-12T18:18:04.392697+0000","last_clean":"2024-09-12T18:18:04.392697+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:18:04.392697+0000","last_undegraded":"2024-09-12T18:18:04.392697+0000","last_fullsized":"2024-09-12T18:18:04.392697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:04.392510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:04.392510+0000","last_clean_scrub_stamp":"2024-09-12T18:18:04.392510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:13.797197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.394169+0000","last_change":"2024-09-12T18:18:15.394169+0000","last_active":"2024-09-12T18:18:15.394169+0000","last_peered":"2024-09-12T18:18:15.394169+0000","last_clean":"2024-09-12T18:18:15.394169+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:18:15.394169+0000","last_undegraded":"2024-09-12T18:18:15.394169+0000","last_fullsized":"2024-09-12T18:18:15.394169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:15.393997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:15.393997+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.393997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:21.072594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"99'3","reported_seq":197,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.730192+0000","last_change":"2024-09-12T18:18:11.730192+0000","last_active":"2024-09-12T18:18:11.730192+0000","last_peered":"2024-09-12T18:18:11.730192+0000","last_clean":"2024-09-12T18:18:11.730192+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:18:11.730192+0000","last_undegraded":"2024-09-12T18:18:11.730192+0000","last_fullsized":"2024-09-12T18:18:11.730192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:11.730001+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:11.730001+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.730001+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:01.521288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.650478+0000","last_change":"2024-09-12T18:18:06.650478+0000","last_active":"2024-09-12T18:18:06.650478+0000","last_peered":"2024-09-12T18:18:06.650478+0000","last_clean":"2024-09-12T18:18:06.650478+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:18:06.650478+0000","last_undegraded":"2024-09-12T18:18:06.650478+0000","last_fullsized":"2024-09-12T18:18:06.650478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.650304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.650304+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.650304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:46.048459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.725443+0000","last_change":"2024-09-12T18:18:19.725443+0000","last_active":"2024-09-12T18:18:19.725443+0000","last_peered":"2024-09-12T18:18:19.725443+0000","last_clean":"2024-09-12T18:18:19.725443+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:18:19.725443+0000","last_undegraded":"2024-09-12T18:18:19.725443+0000","last_fullsized":"2024-09-12T18:18:19.725443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.725242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.725242+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.725242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:02.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"99'2","reported_seq":211,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.720534+0000","last_change":"2024-09-12T18:18:10.720534+0000","last_active":"2024-09-12T18:18:10.720534+0000","last_peered":"2024-09-12T18:18:10.720534+0000","last_clean":"2024-09-12T18:18:10.720534+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:18:10.720534+0000","last_undegraded":"2024-09-12T18:18:10.720534+0000","last_fullsized":"2024-09-12T18:18:10.720534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:10.720311+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:10.720311+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.720311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:34.851932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.058872+0000","last_change":"2024-09-12T18:18:06.058872+0000","last_active":"2024-09-12T18:18:06.058872+0000","last_peered":"2024-09-12T18:18:06.058872+0000","last_clean":"2024-09-12T18:18:06.058872+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:18:06.058872+0000","last_undegraded":"2024-09-12T18:18:06.058872+0000","last_fullsized":"2024-09-12T18:18:06.058872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.058694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.058694+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.058694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:55.056058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":112,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.401245+0000","last_change":"2024-09-12T18:18:14.401245+0000","last_active":"2024-09-12T18:18:14.401245+0000","last_peered":"2024-09-12T18:18:14.401245+0000","last_clean":"2024-09-12T18:18:14.401245+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:18:14.401245+0000","last_undegraded":"2024-09-12T18:18:14.401245+0000","last_fullsized":"2024-09-12T18:18:14.401245+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:14.401080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:14.401080+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.401080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:39.481851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850879+0000","last_change":"2024-09-12T18:17:43.836518+0000","last_active":"2024-09-12T18:17:56.850879+0000","last_peered":"2024-09-12T18:17:56.850879+0000","last_clean":"2024-09-12T18:17:56.850879+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:17:56.850879+0000","last_undegraded":"2024-09-12T18:17:56.850879+0000","last_fullsized":"2024-09-12T18:17:56.850879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:59.696580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"99'10","reported_seq":178,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.961290+0000","last_change":"2024-09-12T18:18:17.961290+0000","last_active":"2024-09-12T18:18:17.961290+0000","last_peered":"2024-09-12T18:18:17.961290+0000","last_clean":"2024-09-12T18:18:17.961290+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:18:17.961290+0000","last_undegraded":"2024-09-12T18:18:17.961290+0000","last_fullsized":"2024-09-12T18:18:17.961290+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'10","last_scrub_stamp":"2024-09-12T18:18:17.961102+0000","last_deep_scrub":"99'10","last_deep_scrub_stamp":"2024-09-12T18:18:17.961102+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.961102+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:21.051053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851846+0000","last_change":"2024-09-12T18:17:36.793132+0000","last_active":"2024-09-12T18:17:56.851846+0000","last_peered":"2024-09-12T18:17:56.851846+0000","last_clean":"2024-09-12T18:17:56.851846+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:17:56.851846+0000","last_undegraded":"2024-09-12T18:17:56.851846+0000","last_fullsized":"2024-09-12T18:17:56.851846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"99'5","reported_seq":34,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.369275+0000","last_change":"2024-09-12T18:18:10.369275+0000","last_active":"2024-09-12T18:18:10.369275+0000","last_peered":"2024-09-12T18:18:10.369275+0000","last_clean":"2024-09-12T18:18:10.369275+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:18:10.369275+0000","last_undegraded":"2024-09-12T18:18:10.369275+0000","last_fullsized":"2024-09-12T18:18:10.369275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'5","last_scrub_stamp":"2024-09-12T18:18:10.369086+0000","last_deep_scrub":"99'5","last_deep_scrub_stamp":"2024-09-12T18:18:10.369086+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.369086+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:42.120931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":136,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.003134+0000","last_change":"2024-09-12T18:18:19.003134+0000","last_active":"2024-09-12T18:18:19.003134+0000","last_peered":"2024-09-12T18:18:19.003134+0000","last_clean":"2024-09-12T18:18:19.003134+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:18:19.003134+0000","last_undegraded":"2024-09-12T18:18:19.003134+0000","last_fullsized":"2024-09-12T18:18:19.003134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.002928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.002928+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.002928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:00.994887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850908+0000","last_change":"2024-09-12T18:13:23.412927+0000","last_active":"2024-09-12T18:17:56.850908+0000","last_peered":"2024-09-12T18:17:56.850908+0000","last_clean":"2024-09-12T18:17:56.850908+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:17:56.850908+0000","last_undegraded":"2024-09-12T18:17:56.850908+0000","last_fullsized":"2024-09-12T18:17:56.850908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.709802+0000","last_change":"2024-09-12T18:18:14.709666+0000","last_active":"2024-09-12T18:18:14.709802+0000","last_peered":"2024-09-12T18:18:14.709802+0000","last_clean":"2024-09-12T18:18:14.709802+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:18:14.709802+0000","last_undegraded":"2024-09-12T18:18:14.709802+0000","last_fullsized":"2024-09-12T18:18:14.709802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:14.709484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:14.709484+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.709484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:45.973585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850725+0000","last_change":"2024-09-12T18:17:36.791200+0000","last_active":"2024-09-12T18:17:56.850725+0000","last_peered":"2024-09-12T18:17:56.850725+0000","last_clean":"2024-09-12T18:17:56.850725+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:17:56.850725+0000","last_undegraded":"2024-09-12T18:17:56.850725+0000","last_fullsized":"2024-09-12T18:17:56.850725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224059+0000","last_change":"2024-09-12T18:17:57.223771+0000","last_active":"2024-09-12T18:17:57.224059+0000","last_peered":"2024-09-12T18:17:57.224059+0000","last_clean":"2024-09-12T18:17:57.224059+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:17:57.224059+0000","last_undegraded":"2024-09-12T18:17:57.224059+0000","last_fullsized":"2024-09-12T18:17:57.224059+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:16.850588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.672725+0000","last_change":"2024-09-12T18:18:15.672725+0000","last_active":"2024-09-12T18:18:15.672725+0000","last_peered":"2024-09-12T18:18:15.672725+0000","last_clean":"2024-09-12T18:18:15.672725+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:18:15.672725+0000","last_undegraded":"2024-09-12T18:18:15.672725+0000","last_fullsized":"2024-09-12T18:18:15.672725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:15.672527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:15.672527+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.672527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:56.693830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.852569+0000","last_change":"2024-09-12T18:17:43.841387+0000","last_active":"2024-09-12T18:17:56.852569+0000","last_peered":"2024-09-12T18:17:56.852569+0000","last_clean":"2024-09-12T18:17:56.852569+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:17:56.852569+0000","last_undegraded":"2024-09-12T18:17:56.852569+0000","last_fullsized":"2024-09-12T18:17:56.852569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:10.754462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:18.702406+0000","last_change":"2024-09-12T18:18:18.702406+0000","last_active":"2024-09-12T18:18:18.702406+0000","last_peered":"2024-09-12T18:18:18.702406+0000","last_clean":"2024-09-12T18:18:18.702406+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:18:18.702406+0000","last_undegraded":"2024-09-12T18:18:18.702406+0000","last_fullsized":"2024-09-12T18:18:18.702406+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:18.702211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:18.702211+0000","last_clean_scrub_stamp":"2024-09-12T18:18:18.702211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:54.433092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.213116+0000","last_change":"2024-09-12T18:17:44.200076+0000","last_active":"2024-09-12T18:17:57.213116+0000","last_peered":"2024-09-12T18:17:57.213116+0000","last_clean":"2024-09-12T18:17:57.213116+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:17:57.213116+0000","last_undegraded":"2024-09-12T18:17:57.213116+0000","last_fullsized":"2024-09-12T18:17:57.213116+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:34.195817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.344080+0000","last_change":"2024-09-12T18:18:11.344080+0000","last_active":"2024-09-12T18:18:11.344080+0000","last_peered":"2024-09-12T18:18:11.344080+0000","last_clean":"2024-09-12T18:18:11.344080+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:18:11.344080+0000","last_undegraded":"2024-09-12T18:18:11.344080+0000","last_fullsized":"2024-09-12T18:18:11.344080+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:11.343906+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:11.343906+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.343906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.876756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.229368+0000","last_change":"2024-09-12T18:17:57.227693+0000","last_active":"2024-09-12T18:17:57.229368+0000","last_peered":"2024-09-12T18:17:57.229368+0000","last_clean":"2024-09-12T18:17:57.229368+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:17:57.229368+0000","last_undegraded":"2024-09-12T18:17:57.229368+0000","last_fullsized":"2024-09-12T18:17:57.229368+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.861398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:12.355637+0000","last_change":"2024-09-12T18:18:12.355637+0000","last_active":"2024-09-12T18:18:12.355637+0000","last_peered":"2024-09-12T18:18:12.355637+0000","last_clean":"2024-09-12T18:18:12.355637+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:18:12.355637+0000","last_undegraded":"2024-09-12T18:18:12.355637+0000","last_fullsized":"2024-09-12T18:18:12.355637+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:12.355434+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:12.355434+0000","last_clean_scrub_stamp":"2024-09-12T18:18:12.355434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:28.993650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":114,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850191+0000","last_change":"2024-09-12T18:17:54.847177+0000","last_active":"2024-09-12T18:17:56.850191+0000","last_peered":"2024-09-12T18:17:56.850191+0000","last_clean":"2024-09-12T18:17:56.850191+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:17:56.850191+0000","last_undegraded":"2024-09-12T18:17:56.850191+0000","last_fullsized":"2024-09-12T18:17:56.850191+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"99'3","reported_seq":152,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.974170+0000","last_change":"2024-09-12T18:18:19.974170+0000","last_active":"2024-09-12T18:18:19.974170+0000","last_peered":"2024-09-12T18:18:19.974170+0000","last_clean":"2024-09-12T18:18:19.974170+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:18:19.974170+0000","last_undegraded":"2024-09-12T18:18:19.974170+0000","last_fullsized":"2024-09-12T18:18:19.974170+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:19.973973+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:19.973973+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.973973+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:14.406611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":114,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.850709+0000","last_change":"2024-09-12T18:17:54.847326+0000","last_active":"2024-09-12T18:17:56.850709+0000","last_peered":"2024-09-12T18:17:56.850709+0000","last_clean":"2024-09-12T18:17:56.850709+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:17:56.850709+0000","last_undegraded":"2024-09-12T18:17:56.850709+0000","last_fullsized":"2024-09-12T18:17:56.850709+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:41.591120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"99'3","reported_seq":67,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.382529+0000","last_change":"2024-09-12T18:18:13.382529+0000","last_active":"2024-09-12T18:18:13.382529+0000","last_peered":"2024-09-12T18:18:13.382529+0000","last_clean":"2024-09-12T18:18:13.382529+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:18:13.382529+0000","last_undegraded":"2024-09-12T18:18:13.382529+0000","last_fullsized":"2024-09-12T18:18:13.382529+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:13.382329+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:13.382329+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.382329+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:31.263684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:57.224203+0000","last_change":"2024-09-12T18:17:57.223910+0000","last_active":"2024-09-12T18:17:57.224203+0000","last_peered":"2024-09-12T18:17:57.224203+0000","last_clean":"2024-09-12T18:17:57.224203+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:17:57.224203+0000","last_undegraded":"2024-09-12T18:17:57.224203+0000","last_fullsized":"2024-09-12T18:17:57.224203+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:01.950899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":195,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.713828+0000","last_change":"2024-09-12T18:18:16.713828+0000","last_active":"2024-09-12T18:18:16.713828+0000","last_peered":"2024-09-12T18:18:16.713828+0000","last_clean":"2024-09-12T18:18:16.713828+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:18:16.713828+0000","last_undegraded":"2024-09-12T18:18:16.713828+0000","last_fullsized":"2024-09-12T18:18:16.713828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:16.713643+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:16.713643+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.713643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:37.564552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851683+0000","last_change":"2024-09-12T18:13:23.416973+0000","last_active":"2024-09-12T18:17:56.851683+0000","last_peered":"2024-09-12T18:17:56.851683+0000","last_clean":"2024-09-12T18:17:56.851683+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:17:56.851683+0000","last_undegraded":"2024-09-12T18:17:56.851683+0000","last_fullsized":"2024-09-12T18:17:56.851683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":219,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.753060+0000","last_change":"2024-09-12T18:18:17.753060+0000","last_active":"2024-09-12T18:18:17.753060+0000","last_peered":"2024-09-12T18:18:17.753060+0000","last_clean":"2024-09-12T18:18:17.753060+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:18:17.753060+0000","last_undegraded":"2024-09-12T18:18:17.753060+0000","last_fullsized":"2024-09-12T18:18:17.753060+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'6","last_scrub_stamp":"2024-09-12T18:18:17.752859+0000","last_deep_scrub":"99'6","last_deep_scrub_stamp":"2024-09-12T18:18:17.752859+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.752859+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:13.953585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280828,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94091012,"statfs":{"total":96636764160,"available":96349196288,"internally_reserved":0,"allocated":1159168,"data_stored":1054579,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":286390725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397372,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974468,"statfs":{"total":96636764160,"available":96229855232,"internally_reserved":0,"allocated":1093632,"data_stored":462417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285579,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50432,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":49274,"kb_avail":94321408,"statfs":{"total":96636764160,"available":96585121792,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":50456679},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:25.563 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.563 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.563 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.563 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.563 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.563 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.564 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.565 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.566 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.567 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.568 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.568 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.568 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.568 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.568 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.568 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.569 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.569 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.569 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.569 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.569 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.570 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.571 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.571 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.571 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:25.571 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:18:45.572 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:18:45.899 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:18:45.901 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:18:45.916 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-12T18:18:44.486550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":732792,"kb_used_data":3336,"kb_used_omap":9,"kb_used_meta":729398,"kb_avail":282382728,"statfs":{"total":289910292480,"available":289159913472,"internally_reserved":0,"allocated":3416064,"data_stored":2570940,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":746904561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005163"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:37.326867+0000","last_change":"2024-09-12T18:18:37.326867+0000","last_active":"2024-09-12T18:18:37.326867+0000","last_peered":"2024-09-12T18:18:37.326867+0000","last_clean":"2024-09-12T18:18:37.326867+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:18:37.326867+0000","last_undegraded":"2024-09-12T18:18:37.326867+0000","last_fullsized":"2024-09-12T18:18:37.326867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:37.326688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:37.326688+0000","last_clean_scrub_stamp":"2024-09-12T18:18:37.326688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:10.885631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:36.357390+0000","last_change":"2024-09-12T18:18:36.357390+0000","last_active":"2024-09-12T18:18:36.357390+0000","last_peered":"2024-09-12T18:18:36.357390+0000","last_clean":"2024-09-12T18:18:36.357390+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:18:36.357390+0000","last_undegraded":"2024-09-12T18:18:36.357390+0000","last_fullsized":"2024-09-12T18:18:36.357390+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:36.357221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:36.357221+0000","last_clean_scrub_stamp":"2024-09-12T18:18:36.357221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:12.818515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":184,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851715+0000","last_change":"2024-09-12T18:17:36.785682+0000","last_active":"2024-09-12T18:17:56.851715+0000","last_peered":"2024-09-12T18:17:56.851715+0000","last_clean":"2024-09-12T18:17:56.851715+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:17:56.851715+0000","last_undegraded":"2024-09-12T18:17:56.851715+0000","last_fullsized":"2024-09-12T18:17:56.851715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:56.319794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":175,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:17:56.851684+0000","last_change":"2024-09-12T18:13:23.411784+0000","last_active":"2024-09-12T18:17:56.851684+0000","last_peered":"2024-09-12T18:17:56.851684+0000","last_clean":"2024-09-12T18:17:56.851684+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:17:56.851684+0000","last_undegraded":"2024-09-12T18:17:56.851684+0000","last_fullsized":"2024-09-12T18:17:56.851684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:13:22.369601+0000","last_clean_scrub_stamp":"2024-09-12T18:13:22.369601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.970533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:35.389540+0000","last_change":"2024-09-12T18:18:35.389540+0000","last_active":"2024-09-12T18:18:35.389540+0000","last_peered":"2024-09-12T18:18:35.389540+0000","last_clean":"2024-09-12T18:18:35.389540+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:18:35.389540+0000","last_undegraded":"2024-09-12T18:18:35.389540+0000","last_fullsized":"2024-09-12T18:18:35.389540+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:35.389372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:35.389372+0000","last_clean_scrub_stamp":"2024-09-12T18:18:35.389372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:08.092706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":94,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:40.136113+0000","last_change":"2024-09-12T18:18:40.136113+0000","last_active":"2024-09-12T18:18:40.136113+0000","last_peered":"2024-09-12T18:18:40.136113+0000","last_clean":"2024-09-12T18:18:40.136113+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:18:40.136113+0000","last_undegraded":"2024-09-12T18:18:40.136113+0000","last_fullsized":"2024-09-12T18:18:40.136113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:40.135928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:40.135928+0000","last_clean_scrub_stamp":"2024-09-12T18:18:40.135928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:06.445427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":117,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:39.179228+0000","last_change":"2024-09-12T18:18:39.179228+0000","last_active":"2024-09-12T18:18:39.179228+0000","last_peered":"2024-09-12T18:18:39.179228+0000","last_clean":"2024-09-12T18:18:39.179228+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:18:39.179228+0000","last_undegraded":"2024-09-12T18:18:39.179228+0000","last_fullsized":"2024-09-12T18:18:39.179228+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:39.179035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:39.179035+0000","last_clean_scrub_stamp":"2024-09-12T18:18:39.179035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:08.675673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:37.115992+0000","last_change":"2024-09-12T18:18:37.115992+0000","last_active":"2024-09-12T18:18:37.115992+0000","last_peered":"2024-09-12T18:18:37.115992+0000","last_clean":"2024-09-12T18:18:37.115992+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:18:37.115992+0000","last_undegraded":"2024-09-12T18:18:37.115992+0000","last_fullsized":"2024-09-12T18:18:37.115992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:37.115757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:37.115757+0000","last_clean_scrub_stamp":"2024-09-12T18:18:37.115757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:33.583506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:36.792306+0000","last_change":"2024-09-12T18:18:36.792306+0000","last_active":"2024-09-12T18:18:36.792306+0000","last_peered":"2024-09-12T18:18:36.792306+0000","last_clean":"2024-09-12T18:18:36.792306+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:18:36.792306+0000","last_undegraded":"2024-09-12T18:18:36.792306+0000","last_fullsized":"2024-09-12T18:18:36.792306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:36.792112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:36.792112+0000","last_clean_scrub_stamp":"2024-09-12T18:18:36.792112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.051668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:34.347564+0000","last_change":"2024-09-12T18:18:34.347564+0000","last_active":"2024-09-12T18:18:34.347564+0000","last_peered":"2024-09-12T18:18:34.347564+0000","last_clean":"2024-09-12T18:18:34.347564+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:18:34.347564+0000","last_undegraded":"2024-09-12T18:18:34.347564+0000","last_fullsized":"2024-09-12T18:18:34.347564+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:34.347373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:34.347373+0000","last_clean_scrub_stamp":"2024-09-12T18:18:34.347373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:36.180896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:38.142403+0000","last_change":"2024-09-12T18:18:38.142403+0000","last_active":"2024-09-12T18:18:38.142403+0000","last_peered":"2024-09-12T18:18:38.142403+0000","last_clean":"2024-09-12T18:18:38.142403+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:18:38.142403+0000","last_undegraded":"2024-09-12T18:18:38.142403+0000","last_fullsized":"2024-09-12T18:18:38.142403+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:38.142225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:38.142225+0000","last_clean_scrub_stamp":"2024-09-12T18:18:38.142225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:53.789786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:33.300224+0000","last_change":"2024-09-12T18:18:33.300224+0000","last_active":"2024-09-12T18:18:33.300224+0000","last_peered":"2024-09-12T18:18:33.300224+0000","last_clean":"2024-09-12T18:18:33.300224+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:18:33.300224+0000","last_undegraded":"2024-09-12T18:18:33.300224+0000","last_fullsized":"2024-09-12T18:18:33.300224+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:33.300055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:33.300055+0000","last_clean_scrub_stamp":"2024-09-12T18:18:33.300055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:11.264330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:32.264836+0000","last_change":"2024-09-12T18:18:32.264836+0000","last_active":"2024-09-12T18:18:32.264836+0000","last_peered":"2024-09-12T18:18:32.264836+0000","last_clean":"2024-09-12T18:18:32.264836+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:18:32.264836+0000","last_undegraded":"2024-09-12T18:18:32.264836+0000","last_fullsized":"2024-09-12T18:18:32.264836+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:32.264666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:32.264666+0000","last_clean_scrub_stamp":"2024-09-12T18:18:32.264666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.976343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:34.107220+0000","last_change":"2024-09-12T18:18:34.107220+0000","last_active":"2024-09-12T18:18:34.107220+0000","last_peered":"2024-09-12T18:18:34.107220+0000","last_clean":"2024-09-12T18:18:34.107220+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:18:34.107220+0000","last_undegraded":"2024-09-12T18:18:34.107220+0000","last_fullsized":"2024-09-12T18:18:34.107220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:34.107045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:34.107045+0000","last_clean_scrub_stamp":"2024-09-12T18:18:34.107045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:16.463914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:35.126415+0000","last_change":"2024-09-12T18:18:35.126415+0000","last_active":"2024-09-12T18:18:35.126415+0000","last_peered":"2024-09-12T18:18:35.126415+0000","last_clean":"2024-09-12T18:18:35.126415+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:18:35.126415+0000","last_undegraded":"2024-09-12T18:18:35.126415+0000","last_fullsized":"2024-09-12T18:18:35.126415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:35.126239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:35.126239+0000","last_clean_scrub_stamp":"2024-09-12T18:18:35.126239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:15.121541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:33.111768+0000","last_change":"2024-09-12T18:18:33.111768+0000","last_active":"2024-09-12T18:18:33.111768+0000","last_peered":"2024-09-12T18:18:33.111768+0000","last_clean":"2024-09-12T18:18:33.111768+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:18:33.111768+0000","last_undegraded":"2024-09-12T18:18:33.111768+0000","last_fullsized":"2024-09-12T18:18:33.111768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:33.111567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:33.111567+0000","last_clean_scrub_stamp":"2024-09-12T18:18:33.111567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.385363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:35.785800+0000","last_change":"2024-09-12T18:18:35.785800+0000","last_active":"2024-09-12T18:18:35.785800+0000","last_peered":"2024-09-12T18:18:35.785800+0000","last_clean":"2024-09-12T18:18:35.785800+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:18:35.785800+0000","last_undegraded":"2024-09-12T18:18:35.785800+0000","last_fullsized":"2024-09-12T18:18:35.785800+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:35.785628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:35.785628+0000","last_clean_scrub_stamp":"2024-09-12T18:18:35.785628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:29.499469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:31.268597+0000","last_change":"2024-09-12T18:18:31.268597+0000","last_active":"2024-09-12T18:18:31.268597+0000","last_peered":"2024-09-12T18:18:31.268597+0000","last_clean":"2024-09-12T18:18:31.268597+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:18:31.268597+0000","last_undegraded":"2024-09-12T18:18:31.268597+0000","last_fullsized":"2024-09-12T18:18:31.268597+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:31.268422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:31.268422+0000","last_clean_scrub_stamp":"2024-09-12T18:18:31.268422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:20.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:34.737749+0000","last_change":"2024-09-12T18:18:34.737749+0000","last_active":"2024-09-12T18:18:34.737749+0000","last_peered":"2024-09-12T18:18:34.737749+0000","last_clean":"2024-09-12T18:18:34.737749+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:18:34.737749+0000","last_undegraded":"2024-09-12T18:18:34.737749+0000","last_fullsized":"2024-09-12T18:18:34.737749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:34.737574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:34.737574+0000","last_clean_scrub_stamp":"2024-09-12T18:18:34.737574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:53.137124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:32.095926+0000","last_change":"2024-09-12T18:18:32.095926+0000","last_active":"2024-09-12T18:18:32.095926+0000","last_peered":"2024-09-12T18:18:32.095926+0000","last_clean":"2024-09-12T18:18:32.095926+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:18:32.095926+0000","last_undegraded":"2024-09-12T18:18:32.095926+0000","last_fullsized":"2024-09-12T18:18:32.095926+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:32.095712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:32.095712+0000","last_clean_scrub_stamp":"2024-09-12T18:18:32.095712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:05.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:36.086955+0000","last_change":"2024-09-12T18:18:36.086955+0000","last_active":"2024-09-12T18:18:36.086955+0000","last_peered":"2024-09-12T18:18:36.086955+0000","last_clean":"2024-09-12T18:18:36.086955+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:18:36.086955+0000","last_undegraded":"2024-09-12T18:18:36.086955+0000","last_fullsized":"2024-09-12T18:18:36.086955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:36.086752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:36.086752+0000","last_clean_scrub_stamp":"2024-09-12T18:18:36.086752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:47.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:30.314292+0000","last_change":"2024-09-12T18:18:30.314292+0000","last_active":"2024-09-12T18:18:30.314292+0000","last_peered":"2024-09-12T18:18:30.314292+0000","last_clean":"2024-09-12T18:18:30.314292+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:18:30.314292+0000","last_undegraded":"2024-09-12T18:18:30.314292+0000","last_fullsized":"2024-09-12T18:18:30.314292+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:30.314122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:30.314122+0000","last_clean_scrub_stamp":"2024-09-12T18:18:30.314122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:59.066217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:33.768131+0000","last_change":"2024-09-12T18:18:33.768131+0000","last_active":"2024-09-12T18:18:33.768131+0000","last_peered":"2024-09-12T18:18:33.768131+0000","last_clean":"2024-09-12T18:18:33.768131+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:18:33.768131+0000","last_undegraded":"2024-09-12T18:18:33.768131+0000","last_fullsized":"2024-09-12T18:18:33.768131+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:33.767953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:33.767953+0000","last_clean_scrub_stamp":"2024-09-12T18:18:33.767953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:33.449016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:29.285707+0000","last_change":"2024-09-12T18:18:29.285707+0000","last_active":"2024-09-12T18:18:29.285707+0000","last_peered":"2024-09-12T18:18:29.285707+0000","last_clean":"2024-09-12T18:18:29.285707+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:18:29.285707+0000","last_undegraded":"2024-09-12T18:18:29.285707+0000","last_fullsized":"2024-09-12T18:18:29.285707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:29.285539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:29.285539+0000","last_clean_scrub_stamp":"2024-09-12T18:18:29.285539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:00.814692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:28.250637+0000","last_change":"2024-09-12T18:18:28.250637+0000","last_active":"2024-09-12T18:18:28.250637+0000","last_peered":"2024-09-12T18:18:28.250637+0000","last_clean":"2024-09-12T18:18:28.250637+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:18:28.250637+0000","last_undegraded":"2024-09-12T18:18:28.250637+0000","last_fullsized":"2024-09-12T18:18:28.250637+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:28.250404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:28.250404+0000","last_clean_scrub_stamp":"2024-09-12T18:18:28.250404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:01.019484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:32.761013+0000","last_change":"2024-09-12T18:18:32.761013+0000","last_active":"2024-09-12T18:18:32.761013+0000","last_peered":"2024-09-12T18:18:32.761013+0000","last_clean":"2024-09-12T18:18:32.761013+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:18:32.761013+0000","last_undegraded":"2024-09-12T18:18:32.761013+0000","last_fullsized":"2024-09-12T18:18:32.761013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:32.760803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:32.760803+0000","last_clean_scrub_stamp":"2024-09-12T18:18:32.760803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:07.038310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:30.092707+0000","last_change":"2024-09-12T18:18:30.092707+0000","last_active":"2024-09-12T18:18:30.092707+0000","last_peered":"2024-09-12T18:18:30.092707+0000","last_clean":"2024-09-12T18:18:30.092707+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:18:30.092707+0000","last_undegraded":"2024-09-12T18:18:30.092707+0000","last_fullsized":"2024-09-12T18:18:30.092707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:30.092505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:30.092505+0000","last_clean_scrub_stamp":"2024-09-12T18:18:30.092505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:22.691409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:27.248250+0000","last_change":"2024-09-12T18:18:27.248250+0000","last_active":"2024-09-12T18:18:27.248250+0000","last_peered":"2024-09-12T18:18:27.248250+0000","last_clean":"2024-09-12T18:18:27.248250+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:18:27.248250+0000","last_undegraded":"2024-09-12T18:18:27.248250+0000","last_fullsized":"2024-09-12T18:18:27.248250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:27.248061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:27.248061+0000","last_clean_scrub_stamp":"2024-09-12T18:18:27.248061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:34.936390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:31.717186+0000","last_change":"2024-09-12T18:18:31.717186+0000","last_active":"2024-09-12T18:18:31.717186+0000","last_peered":"2024-09-12T18:18:31.717186+0000","last_clean":"2024-09-12T18:18:31.717186+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:18:31.717186+0000","last_undegraded":"2024-09-12T18:18:31.717186+0000","last_fullsized":"2024-09-12T18:18:31.717186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:31.716957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:31.716957+0000","last_clean_scrub_stamp":"2024-09-12T18:18:31.716957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.177803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:26.270742+0000","last_change":"2024-09-12T18:18:26.270742+0000","last_active":"2024-09-12T18:18:26.270742+0000","last_peered":"2024-09-12T18:18:26.270742+0000","last_clean":"2024-09-12T18:18:26.270742+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:18:26.270742+0000","last_undegraded":"2024-09-12T18:18:26.270742+0000","last_fullsized":"2024-09-12T18:18:26.270742+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:26.270573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:26.270573+0000","last_clean_scrub_stamp":"2024-09-12T18:18:26.270573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.734922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:29.747587+0000","last_change":"2024-09-12T18:18:29.747587+0000","last_active":"2024-09-12T18:18:29.747587+0000","last_peered":"2024-09-12T18:18:29.747587+0000","last_clean":"2024-09-12T18:18:29.747587+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:18:29.747587+0000","last_undegraded":"2024-09-12T18:18:29.747587+0000","last_fullsized":"2024-09-12T18:18:29.747587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:29.747410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:29.747410+0000","last_clean_scrub_stamp":"2024-09-12T18:18:29.747410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:27.983822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:28.064393+0000","last_change":"2024-09-12T18:18:28.064393+0000","last_active":"2024-09-12T18:18:28.064393+0000","last_peered":"2024-09-12T18:18:28.064393+0000","last_clean":"2024-09-12T18:18:28.064393+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:18:28.064393+0000","last_undegraded":"2024-09-12T18:18:28.064393+0000","last_fullsized":"2024-09-12T18:18:28.064393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:28.064219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:28.064219+0000","last_clean_scrub_stamp":"2024-09-12T18:18:28.064219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:27.903454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:25.284456+0000","last_change":"2024-09-12T18:18:25.284456+0000","last_active":"2024-09-12T18:18:25.284456+0000","last_peered":"2024-09-12T18:18:25.284456+0000","last_clean":"2024-09-12T18:18:25.284456+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:18:25.284456+0000","last_undegraded":"2024-09-12T18:18:25.284456+0000","last_fullsized":"2024-09-12T18:18:25.284456+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:25.284281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:25.284281+0000","last_clean_scrub_stamp":"2024-09-12T18:18:25.284281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.834544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"99'4","reported_seq":189,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.956999+0000","last_change":"2024-09-12T18:18:16.956999+0000","last_active":"2024-09-12T18:18:16.956999+0000","last_peered":"2024-09-12T18:18:16.956999+0000","last_clean":"2024-09-12T18:18:16.956999+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:18:16.956999+0000","last_undegraded":"2024-09-12T18:18:16.956999+0000","last_fullsized":"2024-09-12T18:18:16.956999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'4","last_scrub_stamp":"2024-09-12T18:18:16.956813+0000","last_deep_scrub":"99'4","last_deep_scrub_stamp":"2024-09-12T18:18:16.956813+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.956813+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:41.709536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:20.399265+0000","last_change":"2024-09-12T18:18:20.399265+0000","last_active":"2024-09-12T18:18:20.399265+0000","last_peered":"2024-09-12T18:18:20.399265+0000","last_clean":"2024-09-12T18:18:20.399265+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:18:20.399265+0000","last_undegraded":"2024-09-12T18:18:20.399265+0000","last_fullsized":"2024-09-12T18:18:20.399265+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:20.399068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:20.399068+0000","last_clean_scrub_stamp":"2024-09-12T18:18:20.399068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:43.160674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.738586+0000","last_change":"2024-09-12T18:18:13.738586+0000","last_active":"2024-09-12T18:18:13.738586+0000","last_peered":"2024-09-12T18:18:13.738586+0000","last_clean":"2024-09-12T18:18:13.738586+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:18:13.738586+0000","last_undegraded":"2024-09-12T18:18:13.738586+0000","last_fullsized":"2024-09-12T18:18:13.738586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:13.738413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:13.738413+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.738413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:28.196009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:26.718759+0000","last_change":"2024-09-12T18:18:26.718759+0000","last_active":"2024-09-12T18:18:26.718759+0000","last_peered":"2024-09-12T18:18:26.718759+0000","last_clean":"2024-09-12T18:18:26.718759+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:18:26.718759+0000","last_undegraded":"2024-09-12T18:18:26.718759+0000","last_fullsized":"2024-09-12T18:18:26.718759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:26.718551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:26.718551+0000","last_clean_scrub_stamp":"2024-09-12T18:18:26.718551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:41.947950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.337008+0000","last_change":"2024-09-12T18:18:09.337008+0000","last_active":"2024-09-12T18:18:09.337008+0000","last_peered":"2024-09-12T18:18:09.337008+0000","last_clean":"2024-09-12T18:18:09.337008+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:18:09.337008+0000","last_undegraded":"2024-09-12T18:18:09.337008+0000","last_fullsized":"2024-09-12T18:18:09.337008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.336830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.336830+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.336830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:48.864757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":181,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:27.724598+0000","last_change":"2024-09-12T18:18:27.724598+0000","last_active":"2024-09-12T18:18:27.724598+0000","last_peered":"2024-09-12T18:18:27.724598+0000","last_clean":"2024-09-12T18:18:27.724598+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:18:27.724598+0000","last_undegraded":"2024-09-12T18:18:27.724598+0000","last_fullsized":"2024-09-12T18:18:27.724598+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:27.724415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:27.724415+0000","last_clean_scrub_stamp":"2024-09-12T18:18:27.724415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.820913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"99'12","reported_seq":180,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.935351+0000","last_change":"2024-09-12T18:18:15.935351+0000","last_active":"2024-09-12T18:18:15.935351+0000","last_peered":"2024-09-12T18:18:15.935351+0000","last_clean":"2024-09-12T18:18:15.935351+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:18:15.935351+0000","last_undegraded":"2024-09-12T18:18:15.935351+0000","last_fullsized":"2024-09-12T18:18:15.935351+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'12","last_scrub_stamp":"2024-09-12T18:18:15.935145+0000","last_deep_scrub":"99'12","last_deep_scrub_stamp":"2024-09-12T18:18:15.935145+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.935145+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.212455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"99'2","reported_seq":196,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.939382+0000","last_change":"2024-09-12T18:18:14.939382+0000","last_active":"2024-09-12T18:18:14.939382+0000","last_peered":"2024-09-12T18:18:14.939382+0000","last_clean":"2024-09-12T18:18:14.939382+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:18:14.939382+0000","last_undegraded":"2024-09-12T18:18:14.939382+0000","last_fullsized":"2024-09-12T18:18:14.939382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:14.939141+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:14.939141+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.939141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:54.752385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:18.380542+0000","last_change":"2024-09-12T18:18:18.380542+0000","last_active":"2024-09-12T18:18:18.380542+0000","last_peered":"2024-09-12T18:18:18.380542+0000","last_clean":"2024-09-12T18:18:18.380542+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:18:18.380542+0000","last_undegraded":"2024-09-12T18:18:18.380542+0000","last_fullsized":"2024-09-12T18:18:18.380542+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:18.380370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:18.380370+0000","last_clean_scrub_stamp":"2024-09-12T18:18:18.380370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:51.949885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"99'3","reported_seq":59,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.379041+0000","last_change":"2024-09-12T18:18:07.379041+0000","last_active":"2024-09-12T18:18:07.379041+0000","last_peered":"2024-09-12T18:18:07.379041+0000","last_clean":"2024-09-12T18:18:07.379041+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:18:07.379041+0000","last_undegraded":"2024-09-12T18:18:07.379041+0000","last_fullsized":"2024-09-12T18:18:07.379041+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:07.378868+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:07.378868+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.378868+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:26.083806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.364635+0000","last_change":"2024-09-12T18:18:19.364635+0000","last_active":"2024-09-12T18:18:19.364635+0000","last_peered":"2024-09-12T18:18:19.364635+0000","last_clean":"2024-09-12T18:18:19.364635+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:18:19.364635+0000","last_undegraded":"2024-09-12T18:18:19.364635+0000","last_fullsized":"2024-09-12T18:18:19.364635+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.364463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.364463+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.364463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:04.018914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"99'2","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.971616+0000","last_change":"2024-09-12T18:18:13.971616+0000","last_active":"2024-09-12T18:18:13.971616+0000","last_peered":"2024-09-12T18:18:13.971616+0000","last_clean":"2024-09-12T18:18:13.971616+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:18:13.971616+0000","last_undegraded":"2024-09-12T18:18:13.971616+0000","last_fullsized":"2024-09-12T18:18:13.971616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:13.971421+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:13.971421+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.971421+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:09.949210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:22.031697+0000","last_change":"2024-09-12T18:18:22.031697+0000","last_active":"2024-09-12T18:18:22.031697+0000","last_peered":"2024-09-12T18:18:22.031697+0000","last_clean":"2024-09-12T18:18:22.031697+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:18:22.031697+0000","last_undegraded":"2024-09-12T18:18:22.031697+0000","last_fullsized":"2024-09-12T18:18:22.031697+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:22.031524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:22.031524+0000","last_clean_scrub_stamp":"2024-09-12T18:18:22.031524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:53.545588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.009051+0000","last_change":"2024-09-12T18:18:13.009051+0000","last_active":"2024-09-12T18:18:13.009051+0000","last_peered":"2024-09-12T18:18:13.009051+0000","last_clean":"2024-09-12T18:18:13.009051+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:18:13.009051+0000","last_undegraded":"2024-09-12T18:18:13.009051+0000","last_fullsized":"2024-09-12T18:18:13.009051+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:13.008879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:13.008879+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.008879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.617889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:23.781093+0000","last_change":"2024-09-12T18:18:23.781093+0000","last_active":"2024-09-12T18:18:23.781093+0000","last_peered":"2024-09-12T18:18:23.781093+0000","last_clean":"2024-09-12T18:18:23.781093+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:18:23.781093+0000","last_undegraded":"2024-09-12T18:18:23.781093+0000","last_fullsized":"2024-09-12T18:18:23.781093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:23.780912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:23.780912+0000","last_clean_scrub_stamp":"2024-09-12T18:18:23.780912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:39.239198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"99'3","reported_seq":212,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:12.706325+0000","last_change":"2024-09-12T18:18:12.706325+0000","last_active":"2024-09-12T18:18:12.706325+0000","last_peered":"2024-09-12T18:18:12.706325+0000","last_clean":"2024-09-12T18:18:12.706325+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:18:12.706325+0000","last_undegraded":"2024-09-12T18:18:12.706325+0000","last_fullsized":"2024-09-12T18:18:12.706325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:12.706141+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:12.706141+0000","last_clean_scrub_stamp":"2024-09-12T18:18:12.706141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:52.994231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:23.065737+0000","last_change":"2024-09-12T18:18:23.065737+0000","last_active":"2024-09-12T18:18:23.065737+0000","last_peered":"2024-09-12T18:18:23.065737+0000","last_clean":"2024-09-12T18:18:23.065737+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:18:23.065737+0000","last_undegraded":"2024-09-12T18:18:23.065737+0000","last_fullsized":"2024-09-12T18:18:23.065737+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:23.065558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:23.065558+0000","last_clean_scrub_stamp":"2024-09-12T18:18:23.065558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.667899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.990149+0000","last_change":"2024-09-12T18:18:11.990149+0000","last_active":"2024-09-12T18:18:11.990149+0000","last_peered":"2024-09-12T18:18:11.990149+0000","last_clean":"2024-09-12T18:18:11.990149+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:18:11.990149+0000","last_undegraded":"2024-09-12T18:18:11.990149+0000","last_fullsized":"2024-09-12T18:18:11.990149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:11.989951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:11.989951+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.989951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:04.218973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:24.098708+0000","last_change":"2024-09-12T18:18:24.098708+0000","last_active":"2024-09-12T18:18:24.098708+0000","last_peered":"2024-09-12T18:18:24.098708+0000","last_clean":"2024-09-12T18:18:24.098708+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:18:24.098708+0000","last_undegraded":"2024-09-12T18:18:24.098708+0000","last_fullsized":"2024-09-12T18:18:24.098708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:24.098512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:24.098512+0000","last_clean_scrub_stamp":"2024-09-12T18:18:24.098512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:59.851568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.423022+0000","last_change":"2024-09-12T18:18:06.423022+0000","last_active":"2024-09-12T18:18:06.423022+0000","last_peered":"2024-09-12T18:18:06.423022+0000","last_clean":"2024-09-12T18:18:06.423022+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:18:06.423022+0000","last_undegraded":"2024-09-12T18:18:06.423022+0000","last_fullsized":"2024-09-12T18:18:06.423022+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.422852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.422852+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.422852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:32.660307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:26.118224+0000","last_change":"2024-09-12T18:18:26.118224+0000","last_active":"2024-09-12T18:18:26.118224+0000","last_peered":"2024-09-12T18:18:26.118224+0000","last_clean":"2024-09-12T18:18:26.118224+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:18:26.118224+0000","last_undegraded":"2024-09-12T18:18:26.118224+0000","last_fullsized":"2024-09-12T18:18:26.118224+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:26.118020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:26.118020+0000","last_clean_scrub_stamp":"2024-09-12T18:18:26.118020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.297391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.360640+0000","last_change":"2024-09-12T18:18:08.360640+0000","last_active":"2024-09-12T18:18:08.360640+0000","last_peered":"2024-09-12T18:18:08.360640+0000","last_clean":"2024-09-12T18:18:08.360640+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:18:08.360640+0000","last_undegraded":"2024-09-12T18:18:08.360640+0000","last_fullsized":"2024-09-12T18:18:08.360640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.360470+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.360470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:12.127089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:22.790267+0000","last_change":"2024-09-12T18:18:22.790267+0000","last_active":"2024-09-12T18:18:22.790267+0000","last_peered":"2024-09-12T18:18:22.790267+0000","last_clean":"2024-09-12T18:18:22.790267+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:18:22.790267+0000","last_undegraded":"2024-09-12T18:18:22.790267+0000","last_fullsized":"2024-09-12T18:18:22.790267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:22.790095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:22.790095+0000","last_clean_scrub_stamp":"2024-09-12T18:18:22.790095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:46.177848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'114","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.038010+0000","last_change":"2024-09-12T18:18:07.038010+0000","last_active":"2024-09-12T18:18:07.038010+0000","last_peered":"2024-09-12T18:18:07.038010+0000","last_clean":"2024-09-12T18:18:07.038010+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:18:07.038010+0000","last_undegraded":"2024-09-12T18:18:07.038010+0000","last_fullsized":"2024-09-12T18:18:07.038010+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'114","last_scrub_stamp":"2024-09-12T18:18:07.037826+0000","last_deep_scrub":"99'114","last_deep_scrub_stamp":"2024-09-12T18:18:07.037826+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.037826+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:09.956193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"99'2","reported_seq":200,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.044603+0000","last_change":"2024-09-12T18:18:05.044603+0000","last_active":"2024-09-12T18:18:05.044603+0000","last_peered":"2024-09-12T18:18:05.044603+0000","last_clean":"2024-09-12T18:18:05.044603+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:18:05.044603+0000","last_undegraded":"2024-09-12T18:18:05.044603+0000","last_fullsized":"2024-09-12T18:18:05.044603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:05.044409+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:05.044409+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.044409+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:50.507868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.675158+0000","last_change":"2024-09-12T18:18:08.675158+0000","last_active":"2024-09-12T18:18:08.675158+0000","last_peered":"2024-09-12T18:18:08.675158+0000","last_clean":"2024-09-12T18:18:08.675158+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:18:08.675158+0000","last_undegraded":"2024-09-12T18:18:08.675158+0000","last_fullsized":"2024-09-12T18:18:08.675158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.674968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.674968+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.674968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:01.989940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:20.991454+0000","last_change":"2024-09-12T18:18:20.991454+0000","last_active":"2024-09-12T18:18:20.991454+0000","last_peered":"2024-09-12T18:18:20.991454+0000","last_clean":"2024-09-12T18:18:20.991454+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:18:20.991454+0000","last_undegraded":"2024-09-12T18:18:20.991454+0000","last_fullsized":"2024-09-12T18:18:20.991454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:20.991276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:20.991276+0000","last_clean_scrub_stamp":"2024-09-12T18:18:20.991276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:23.679029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.037952+0000","last_change":"2024-09-12T18:18:08.037952+0000","last_active":"2024-09-12T18:18:08.037952+0000","last_peered":"2024-09-12T18:18:08.037952+0000","last_clean":"2024-09-12T18:18:08.037952+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:18:08.037952+0000","last_undegraded":"2024-09-12T18:18:08.037952+0000","last_fullsized":"2024-09-12T18:18:08.037952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.037776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.037776+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.037776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:16.887981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.647761+0000","last_change":"2024-09-12T18:18:07.647761+0000","last_active":"2024-09-12T18:18:07.647761+0000","last_peered":"2024-09-12T18:18:07.647761+0000","last_clean":"2024-09-12T18:18:07.647761+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:18:07.647761+0000","last_undegraded":"2024-09-12T18:18:07.647761+0000","last_fullsized":"2024-09-12T18:18:07.647761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:07.647588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:07.647588+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.647588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:16.251601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.392490+0000","last_change":"2024-09-12T18:18:17.392490+0000","last_active":"2024-09-12T18:18:17.392490+0000","last_peered":"2024-09-12T18:18:17.392490+0000","last_clean":"2024-09-12T18:18:17.392490+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:18:17.392490+0000","last_undegraded":"2024-09-12T18:18:17.392490+0000","last_fullsized":"2024-09-12T18:18:17.392490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:17.392315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:17.392315+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.392315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:52.091171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:04.671886+0000","last_change":"2024-09-12T18:18:04.671886+0000","last_active":"2024-09-12T18:18:04.671886+0000","last_peered":"2024-09-12T18:18:04.671886+0000","last_clean":"2024-09-12T18:18:04.671886+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:18:04.671886+0000","last_undegraded":"2024-09-12T18:18:04.671886+0000","last_fullsized":"2024-09-12T18:18:04.671886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:04.671711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:04.671711+0000","last_clean_scrub_stamp":"2024-09-12T18:18:04.671711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:11.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":112,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.439014+0000","last_change":"2024-09-12T18:18:05.439014+0000","last_active":"2024-09-12T18:18:05.439014+0000","last_peered":"2024-09-12T18:18:05.439014+0000","last_clean":"2024-09-12T18:18:05.439014+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:18:05.439014+0000","last_undegraded":"2024-09-12T18:18:05.439014+0000","last_fullsized":"2024-09-12T18:18:05.439014+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:05.438827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:05.438827+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.438827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.465649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:21.764316+0000","last_change":"2024-09-12T18:18:21.764316+0000","last_active":"2024-09-12T18:18:21.764316+0000","last_peered":"2024-09-12T18:18:21.764316+0000","last_clean":"2024-09-12T18:18:21.764316+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:18:21.764316+0000","last_undegraded":"2024-09-12T18:18:21.764316+0000","last_fullsized":"2024-09-12T18:18:21.764316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:21.764138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:21.764138+0000","last_clean_scrub_stamp":"2024-09-12T18:18:21.764138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.482626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"99'3","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.969224+0000","last_change":"2024-09-12T18:18:10.969224+0000","last_active":"2024-09-12T18:18:10.969224+0000","last_peered":"2024-09-12T18:18:10.969224+0000","last_clean":"2024-09-12T18:18:10.969224+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:18:10.969224+0000","last_undegraded":"2024-09-12T18:18:10.969224+0000","last_fullsized":"2024-09-12T18:18:10.969224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:10.969049+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:10.969049+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.969049+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:26.882435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.011049+0000","last_change":"2024-09-12T18:18:10.011049+0000","last_active":"2024-09-12T18:18:10.011049+0000","last_peered":"2024-09-12T18:18:10.011049+0000","last_clean":"2024-09-12T18:18:10.011049+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:18:10.011049+0000","last_undegraded":"2024-09-12T18:18:10.011049+0000","last_fullsized":"2024-09-12T18:18:10.011049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:10.010962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:10.010962+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.010962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:28.945378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:20.749319+0000","last_change":"2024-09-12T18:18:20.749319+0000","last_active":"2024-09-12T18:18:20.749319+0000","last_peered":"2024-09-12T18:18:20.749319+0000","last_clean":"2024-09-12T18:18:20.749319+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:18:20.749319+0000","last_undegraded":"2024-09-12T18:18:20.749319+0000","last_fullsized":"2024-09-12T18:18:20.749319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:20.749119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:20.749119+0000","last_clean_scrub_stamp":"2024-09-12T18:18:20.749119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:11.628864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.034397+0000","last_change":"2024-09-12T18:18:09.034397+0000","last_active":"2024-09-12T18:18:09.034397+0000","last_peered":"2024-09-12T18:18:09.034397+0000","last_clean":"2024-09-12T18:18:09.034397+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:18:09.034397+0000","last_undegraded":"2024-09-12T18:18:09.034397+0000","last_fullsized":"2024-09-12T18:18:09.034397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.034224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.034224+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.034224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:04.477551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.627437+0000","last_change":"2024-09-12T18:18:05.627437+0000","last_active":"2024-09-12T18:18:05.627437+0000","last_peered":"2024-09-12T18:18:05.627437+0000","last_clean":"2024-09-12T18:18:05.627437+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:18:05.627437+0000","last_undegraded":"2024-09-12T18:18:05.627437+0000","last_fullsized":"2024-09-12T18:18:05.627437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:05.627265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:05.627265+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.627265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.270385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.344720+0000","last_change":"2024-09-12T18:18:16.344720+0000","last_active":"2024-09-12T18:18:16.344720+0000","last_peered":"2024-09-12T18:18:16.344720+0000","last_clean":"2024-09-12T18:18:16.344720+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:18:16.344720+0000","last_undegraded":"2024-09-12T18:18:16.344720+0000","last_fullsized":"2024-09-12T18:18:16.344720+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:16.344552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:16.344552+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.344552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:12.171461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.716740+0000","last_change":"2024-09-12T18:18:09.716740+0000","last_active":"2024-09-12T18:18:09.716740+0000","last_peered":"2024-09-12T18:18:09.716740+0000","last_clean":"2024-09-12T18:18:09.716740+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:18:09.716740+0000","last_undegraded":"2024-09-12T18:18:09.716740+0000","last_fullsized":"2024-09-12T18:18:09.716740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.716563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.716563+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.716563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:17.402291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:04.392697+0000","last_change":"2024-09-12T18:18:04.392697+0000","last_active":"2024-09-12T18:18:04.392697+0000","last_peered":"2024-09-12T18:18:04.392697+0000","last_clean":"2024-09-12T18:18:04.392697+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:18:04.392697+0000","last_undegraded":"2024-09-12T18:18:04.392697+0000","last_fullsized":"2024-09-12T18:18:04.392697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:04.392510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:04.392510+0000","last_clean_scrub_stamp":"2024-09-12T18:18:04.392510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:13.797197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.394169+0000","last_change":"2024-09-12T18:18:15.394169+0000","last_active":"2024-09-12T18:18:15.394169+0000","last_peered":"2024-09-12T18:18:15.394169+0000","last_clean":"2024-09-12T18:18:15.394169+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:18:15.394169+0000","last_undegraded":"2024-09-12T18:18:15.394169+0000","last_fullsized":"2024-09-12T18:18:15.394169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:15.393997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:15.393997+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.393997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:21.072594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"99'3","reported_seq":197,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.730192+0000","last_change":"2024-09-12T18:18:11.730192+0000","last_active":"2024-09-12T18:18:11.730192+0000","last_peered":"2024-09-12T18:18:11.730192+0000","last_clean":"2024-09-12T18:18:11.730192+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:18:11.730192+0000","last_undegraded":"2024-09-12T18:18:11.730192+0000","last_fullsized":"2024-09-12T18:18:11.730192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:11.730001+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:11.730001+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.730001+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:01.521288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.650478+0000","last_change":"2024-09-12T18:18:06.650478+0000","last_active":"2024-09-12T18:18:06.650478+0000","last_peered":"2024-09-12T18:18:06.650478+0000","last_clean":"2024-09-12T18:18:06.650478+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:18:06.650478+0000","last_undegraded":"2024-09-12T18:18:06.650478+0000","last_fullsized":"2024-09-12T18:18:06.650478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.650304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.650304+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.650304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:46.048459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.725443+0000","last_change":"2024-09-12T18:18:19.725443+0000","last_active":"2024-09-12T18:18:19.725443+0000","last_peered":"2024-09-12T18:18:19.725443+0000","last_clean":"2024-09-12T18:18:19.725443+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:18:19.725443+0000","last_undegraded":"2024-09-12T18:18:19.725443+0000","last_fullsized":"2024-09-12T18:18:19.725443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.725242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.725242+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.725242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:02.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"99'2","reported_seq":211,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.720534+0000","last_change":"2024-09-12T18:18:10.720534+0000","last_active":"2024-09-12T18:18:10.720534+0000","last_peered":"2024-09-12T18:18:10.720534+0000","last_clean":"2024-09-12T18:18:10.720534+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:18:10.720534+0000","last_undegraded":"2024-09-12T18:18:10.720534+0000","last_fullsized":"2024-09-12T18:18:10.720534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:10.720311+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:10.720311+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.720311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:34.851932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.058872+0000","last_change":"2024-09-12T18:18:06.058872+0000","last_active":"2024-09-12T18:18:06.058872+0000","last_peered":"2024-09-12T18:18:06.058872+0000","last_clean":"2024-09-12T18:18:06.058872+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:18:06.058872+0000","last_undegraded":"2024-09-12T18:18:06.058872+0000","last_fullsized":"2024-09-12T18:18:06.058872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.058694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.058694+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.058694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:55.056058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":112,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.401245+0000","last_change":"2024-09-12T18:18:14.401245+0000","last_active":"2024-09-12T18:18:14.401245+0000","last_peered":"2024-09-12T18:18:14.401245+0000","last_clean":"2024-09-12T18:18:14.401245+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:18:14.401245+0000","last_undegraded":"2024-09-12T18:18:14.401245+0000","last_fullsized":"2024-09-12T18:18:14.401245+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:14.401080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:14.401080+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.401080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:39.481851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:25.128220+0000","last_change":"2024-09-12T18:18:25.128220+0000","last_active":"2024-09-12T18:18:25.128220+0000","last_peered":"2024-09-12T18:18:25.128220+0000","last_clean":"2024-09-12T18:18:25.128220+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:18:25.128220+0000","last_undegraded":"2024-09-12T18:18:25.128220+0000","last_fullsized":"2024-09-12T18:18:25.128220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:25.128045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:25.128045+0000","last_clean_scrub_stamp":"2024-09-12T18:18:25.128045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:54.261612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"99'10","reported_seq":178,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.961290+0000","last_change":"2024-09-12T18:18:17.961290+0000","last_active":"2024-09-12T18:18:17.961290+0000","last_peered":"2024-09-12T18:18:17.961290+0000","last_clean":"2024-09-12T18:18:17.961290+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:18:17.961290+0000","last_undegraded":"2024-09-12T18:18:17.961290+0000","last_fullsized":"2024-09-12T18:18:17.961290+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'10","last_scrub_stamp":"2024-09-12T18:18:17.961102+0000","last_deep_scrub":"99'10","last_deep_scrub_stamp":"2024-09-12T18:18:17.961102+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.961102+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:21.051053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:25.756674+0000","last_change":"2024-09-12T18:18:25.756674+0000","last_active":"2024-09-12T18:18:25.756674+0000","last_peered":"2024-09-12T18:18:25.756674+0000","last_clean":"2024-09-12T18:18:25.756674+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:18:25.756674+0000","last_undegraded":"2024-09-12T18:18:25.756674+0000","last_fullsized":"2024-09-12T18:18:25.756674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:25.756497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:25.756497+0000","last_clean_scrub_stamp":"2024-09-12T18:18:25.756497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:21.157908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"99'5","reported_seq":34,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.369275+0000","last_change":"2024-09-12T18:18:10.369275+0000","last_active":"2024-09-12T18:18:10.369275+0000","last_peered":"2024-09-12T18:18:10.369275+0000","last_clean":"2024-09-12T18:18:10.369275+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:18:10.369275+0000","last_undegraded":"2024-09-12T18:18:10.369275+0000","last_fullsized":"2024-09-12T18:18:10.369275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'5","last_scrub_stamp":"2024-09-12T18:18:10.369086+0000","last_deep_scrub":"99'5","last_deep_scrub_stamp":"2024-09-12T18:18:10.369086+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.369086+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:42.120931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":136,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.003134+0000","last_change":"2024-09-12T18:18:19.003134+0000","last_active":"2024-09-12T18:18:19.003134+0000","last_peered":"2024-09-12T18:18:19.003134+0000","last_clean":"2024-09-12T18:18:19.003134+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:18:19.003134+0000","last_undegraded":"2024-09-12T18:18:19.003134+0000","last_fullsized":"2024-09-12T18:18:19.003134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.002928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.002928+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.002928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:00.994887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:30.716606+0000","last_change":"2024-09-12T18:18:30.716606+0000","last_active":"2024-09-12T18:18:30.716606+0000","last_peered":"2024-09-12T18:18:30.716606+0000","last_clean":"2024-09-12T18:18:30.716606+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:18:30.716606+0000","last_undegraded":"2024-09-12T18:18:30.716606+0000","last_fullsized":"2024-09-12T18:18:30.716606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:30.716432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:30.716432+0000","last_clean_scrub_stamp":"2024-09-12T18:18:30.716432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:58.602047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.709802+0000","last_change":"2024-09-12T18:18:14.709666+0000","last_active":"2024-09-12T18:18:14.709802+0000","last_peered":"2024-09-12T18:18:14.709802+0000","last_clean":"2024-09-12T18:18:14.709802+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:18:14.709802+0000","last_undegraded":"2024-09-12T18:18:14.709802+0000","last_fullsized":"2024-09-12T18:18:14.709802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:14.709484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:14.709484+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.709484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:45.973585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:24.735612+0000","last_change":"2024-09-12T18:18:24.735612+0000","last_active":"2024-09-12T18:18:24.735612+0000","last_peered":"2024-09-12T18:18:24.735612+0000","last_clean":"2024-09-12T18:18:24.735612+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:18:24.735612+0000","last_undegraded":"2024-09-12T18:18:24.735612+0000","last_fullsized":"2024-09-12T18:18:24.735612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:24.735432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:24.735432+0000","last_clean_scrub_stamp":"2024-09-12T18:18:24.735432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:44.453037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:24.333205+0000","last_change":"2024-09-12T18:18:24.333205+0000","last_active":"2024-09-12T18:18:24.333205+0000","last_peered":"2024-09-12T18:18:24.333205+0000","last_clean":"2024-09-12T18:18:24.333205+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:18:24.333205+0000","last_undegraded":"2024-09-12T18:18:24.333205+0000","last_fullsized":"2024-09-12T18:18:24.333205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:24.333030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:24.333030+0000","last_clean_scrub_stamp":"2024-09-12T18:18:24.333030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.475746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.672725+0000","last_change":"2024-09-12T18:18:15.672725+0000","last_active":"2024-09-12T18:18:15.672725+0000","last_peered":"2024-09-12T18:18:15.672725+0000","last_clean":"2024-09-12T18:18:15.672725+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:18:15.672725+0000","last_undegraded":"2024-09-12T18:18:15.672725+0000","last_fullsized":"2024-09-12T18:18:15.672725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:15.672527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:15.672527+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.672527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:56.693830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:28.705523+0000","last_change":"2024-09-12T18:18:28.705523+0000","last_active":"2024-09-12T18:18:28.705523+0000","last_peered":"2024-09-12T18:18:28.705523+0000","last_clean":"2024-09-12T18:18:28.705523+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:18:28.705523+0000","last_undegraded":"2024-09-12T18:18:28.705523+0000","last_fullsized":"2024-09-12T18:18:28.705523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:28.705329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:28.705329+0000","last_clean_scrub_stamp":"2024-09-12T18:18:28.705329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:45.920437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:18.702406+0000","last_change":"2024-09-12T18:18:18.702406+0000","last_active":"2024-09-12T18:18:18.702406+0000","last_peered":"2024-09-12T18:18:18.702406+0000","last_clean":"2024-09-12T18:18:18.702406+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:18:18.702406+0000","last_undegraded":"2024-09-12T18:18:18.702406+0000","last_fullsized":"2024-09-12T18:18:18.702406+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:18.702211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:18.702211+0000","last_clean_scrub_stamp":"2024-09-12T18:18:18.702211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:54.433092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:22.404503+0000","last_change":"2024-09-12T18:18:22.404503+0000","last_active":"2024-09-12T18:18:22.404503+0000","last_peered":"2024-09-12T18:18:22.404503+0000","last_clean":"2024-09-12T18:18:22.404503+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:18:22.404503+0000","last_undegraded":"2024-09-12T18:18:22.404503+0000","last_fullsized":"2024-09-12T18:18:22.404503+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:22.404328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:22.404328+0000","last_clean_scrub_stamp":"2024-09-12T18:18:22.404328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:31.669876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.344080+0000","last_change":"2024-09-12T18:18:11.344080+0000","last_active":"2024-09-12T18:18:11.344080+0000","last_peered":"2024-09-12T18:18:11.344080+0000","last_clean":"2024-09-12T18:18:11.344080+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:18:11.344080+0000","last_undegraded":"2024-09-12T18:18:11.344080+0000","last_fullsized":"2024-09-12T18:18:11.344080+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:11.343906+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:11.343906+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.343906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.876756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:23.366544+0000","last_change":"2024-09-12T18:18:23.366544+0000","last_active":"2024-09-12T18:18:23.366544+0000","last_peered":"2024-09-12T18:18:23.366544+0000","last_clean":"2024-09-12T18:18:23.366544+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:18:23.366544+0000","last_undegraded":"2024-09-12T18:18:23.366544+0000","last_fullsized":"2024-09-12T18:18:23.366544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:23.366320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:23.366320+0000","last_clean_scrub_stamp":"2024-09-12T18:18:23.366320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:05.934196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:12.355637+0000","last_change":"2024-09-12T18:18:12.355637+0000","last_active":"2024-09-12T18:18:12.355637+0000","last_peered":"2024-09-12T18:18:12.355637+0000","last_clean":"2024-09-12T18:18:12.355637+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:18:12.355637+0000","last_undegraded":"2024-09-12T18:18:12.355637+0000","last_fullsized":"2024-09-12T18:18:12.355637+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:12.355434+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:12.355434+0000","last_clean_scrub_stamp":"2024-09-12T18:18:12.355434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:28.993650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:31.128942+0000","last_change":"2024-09-12T18:18:31.128942+0000","last_active":"2024-09-12T18:18:31.128942+0000","last_peered":"2024-09-12T18:18:31.128942+0000","last_clean":"2024-09-12T18:18:31.128942+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:18:31.128942+0000","last_undegraded":"2024-09-12T18:18:31.128942+0000","last_fullsized":"2024-09-12T18:18:31.128942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:31.128737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:31.128737+0000","last_clean_scrub_stamp":"2024-09-12T18:18:31.128737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:02.944217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"99'3","reported_seq":152,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.974170+0000","last_change":"2024-09-12T18:18:19.974170+0000","last_active":"2024-09-12T18:18:19.974170+0000","last_peered":"2024-09-12T18:18:19.974170+0000","last_clean":"2024-09-12T18:18:19.974170+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:18:19.974170+0000","last_undegraded":"2024-09-12T18:18:19.974170+0000","last_fullsized":"2024-09-12T18:18:19.974170+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:19.973973+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:19.973973+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.973973+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:14.406611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:29.078449+0000","last_change":"2024-09-12T18:18:29.078449+0000","last_active":"2024-09-12T18:18:29.078449+0000","last_peered":"2024-09-12T18:18:29.078449+0000","last_clean":"2024-09-12T18:18:29.078449+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:18:29.078449+0000","last_undegraded":"2024-09-12T18:18:29.078449+0000","last_fullsized":"2024-09-12T18:18:29.078449+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:29.078248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:29.078248+0000","last_clean_scrub_stamp":"2024-09-12T18:18:29.078248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:34.082047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"99'3","reported_seq":67,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.382529+0000","last_change":"2024-09-12T18:18:13.382529+0000","last_active":"2024-09-12T18:18:13.382529+0000","last_peered":"2024-09-12T18:18:13.382529+0000","last_clean":"2024-09-12T18:18:13.382529+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:18:13.382529+0000","last_undegraded":"2024-09-12T18:18:13.382529+0000","last_fullsized":"2024-09-12T18:18:13.382529+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:13.382329+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:13.382329+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.382329+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:31.263684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:21.399034+0000","last_change":"2024-09-12T18:18:21.399034+0000","last_active":"2024-09-12T18:18:21.399034+0000","last_peered":"2024-09-12T18:18:21.399034+0000","last_clean":"2024-09-12T18:18:21.399034+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:18:21.399034+0000","last_undegraded":"2024-09-12T18:18:21.399034+0000","last_fullsized":"2024-09-12T18:18:21.399034+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:21.398864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:21.398864+0000","last_clean_scrub_stamp":"2024-09-12T18:18:21.398864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:26.710571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":195,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.713828+0000","last_change":"2024-09-12T18:18:16.713828+0000","last_active":"2024-09-12T18:18:16.713828+0000","last_peered":"2024-09-12T18:18:16.713828+0000","last_clean":"2024-09-12T18:18:16.713828+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:18:16.713828+0000","last_undegraded":"2024-09-12T18:18:16.713828+0000","last_fullsized":"2024-09-12T18:18:16.713828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:16.713643+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:16.713643+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.713643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:37.564552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:27.069847+0000","last_change":"2024-09-12T18:18:27.069847+0000","last_active":"2024-09-12T18:18:27.069847+0000","last_peered":"2024-09-12T18:18:27.069847+0000","last_clean":"2024-09-12T18:18:27.069847+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:18:27.069847+0000","last_undegraded":"2024-09-12T18:18:27.069847+0000","last_fullsized":"2024-09-12T18:18:27.069847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:27.069645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:27.069645+0000","last_clean_scrub_stamp":"2024-09-12T18:18:27.069645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:59.767369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":219,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.753060+0000","last_change":"2024-09-12T18:18:17.753060+0000","last_active":"2024-09-12T18:18:17.753060+0000","last_peered":"2024-09-12T18:18:17.753060+0000","last_clean":"2024-09-12T18:18:17.753060+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:18:17.753060+0000","last_undegraded":"2024-09-12T18:18:17.753060+0000","last_fullsized":"2024-09-12T18:18:17.753060+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'6","last_scrub_stamp":"2024-09-12T18:18:17.752859+0000","last_deep_scrub":"99'6","last_deep_scrub_stamp":"2024-09-12T18:18:17.752859+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.752859+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:13.953585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284988,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94086852,"statfs":{"total":96636764160,"available":96344936448,"internally_reserved":0,"allocated":1159168,"data_stored":1054579,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738438,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397372,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974468,"statfs":{"total":96636764160,"available":96229855232,"internally_reserved":0,"allocated":1093632,"data_stored":462417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285583,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50432,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":49274,"kb_avail":94321408,"statfs":{"total":96636764160,"available":96585121792,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":50456679},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:18:45.921 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:45.922 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:13:22.369601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=13, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:18:45.923 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:19:05.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:19:06.253 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:19:06.257 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T18:19:06.271 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-12T18:19:04.494433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":591602,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":732792,"kb_used_data":3336,"kb_used_omap":9,"kb_used_meta":729398,"kb_avail":282382728,"statfs":{"total":289910292480,"available":289159913472,"internally_reserved":0,"allocated":3416064,"data_stored":2570940,"data_compressed":14423,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":9231,"internal_metadata":746904561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004795"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:37.326867+0000","last_change":"2024-09-12T18:18:37.326867+0000","last_active":"2024-09-12T18:18:37.326867+0000","last_peered":"2024-09-12T18:18:37.326867+0000","last_clean":"2024-09-12T18:18:37.326867+0000","last_became_active":"2024-09-12T18:17:37.157083+0000","last_became_peered":"2024-09-12T18:17:37.157083+0000","last_unstale":"2024-09-12T18:18:37.326867+0000","last_undegraded":"2024-09-12T18:18:37.326867+0000","last_fullsized":"2024-09-12T18:18:37.326867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:37.326688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:37.326688+0000","last_clean_scrub_stamp":"2024-09-12T18:18:37.326688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:10.885631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:36.357390+0000","last_change":"2024-09-12T18:18:36.357390+0000","last_active":"2024-09-12T18:18:36.357390+0000","last_peered":"2024-09-12T18:18:36.357390+0000","last_clean":"2024-09-12T18:18:36.357390+0000","last_became_active":"2024-09-12T18:17:57.229786+0000","last_became_peered":"2024-09-12T18:17:57.229786+0000","last_unstale":"2024-09-12T18:18:36.357390+0000","last_undegraded":"2024-09-12T18:18:36.357390+0000","last_fullsized":"2024-09-12T18:18:36.357390+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:36.357221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:36.357221+0000","last_clean_scrub_stamp":"2024-09-12T18:18:36.357221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:12.818515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:42.196132+0000","last_change":"2024-09-12T18:18:42.196132+0000","last_active":"2024-09-12T18:18:42.196132+0000","last_peered":"2024-09-12T18:18:42.196132+0000","last_clean":"2024-09-12T18:18:42.196132+0000","last_became_active":"2024-09-12T18:17:36.784780+0000","last_became_peered":"2024-09-12T18:17:36.784780+0000","last_unstale":"2024-09-12T18:18:42.196132+0000","last_undegraded":"2024-09-12T18:18:42.196132+0000","last_fullsized":"2024-09-12T18:18:42.196132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:42.195951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:42.195951+0000","last_clean_scrub_stamp":"2024-09-12T18:18:42.195951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:30.677699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:41.182125+0000","last_change":"2024-09-12T18:18:41.182125+0000","last_active":"2024-09-12T18:18:41.182125+0000","last_peered":"2024-09-12T18:18:41.182125+0000","last_clean":"2024-09-12T18:18:41.182125+0000","last_became_active":"2024-09-12T18:13:23.411068+0000","last_became_peered":"2024-09-12T18:13:23.411068+0000","last_unstale":"2024-09-12T18:18:41.182125+0000","last_undegraded":"2024-09-12T18:18:41.182125+0000","last_fullsized":"2024-09-12T18:18:41.182125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:41.181946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:41.181946+0000","last_clean_scrub_stamp":"2024-09-12T18:18:41.181946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:29.824479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:35.389540+0000","last_change":"2024-09-12T18:18:35.389540+0000","last_active":"2024-09-12T18:18:35.389540+0000","last_peered":"2024-09-12T18:18:35.389540+0000","last_clean":"2024-09-12T18:18:35.389540+0000","last_became_active":"2024-09-12T18:17:57.223303+0000","last_became_peered":"2024-09-12T18:17:57.223303+0000","last_unstale":"2024-09-12T18:18:35.389540+0000","last_undegraded":"2024-09-12T18:18:35.389540+0000","last_fullsized":"2024-09-12T18:18:35.389540+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:35.389372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:35.389372+0000","last_clean_scrub_stamp":"2024-09-12T18:18:35.389372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:08.092706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":94,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:40.136113+0000","last_change":"2024-09-12T18:18:40.136113+0000","last_active":"2024-09-12T18:18:40.136113+0000","last_peered":"2024-09-12T18:18:40.136113+0000","last_clean":"2024-09-12T18:18:40.136113+0000","last_became_active":"2024-09-12T18:17:54.843294+0000","last_became_peered":"2024-09-12T18:17:54.843294+0000","last_unstale":"2024-09-12T18:18:40.136113+0000","last_undegraded":"2024-09-12T18:18:40.136113+0000","last_fullsized":"2024-09-12T18:18:40.136113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:40.135928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:40.135928+0000","last_clean_scrub_stamp":"2024-09-12T18:18:40.135928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:06.445427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":117,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:39.179228+0000","last_change":"2024-09-12T18:18:39.179228+0000","last_active":"2024-09-12T18:18:39.179228+0000","last_peered":"2024-09-12T18:18:39.179228+0000","last_clean":"2024-09-12T18:18:39.179228+0000","last_became_active":"2024-09-12T18:17:54.840335+0000","last_became_peered":"2024-09-12T18:17:54.840335+0000","last_unstale":"2024-09-12T18:18:39.179228+0000","last_undegraded":"2024-09-12T18:18:39.179228+0000","last_fullsized":"2024-09-12T18:18:39.179228+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:39.179035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:39.179035+0000","last_clean_scrub_stamp":"2024-09-12T18:18:39.179035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:08.675673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:37.115992+0000","last_change":"2024-09-12T18:18:37.115992+0000","last_active":"2024-09-12T18:18:37.115992+0000","last_peered":"2024-09-12T18:18:37.115992+0000","last_clean":"2024-09-12T18:18:37.115992+0000","last_became_active":"2024-09-12T18:17:43.829254+0000","last_became_peered":"2024-09-12T18:17:43.829254+0000","last_unstale":"2024-09-12T18:18:37.115992+0000","last_undegraded":"2024-09-12T18:18:37.115992+0000","last_fullsized":"2024-09-12T18:18:37.115992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:37.115757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:37.115757+0000","last_clean_scrub_stamp":"2024-09-12T18:18:37.115757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:33.583506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:36.792306+0000","last_change":"2024-09-12T18:18:36.792306+0000","last_active":"2024-09-12T18:18:36.792306+0000","last_peered":"2024-09-12T18:18:36.792306+0000","last_clean":"2024-09-12T18:18:36.792306+0000","last_became_active":"2024-09-12T18:17:36.783154+0000","last_became_peered":"2024-09-12T18:17:36.783154+0000","last_unstale":"2024-09-12T18:18:36.792306+0000","last_undegraded":"2024-09-12T18:18:36.792306+0000","last_fullsized":"2024-09-12T18:18:36.792306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:36.792112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:36.792112+0000","last_clean_scrub_stamp":"2024-09-12T18:18:36.792112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:04.051668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:34.347564+0000","last_change":"2024-09-12T18:18:34.347564+0000","last_active":"2024-09-12T18:18:34.347564+0000","last_peered":"2024-09-12T18:18:34.347564+0000","last_clean":"2024-09-12T18:18:34.347564+0000","last_became_active":"2024-09-12T18:17:57.231073+0000","last_became_peered":"2024-09-12T18:17:57.231073+0000","last_unstale":"2024-09-12T18:18:34.347564+0000","last_undegraded":"2024-09-12T18:18:34.347564+0000","last_fullsized":"2024-09-12T18:18:34.347564+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:34.347373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:34.347373+0000","last_clean_scrub_stamp":"2024-09-12T18:18:34.347373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:36.180896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:38.142403+0000","last_change":"2024-09-12T18:18:38.142403+0000","last_active":"2024-09-12T18:18:38.142403+0000","last_peered":"2024-09-12T18:18:38.142403+0000","last_clean":"2024-09-12T18:18:38.142403+0000","last_became_active":"2024-09-12T18:17:54.850524+0000","last_became_peered":"2024-09-12T18:17:54.850524+0000","last_unstale":"2024-09-12T18:18:38.142403+0000","last_undegraded":"2024-09-12T18:18:38.142403+0000","last_fullsized":"2024-09-12T18:18:38.142403+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:38.142225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:38.142225+0000","last_clean_scrub_stamp":"2024-09-12T18:18:38.142225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:53.789786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:33.300224+0000","last_change":"2024-09-12T18:18:33.300224+0000","last_active":"2024-09-12T18:18:33.300224+0000","last_peered":"2024-09-12T18:18:33.300224+0000","last_clean":"2024-09-12T18:18:33.300224+0000","last_became_active":"2024-09-12T18:17:57.233008+0000","last_became_peered":"2024-09-12T18:17:57.233008+0000","last_unstale":"2024-09-12T18:18:33.300224+0000","last_undegraded":"2024-09-12T18:18:33.300224+0000","last_fullsized":"2024-09-12T18:18:33.300224+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:33.300055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:33.300055+0000","last_clean_scrub_stamp":"2024-09-12T18:18:33.300055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:11.264330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:32.264836+0000","last_change":"2024-09-12T18:18:32.264836+0000","last_active":"2024-09-12T18:18:32.264836+0000","last_peered":"2024-09-12T18:18:32.264836+0000","last_clean":"2024-09-12T18:18:32.264836+0000","last_became_active":"2024-09-12T18:17:57.227739+0000","last_became_peered":"2024-09-12T18:17:57.227739+0000","last_unstale":"2024-09-12T18:18:32.264836+0000","last_undegraded":"2024-09-12T18:18:32.264836+0000","last_fullsized":"2024-09-12T18:18:32.264836+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:32.264666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:32.264666+0000","last_clean_scrub_stamp":"2024-09-12T18:18:32.264666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:17.976343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:34.107220+0000","last_change":"2024-09-12T18:18:34.107220+0000","last_active":"2024-09-12T18:18:34.107220+0000","last_peered":"2024-09-12T18:18:34.107220+0000","last_clean":"2024-09-12T18:18:34.107220+0000","last_became_active":"2024-09-12T18:17:36.781780+0000","last_became_peered":"2024-09-12T18:17:36.781780+0000","last_unstale":"2024-09-12T18:18:34.107220+0000","last_undegraded":"2024-09-12T18:18:34.107220+0000","last_fullsized":"2024-09-12T18:18:34.107220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:34.107045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:34.107045+0000","last_clean_scrub_stamp":"2024-09-12T18:18:34.107045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:16.463914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:35.126415+0000","last_change":"2024-09-12T18:18:35.126415+0000","last_active":"2024-09-12T18:18:35.126415+0000","last_peered":"2024-09-12T18:18:35.126415+0000","last_clean":"2024-09-12T18:18:35.126415+0000","last_became_active":"2024-09-12T18:17:43.830783+0000","last_became_peered":"2024-09-12T18:17:43.830783+0000","last_unstale":"2024-09-12T18:18:35.126415+0000","last_undegraded":"2024-09-12T18:18:35.126415+0000","last_fullsized":"2024-09-12T18:18:35.126415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:35.126239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:35.126239+0000","last_clean_scrub_stamp":"2024-09-12T18:18:35.126239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:15.121541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:33.111768+0000","last_change":"2024-09-12T18:18:33.111768+0000","last_active":"2024-09-12T18:18:33.111768+0000","last_peered":"2024-09-12T18:18:33.111768+0000","last_clean":"2024-09-12T18:18:33.111768+0000","last_became_active":"2024-09-12T18:17:54.847970+0000","last_became_peered":"2024-09-12T18:17:54.847970+0000","last_unstale":"2024-09-12T18:18:33.111768+0000","last_undegraded":"2024-09-12T18:18:33.111768+0000","last_fullsized":"2024-09-12T18:18:33.111768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:33.111567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:33.111567+0000","last_clean_scrub_stamp":"2024-09-12T18:18:33.111567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:39.385363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:35.785800+0000","last_change":"2024-09-12T18:18:35.785800+0000","last_active":"2024-09-12T18:18:35.785800+0000","last_peered":"2024-09-12T18:18:35.785800+0000","last_clean":"2024-09-12T18:18:35.785800+0000","last_became_active":"2024-09-12T18:17:36.800308+0000","last_became_peered":"2024-09-12T18:17:36.800308+0000","last_unstale":"2024-09-12T18:18:35.785800+0000","last_undegraded":"2024-09-12T18:18:35.785800+0000","last_fullsized":"2024-09-12T18:18:35.785800+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:35.785628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:35.785628+0000","last_clean_scrub_stamp":"2024-09-12T18:18:35.785628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:29.499469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:31.268597+0000","last_change":"2024-09-12T18:18:31.268597+0000","last_active":"2024-09-12T18:18:31.268597+0000","last_peered":"2024-09-12T18:18:31.268597+0000","last_clean":"2024-09-12T18:18:31.268597+0000","last_became_active":"2024-09-12T18:17:57.226578+0000","last_became_peered":"2024-09-12T18:17:57.226578+0000","last_unstale":"2024-09-12T18:18:31.268597+0000","last_undegraded":"2024-09-12T18:18:31.268597+0000","last_fullsized":"2024-09-12T18:18:31.268597+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:31.268422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:31.268422+0000","last_clean_scrub_stamp":"2024-09-12T18:18:31.268422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:20.455949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:34.737749+0000","last_change":"2024-09-12T18:18:34.737749+0000","last_active":"2024-09-12T18:18:34.737749+0000","last_peered":"2024-09-12T18:18:34.737749+0000","last_clean":"2024-09-12T18:18:34.737749+0000","last_became_active":"2024-09-12T18:17:36.798093+0000","last_became_peered":"2024-09-12T18:17:36.798093+0000","last_unstale":"2024-09-12T18:18:34.737749+0000","last_undegraded":"2024-09-12T18:18:34.737749+0000","last_fullsized":"2024-09-12T18:18:34.737749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:34.737574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:34.737574+0000","last_clean_scrub_stamp":"2024-09-12T18:18:34.737574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:52:53.137124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:32.095926+0000","last_change":"2024-09-12T18:18:32.095926+0000","last_active":"2024-09-12T18:18:32.095926+0000","last_peered":"2024-09-12T18:18:32.095926+0000","last_clean":"2024-09-12T18:18:32.095926+0000","last_became_active":"2024-09-12T18:17:54.847336+0000","last_became_peered":"2024-09-12T18:17:54.847336+0000","last_unstale":"2024-09-12T18:18:32.095926+0000","last_undegraded":"2024-09-12T18:18:32.095926+0000","last_fullsized":"2024-09-12T18:18:32.095926+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:32.095712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:32.095712+0000","last_clean_scrub_stamp":"2024-09-12T18:18:32.095712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:05.414598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:36.086955+0000","last_change":"2024-09-12T18:18:36.086955+0000","last_active":"2024-09-12T18:18:36.086955+0000","last_peered":"2024-09-12T18:18:36.086955+0000","last_clean":"2024-09-12T18:18:36.086955+0000","last_became_active":"2024-09-12T18:17:43.832549+0000","last_became_peered":"2024-09-12T18:17:43.832549+0000","last_unstale":"2024-09-12T18:18:36.086955+0000","last_undegraded":"2024-09-12T18:18:36.086955+0000","last_fullsized":"2024-09-12T18:18:36.086955+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:36.086752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:36.086752+0000","last_clean_scrub_stamp":"2024-09-12T18:18:36.086752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:47.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:30.314292+0000","last_change":"2024-09-12T18:18:30.314292+0000","last_active":"2024-09-12T18:18:30.314292+0000","last_peered":"2024-09-12T18:18:30.314292+0000","last_clean":"2024-09-12T18:18:30.314292+0000","last_became_active":"2024-09-12T18:17:57.217531+0000","last_became_peered":"2024-09-12T18:17:57.217531+0000","last_unstale":"2024-09-12T18:18:30.314292+0000","last_undegraded":"2024-09-12T18:18:30.314292+0000","last_fullsized":"2024-09-12T18:18:30.314292+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:30.314122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:30.314122+0000","last_clean_scrub_stamp":"2024-09-12T18:18:30.314122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:59.066217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:33.768131+0000","last_change":"2024-09-12T18:18:33.768131+0000","last_active":"2024-09-12T18:18:33.768131+0000","last_peered":"2024-09-12T18:18:33.768131+0000","last_clean":"2024-09-12T18:18:33.768131+0000","last_became_active":"2024-09-12T18:17:43.840361+0000","last_became_peered":"2024-09-12T18:17:43.840361+0000","last_unstale":"2024-09-12T18:18:33.768131+0000","last_undegraded":"2024-09-12T18:18:33.768131+0000","last_fullsized":"2024-09-12T18:18:33.768131+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:33.767953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:33.767953+0000","last_clean_scrub_stamp":"2024-09-12T18:18:33.767953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:33.449016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:29.285707+0000","last_change":"2024-09-12T18:18:29.285707+0000","last_active":"2024-09-12T18:18:29.285707+0000","last_peered":"2024-09-12T18:18:29.285707+0000","last_clean":"2024-09-12T18:18:29.285707+0000","last_became_active":"2024-09-12T18:17:57.218309+0000","last_became_peered":"2024-09-12T18:17:57.218309+0000","last_unstale":"2024-09-12T18:18:29.285707+0000","last_undegraded":"2024-09-12T18:18:29.285707+0000","last_fullsized":"2024-09-12T18:18:29.285707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:29.285539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:29.285539+0000","last_clean_scrub_stamp":"2024-09-12T18:18:29.285539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:00.814692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:28.250637+0000","last_change":"2024-09-12T18:18:28.250637+0000","last_active":"2024-09-12T18:18:28.250637+0000","last_peered":"2024-09-12T18:18:28.250637+0000","last_clean":"2024-09-12T18:18:28.250637+0000","last_became_active":"2024-09-12T18:17:44.199010+0000","last_became_peered":"2024-09-12T18:17:44.199010+0000","last_unstale":"2024-09-12T18:18:28.250637+0000","last_undegraded":"2024-09-12T18:18:28.250637+0000","last_fullsized":"2024-09-12T18:18:28.250637+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:28.250404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:28.250404+0000","last_clean_scrub_stamp":"2024-09-12T18:18:28.250404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:01.019484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:32.761013+0000","last_change":"2024-09-12T18:18:32.761013+0000","last_active":"2024-09-12T18:18:32.761013+0000","last_peered":"2024-09-12T18:18:32.761013+0000","last_clean":"2024-09-12T18:18:32.761013+0000","last_became_active":"2024-09-12T18:13:23.415341+0000","last_became_peered":"2024-09-12T18:13:23.415341+0000","last_unstale":"2024-09-12T18:18:32.761013+0000","last_undegraded":"2024-09-12T18:18:32.761013+0000","last_fullsized":"2024-09-12T18:18:32.761013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:32.760803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:32.760803+0000","last_clean_scrub_stamp":"2024-09-12T18:18:32.760803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:07.038310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:30.092707+0000","last_change":"2024-09-12T18:18:30.092707+0000","last_active":"2024-09-12T18:18:30.092707+0000","last_peered":"2024-09-12T18:18:30.092707+0000","last_clean":"2024-09-12T18:18:30.092707+0000","last_became_active":"2024-09-12T18:17:43.840159+0000","last_became_peered":"2024-09-12T18:17:43.840159+0000","last_unstale":"2024-09-12T18:18:30.092707+0000","last_undegraded":"2024-09-12T18:18:30.092707+0000","last_fullsized":"2024-09-12T18:18:30.092707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:30.092505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:30.092505+0000","last_clean_scrub_stamp":"2024-09-12T18:18:30.092505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:22.691409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:27.248250+0000","last_change":"2024-09-12T18:18:27.248250+0000","last_active":"2024-09-12T18:18:27.248250+0000","last_peered":"2024-09-12T18:18:27.248250+0000","last_clean":"2024-09-12T18:18:27.248250+0000","last_became_active":"2024-09-12T18:17:57.234763+0000","last_became_peered":"2024-09-12T18:17:57.234763+0000","last_unstale":"2024-09-12T18:18:27.248250+0000","last_undegraded":"2024-09-12T18:18:27.248250+0000","last_fullsized":"2024-09-12T18:18:27.248250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:27.248061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:27.248061+0000","last_clean_scrub_stamp":"2024-09-12T18:18:27.248061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:34.936390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:31.717186+0000","last_change":"2024-09-12T18:18:31.717186+0000","last_active":"2024-09-12T18:18:31.717186+0000","last_peered":"2024-09-12T18:18:31.717186+0000","last_clean":"2024-09-12T18:18:31.717186+0000","last_became_active":"2024-09-12T18:17:36.797520+0000","last_became_peered":"2024-09-12T18:17:36.797520+0000","last_unstale":"2024-09-12T18:18:31.717186+0000","last_undegraded":"2024-09-12T18:18:31.717186+0000","last_fullsized":"2024-09-12T18:18:31.717186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:31.716957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:31.716957+0000","last_clean_scrub_stamp":"2024-09-12T18:18:31.716957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:02.177803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:26.270742+0000","last_change":"2024-09-12T18:18:26.270742+0000","last_active":"2024-09-12T18:18:26.270742+0000","last_peered":"2024-09-12T18:18:26.270742+0000","last_clean":"2024-09-12T18:18:26.270742+0000","last_became_active":"2024-09-12T18:17:57.223460+0000","last_became_peered":"2024-09-12T18:17:57.223460+0000","last_unstale":"2024-09-12T18:18:26.270742+0000","last_undegraded":"2024-09-12T18:18:26.270742+0000","last_fullsized":"2024-09-12T18:18:26.270742+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:26.270573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:26.270573+0000","last_clean_scrub_stamp":"2024-09-12T18:18:26.270573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.734922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:29.747587+0000","last_change":"2024-09-12T18:18:29.747587+0000","last_active":"2024-09-12T18:18:29.747587+0000","last_peered":"2024-09-12T18:18:29.747587+0000","last_clean":"2024-09-12T18:18:29.747587+0000","last_became_active":"2024-09-12T18:17:36.804047+0000","last_became_peered":"2024-09-12T18:17:36.804047+0000","last_unstale":"2024-09-12T18:18:29.747587+0000","last_undegraded":"2024-09-12T18:18:29.747587+0000","last_fullsized":"2024-09-12T18:18:29.747587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:29.747410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:29.747410+0000","last_clean_scrub_stamp":"2024-09-12T18:18:29.747410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:27.983822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:28.064393+0000","last_change":"2024-09-12T18:18:28.064393+0000","last_active":"2024-09-12T18:18:28.064393+0000","last_peered":"2024-09-12T18:18:28.064393+0000","last_clean":"2024-09-12T18:18:28.064393+0000","last_became_active":"2024-09-12T18:13:23.408832+0000","last_became_peered":"2024-09-12T18:13:23.408832+0000","last_unstale":"2024-09-12T18:18:28.064393+0000","last_undegraded":"2024-09-12T18:18:28.064393+0000","last_fullsized":"2024-09-12T18:18:28.064393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:28.064219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:28.064219+0000","last_clean_scrub_stamp":"2024-09-12T18:18:28.064219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:27.903454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:25.284456+0000","last_change":"2024-09-12T18:18:25.284456+0000","last_active":"2024-09-12T18:18:25.284456+0000","last_peered":"2024-09-12T18:18:25.284456+0000","last_clean":"2024-09-12T18:18:25.284456+0000","last_became_active":"2024-09-12T18:17:57.232199+0000","last_became_peered":"2024-09-12T18:17:57.232199+0000","last_unstale":"2024-09-12T18:18:25.284456+0000","last_undegraded":"2024-09-12T18:18:25.284456+0000","last_fullsized":"2024-09-12T18:18:25.284456+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:25.284281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:25.284281+0000","last_clean_scrub_stamp":"2024-09-12T18:18:25.284281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:11.834544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"99'4","reported_seq":189,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.956999+0000","last_change":"2024-09-12T18:18:16.956999+0000","last_active":"2024-09-12T18:18:16.956999+0000","last_peered":"2024-09-12T18:18:16.956999+0000","last_clean":"2024-09-12T18:18:16.956999+0000","last_became_active":"2024-09-12T18:13:22.413827+0000","last_became_peered":"2024-09-12T18:13:22.413827+0000","last_unstale":"2024-09-12T18:18:16.956999+0000","last_undegraded":"2024-09-12T18:18:16.956999+0000","last_fullsized":"2024-09-12T18:18:16.956999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'4","last_scrub_stamp":"2024-09-12T18:18:16.956813+0000","last_deep_scrub":"99'4","last_deep_scrub_stamp":"2024-09-12T18:18:16.956813+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.956813+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:41.709536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:20.399265+0000","last_change":"2024-09-12T18:18:20.399265+0000","last_active":"2024-09-12T18:18:20.399265+0000","last_peered":"2024-09-12T18:18:20.399265+0000","last_clean":"2024-09-12T18:18:20.399265+0000","last_became_active":"2024-09-12T18:17:57.220717+0000","last_became_peered":"2024-09-12T18:17:57.220717+0000","last_unstale":"2024-09-12T18:18:20.399265+0000","last_undegraded":"2024-09-12T18:18:20.399265+0000","last_fullsized":"2024-09-12T18:18:20.399265+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:20.399068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:20.399068+0000","last_clean_scrub_stamp":"2024-09-12T18:18:20.399068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:43.160674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.738586+0000","last_change":"2024-09-12T18:18:13.738586+0000","last_active":"2024-09-12T18:18:13.738586+0000","last_peered":"2024-09-12T18:18:13.738586+0000","last_clean":"2024-09-12T18:18:13.738586+0000","last_became_active":"2024-09-12T18:17:52.822375+0000","last_became_peered":"2024-09-12T18:17:52.822375+0000","last_unstale":"2024-09-12T18:18:13.738586+0000","last_undegraded":"2024-09-12T18:18:13.738586+0000","last_fullsized":"2024-09-12T18:18:13.738586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:13.738413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:13.738413+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.738413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:28.196009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:26.718759+0000","last_change":"2024-09-12T18:18:26.718759+0000","last_active":"2024-09-12T18:18:26.718759+0000","last_peered":"2024-09-12T18:18:26.718759+0000","last_clean":"2024-09-12T18:18:26.718759+0000","last_became_active":"2024-09-12T18:13:23.412492+0000","last_became_peered":"2024-09-12T18:13:23.412492+0000","last_unstale":"2024-09-12T18:18:26.718759+0000","last_undegraded":"2024-09-12T18:18:26.718759+0000","last_fullsized":"2024-09-12T18:18:26.718759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:26.718551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:26.718551+0000","last_clean_scrub_stamp":"2024-09-12T18:18:26.718551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:41.947950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.337008+0000","last_change":"2024-09-12T18:18:09.337008+0000","last_active":"2024-09-12T18:18:09.337008+0000","last_peered":"2024-09-12T18:18:09.337008+0000","last_clean":"2024-09-12T18:18:09.337008+0000","last_became_active":"2024-09-12T18:17:44.195064+0000","last_became_peered":"2024-09-12T18:17:44.195064+0000","last_unstale":"2024-09-12T18:18:09.337008+0000","last_undegraded":"2024-09-12T18:18:09.337008+0000","last_fullsized":"2024-09-12T18:18:09.337008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.336830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.336830+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.336830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:48.864757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":181,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:27.724598+0000","last_change":"2024-09-12T18:18:27.724598+0000","last_active":"2024-09-12T18:18:27.724598+0000","last_peered":"2024-09-12T18:18:27.724598+0000","last_clean":"2024-09-12T18:18:27.724598+0000","last_became_active":"2024-09-12T18:17:52.818909+0000","last_became_peered":"2024-09-12T18:17:52.818909+0000","last_unstale":"2024-09-12T18:18:27.724598+0000","last_undegraded":"2024-09-12T18:18:27.724598+0000","last_fullsized":"2024-09-12T18:18:27.724598+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:27.724415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:27.724415+0000","last_clean_scrub_stamp":"2024-09-12T18:18:27.724415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.820913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"99'12","reported_seq":180,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.935351+0000","last_change":"2024-09-12T18:18:15.935351+0000","last_active":"2024-09-12T18:18:15.935351+0000","last_peered":"2024-09-12T18:18:15.935351+0000","last_clean":"2024-09-12T18:18:15.935351+0000","last_became_active":"2024-09-12T18:17:54.848242+0000","last_became_peered":"2024-09-12T18:17:54.848242+0000","last_unstale":"2024-09-12T18:18:15.935351+0000","last_undegraded":"2024-09-12T18:18:15.935351+0000","last_fullsized":"2024-09-12T18:18:15.935351+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'12","last_scrub_stamp":"2024-09-12T18:18:15.935145+0000","last_deep_scrub":"99'12","last_deep_scrub_stamp":"2024-09-12T18:18:15.935145+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.935145+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.212455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"99'2","reported_seq":196,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.939382+0000","last_change":"2024-09-12T18:18:14.939382+0000","last_active":"2024-09-12T18:18:14.939382+0000","last_peered":"2024-09-12T18:18:14.939382+0000","last_clean":"2024-09-12T18:18:14.939382+0000","last_became_active":"2024-09-12T18:17:36.782941+0000","last_became_peered":"2024-09-12T18:17:36.782941+0000","last_unstale":"2024-09-12T18:18:14.939382+0000","last_undegraded":"2024-09-12T18:18:14.939382+0000","last_fullsized":"2024-09-12T18:18:14.939382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:14.939141+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:14.939141+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.939141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:54.752385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:18.380542+0000","last_change":"2024-09-12T18:18:18.380542+0000","last_active":"2024-09-12T18:18:18.380542+0000","last_peered":"2024-09-12T18:18:18.380542+0000","last_clean":"2024-09-12T18:18:18.380542+0000","last_became_active":"2024-09-12T18:17:57.221874+0000","last_became_peered":"2024-09-12T18:17:57.221874+0000","last_unstale":"2024-09-12T18:18:18.380542+0000","last_undegraded":"2024-09-12T18:18:18.380542+0000","last_fullsized":"2024-09-12T18:18:18.380542+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:18.380370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:18.380370+0000","last_clean_scrub_stamp":"2024-09-12T18:18:18.380370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:51.949885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"99'3","reported_seq":59,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.379041+0000","last_change":"2024-09-12T18:18:07.379041+0000","last_active":"2024-09-12T18:18:07.379041+0000","last_peered":"2024-09-12T18:18:07.379041+0000","last_clean":"2024-09-12T18:18:07.379041+0000","last_became_active":"2024-09-12T18:17:57.220174+0000","last_became_peered":"2024-09-12T18:17:57.220174+0000","last_unstale":"2024-09-12T18:18:07.379041+0000","last_undegraded":"2024-09-12T18:18:07.379041+0000","last_fullsized":"2024-09-12T18:18:07.379041+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:07.378868+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:07.378868+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.378868+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:26.083806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.364635+0000","last_change":"2024-09-12T18:18:19.364635+0000","last_active":"2024-09-12T18:18:19.364635+0000","last_peered":"2024-09-12T18:18:19.364635+0000","last_clean":"2024-09-12T18:18:19.364635+0000","last_became_active":"2024-09-12T18:17:57.232830+0000","last_became_peered":"2024-09-12T18:17:57.232830+0000","last_unstale":"2024-09-12T18:18:19.364635+0000","last_undegraded":"2024-09-12T18:18:19.364635+0000","last_fullsized":"2024-09-12T18:18:19.364635+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.364463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.364463+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.364463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:04.018914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"99'2","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.971616+0000","last_change":"2024-09-12T18:18:13.971616+0000","last_active":"2024-09-12T18:18:13.971616+0000","last_peered":"2024-09-12T18:18:13.971616+0000","last_clean":"2024-09-12T18:18:13.971616+0000","last_became_active":"2024-09-12T18:17:43.833718+0000","last_became_peered":"2024-09-12T18:17:43.833718+0000","last_unstale":"2024-09-12T18:18:13.971616+0000","last_undegraded":"2024-09-12T18:18:13.971616+0000","last_fullsized":"2024-09-12T18:18:13.971616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:13.971421+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:13.971421+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.971421+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:09.949210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:22.031697+0000","last_change":"2024-09-12T18:18:22.031697+0000","last_active":"2024-09-12T18:18:22.031697+0000","last_peered":"2024-09-12T18:18:22.031697+0000","last_clean":"2024-09-12T18:18:22.031697+0000","last_became_active":"2024-09-12T18:17:43.833002+0000","last_became_peered":"2024-09-12T18:17:43.833002+0000","last_unstale":"2024-09-12T18:18:22.031697+0000","last_undegraded":"2024-09-12T18:18:22.031697+0000","last_fullsized":"2024-09-12T18:18:22.031697+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:22.031524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:22.031524+0000","last_clean_scrub_stamp":"2024-09-12T18:18:22.031524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:53.545588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":96,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.009051+0000","last_change":"2024-09-12T18:18:13.009051+0000","last_active":"2024-09-12T18:18:13.009051+0000","last_peered":"2024-09-12T18:18:13.009051+0000","last_clean":"2024-09-12T18:18:13.009051+0000","last_became_active":"2024-09-12T18:17:54.845026+0000","last_became_peered":"2024-09-12T18:17:54.845026+0000","last_unstale":"2024-09-12T18:18:13.009051+0000","last_undegraded":"2024-09-12T18:18:13.009051+0000","last_fullsized":"2024-09-12T18:18:13.009051+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:13.008879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:13.008879+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.008879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.617889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:23.781093+0000","last_change":"2024-09-12T18:18:23.781093+0000","last_active":"2024-09-12T18:18:23.781093+0000","last_peered":"2024-09-12T18:18:23.781093+0000","last_clean":"2024-09-12T18:18:23.781093+0000","last_became_active":"2024-09-12T18:17:43.843258+0000","last_became_peered":"2024-09-12T18:17:43.843258+0000","last_unstale":"2024-09-12T18:18:23.781093+0000","last_undegraded":"2024-09-12T18:18:23.781093+0000","last_fullsized":"2024-09-12T18:18:23.781093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:23.780912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:23.780912+0000","last_clean_scrub_stamp":"2024-09-12T18:18:23.780912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:39.239198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"99'3","reported_seq":212,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:12.706325+0000","last_change":"2024-09-12T18:18:12.706325+0000","last_active":"2024-09-12T18:18:12.706325+0000","last_peered":"2024-09-12T18:18:12.706325+0000","last_clean":"2024-09-12T18:18:12.706325+0000","last_became_active":"2024-09-12T18:17:43.832918+0000","last_became_peered":"2024-09-12T18:17:43.832918+0000","last_unstale":"2024-09-12T18:18:12.706325+0000","last_undegraded":"2024-09-12T18:18:12.706325+0000","last_fullsized":"2024-09-12T18:18:12.706325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:12.706141+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:12.706141+0000","last_clean_scrub_stamp":"2024-09-12T18:18:12.706141+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:52.994231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:23.065737+0000","last_change":"2024-09-12T18:18:23.065737+0000","last_active":"2024-09-12T18:18:23.065737+0000","last_peered":"2024-09-12T18:18:23.065737+0000","last_clean":"2024-09-12T18:18:23.065737+0000","last_became_active":"2024-09-12T18:17:54.853898+0000","last_became_peered":"2024-09-12T18:17:54.853898+0000","last_unstale":"2024-09-12T18:18:23.065737+0000","last_undegraded":"2024-09-12T18:18:23.065737+0000","last_fullsized":"2024-09-12T18:18:23.065737+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:23.065558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:23.065558+0000","last_clean_scrub_stamp":"2024-09-12T18:18:23.065558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.667899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.990149+0000","last_change":"2024-09-12T18:18:11.990149+0000","last_active":"2024-09-12T18:18:11.990149+0000","last_peered":"2024-09-12T18:18:11.990149+0000","last_clean":"2024-09-12T18:18:11.990149+0000","last_became_active":"2024-09-12T18:17:54.841538+0000","last_became_peered":"2024-09-12T18:17:54.841538+0000","last_unstale":"2024-09-12T18:18:11.990149+0000","last_undegraded":"2024-09-12T18:18:11.990149+0000","last_fullsized":"2024-09-12T18:18:11.990149+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:11.989951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:11.989951+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.989951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:04.218973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:24.098708+0000","last_change":"2024-09-12T18:18:24.098708+0000","last_active":"2024-09-12T18:18:24.098708+0000","last_peered":"2024-09-12T18:18:24.098708+0000","last_clean":"2024-09-12T18:18:24.098708+0000","last_became_active":"2024-09-12T18:17:43.827238+0000","last_became_peered":"2024-09-12T18:17:43.827238+0000","last_unstale":"2024-09-12T18:18:24.098708+0000","last_undegraded":"2024-09-12T18:18:24.098708+0000","last_fullsized":"2024-09-12T18:18:24.098708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:24.098512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:24.098512+0000","last_clean_scrub_stamp":"2024-09-12T18:18:24.098512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:59.851568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.423022+0000","last_change":"2024-09-12T18:18:06.423022+0000","last_active":"2024-09-12T18:18:06.423022+0000","last_peered":"2024-09-12T18:18:06.423022+0000","last_clean":"2024-09-12T18:18:06.423022+0000","last_became_active":"2024-09-12T18:17:57.226610+0000","last_became_peered":"2024-09-12T18:17:57.226610+0000","last_unstale":"2024-09-12T18:18:06.423022+0000","last_undegraded":"2024-09-12T18:18:06.423022+0000","last_fullsized":"2024-09-12T18:18:06.423022+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.422852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.422852+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.422852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:32.660307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:26.118224+0000","last_change":"2024-09-12T18:18:26.118224+0000","last_active":"2024-09-12T18:18:26.118224+0000","last_peered":"2024-09-12T18:18:26.118224+0000","last_clean":"2024-09-12T18:18:26.118224+0000","last_became_active":"2024-09-12T18:17:43.836038+0000","last_became_peered":"2024-09-12T18:17:43.836038+0000","last_unstale":"2024-09-12T18:18:26.118224+0000","last_undegraded":"2024-09-12T18:18:26.118224+0000","last_fullsized":"2024-09-12T18:18:26.118224+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:26.118020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:26.118020+0000","last_clean_scrub_stamp":"2024-09-12T18:18:26.118020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.297391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.360640+0000","last_change":"2024-09-12T18:18:08.360640+0000","last_active":"2024-09-12T18:18:08.360640+0000","last_peered":"2024-09-12T18:18:08.360640+0000","last_clean":"2024-09-12T18:18:08.360640+0000","last_became_active":"2024-09-12T18:17:57.227560+0000","last_became_peered":"2024-09-12T18:17:57.227560+0000","last_unstale":"2024-09-12T18:18:08.360640+0000","last_undegraded":"2024-09-12T18:18:08.360640+0000","last_fullsized":"2024-09-12T18:18:08.360640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.360470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.360470+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.360470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:12.127089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:22.790267+0000","last_change":"2024-09-12T18:18:22.790267+0000","last_active":"2024-09-12T18:18:22.790267+0000","last_peered":"2024-09-12T18:18:22.790267+0000","last_clean":"2024-09-12T18:18:22.790267+0000","last_became_active":"2024-09-12T18:17:36.783050+0000","last_became_peered":"2024-09-12T18:17:36.783050+0000","last_unstale":"2024-09-12T18:18:22.790267+0000","last_undegraded":"2024-09-12T18:18:22.790267+0000","last_fullsized":"2024-09-12T18:18:22.790267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:22.790095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:22.790095+0000","last_clean_scrub_stamp":"2024-09-12T18:18:22.790095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:46.177848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'114","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.038010+0000","last_change":"2024-09-12T18:18:07.038010+0000","last_active":"2024-09-12T18:18:07.038010+0000","last_peered":"2024-09-12T18:18:07.038010+0000","last_clean":"2024-09-12T18:18:07.038010+0000","last_became_active":"2024-09-12T18:17:46.784497+0000","last_became_peered":"2024-09-12T18:17:46.784497+0000","last_unstale":"2024-09-12T18:18:07.038010+0000","last_undegraded":"2024-09-12T18:18:07.038010+0000","last_fullsized":"2024-09-12T18:18:07.038010+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'114","last_scrub_stamp":"2024-09-12T18:18:07.037826+0000","last_deep_scrub":"99'114","last_deep_scrub_stamp":"2024-09-12T18:18:07.037826+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.037826+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:09.956193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"99'2","reported_seq":200,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.044603+0000","last_change":"2024-09-12T18:18:05.044603+0000","last_active":"2024-09-12T18:18:05.044603+0000","last_peered":"2024-09-12T18:18:05.044603+0000","last_clean":"2024-09-12T18:18:05.044603+0000","last_became_active":"2024-09-12T18:13:17.344517+0000","last_became_peered":"2024-09-12T18:13:17.344517+0000","last_unstale":"2024-09-12T18:18:05.044603+0000","last_undegraded":"2024-09-12T18:18:05.044603+0000","last_fullsized":"2024-09-12T18:18:05.044603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:05.044409+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:05.044409+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.044409+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:11:50.507868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001501058,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.675158+0000","last_change":"2024-09-12T18:18:08.675158+0000","last_active":"2024-09-12T18:18:08.675158+0000","last_peered":"2024-09-12T18:18:08.675158+0000","last_clean":"2024-09-12T18:18:08.675158+0000","last_became_active":"2024-09-12T18:17:36.795163+0000","last_became_peered":"2024-09-12T18:17:36.795163+0000","last_unstale":"2024-09-12T18:18:08.675158+0000","last_undegraded":"2024-09-12T18:18:08.675158+0000","last_fullsized":"2024-09-12T18:18:08.675158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.674968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.674968+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.674968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:01.989940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:20.991454+0000","last_change":"2024-09-12T18:18:20.991454+0000","last_active":"2024-09-12T18:18:20.991454+0000","last_peered":"2024-09-12T18:18:20.991454+0000","last_clean":"2024-09-12T18:18:20.991454+0000","last_became_active":"2024-09-12T18:17:36.784913+0000","last_became_peered":"2024-09-12T18:17:36.784913+0000","last_unstale":"2024-09-12T18:18:20.991454+0000","last_undegraded":"2024-09-12T18:18:20.991454+0000","last_fullsized":"2024-09-12T18:18:20.991454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:20.991276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:20.991276+0000","last_clean_scrub_stamp":"2024-09-12T18:18:20.991276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:23.679029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:08.037952+0000","last_change":"2024-09-12T18:18:08.037952+0000","last_active":"2024-09-12T18:18:08.037952+0000","last_peered":"2024-09-12T18:18:08.037952+0000","last_clean":"2024-09-12T18:18:08.037952+0000","last_became_active":"2024-09-12T18:17:36.782121+0000","last_became_peered":"2024-09-12T18:17:36.782121+0000","last_unstale":"2024-09-12T18:18:08.037952+0000","last_undegraded":"2024-09-12T18:18:08.037952+0000","last_fullsized":"2024-09-12T18:18:08.037952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:08.037776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:08.037776+0000","last_clean_scrub_stamp":"2024-09-12T18:18:08.037776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:16.887981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00098063199999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:07.647761+0000","last_change":"2024-09-12T18:18:07.647761+0000","last_active":"2024-09-12T18:18:07.647761+0000","last_peered":"2024-09-12T18:18:07.647761+0000","last_clean":"2024-09-12T18:18:07.647761+0000","last_became_active":"2024-09-12T18:17:43.836469+0000","last_became_peered":"2024-09-12T18:17:43.836469+0000","last_unstale":"2024-09-12T18:18:07.647761+0000","last_undegraded":"2024-09-12T18:18:07.647761+0000","last_fullsized":"2024-09-12T18:18:07.647761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:07.647588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:07.647588+0000","last_clean_scrub_stamp":"2024-09-12T18:18:07.647588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:16.251601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.392490+0000","last_change":"2024-09-12T18:18:17.392490+0000","last_active":"2024-09-12T18:18:17.392490+0000","last_peered":"2024-09-12T18:18:17.392490+0000","last_clean":"2024-09-12T18:18:17.392490+0000","last_became_active":"2024-09-12T18:17:37.170631+0000","last_became_peered":"2024-09-12T18:17:37.170631+0000","last_unstale":"2024-09-12T18:18:17.392490+0000","last_undegraded":"2024-09-12T18:18:17.392490+0000","last_fullsized":"2024-09-12T18:18:17.392490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:17.392315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:17.392315+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.392315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:52.091171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:04.671886+0000","last_change":"2024-09-12T18:18:04.671886+0000","last_active":"2024-09-12T18:18:04.671886+0000","last_peered":"2024-09-12T18:18:04.671886+0000","last_clean":"2024-09-12T18:18:04.671886+0000","last_became_active":"2024-09-12T18:17:36.807204+0000","last_became_peered":"2024-09-12T18:17:36.807204+0000","last_unstale":"2024-09-12T18:18:04.671886+0000","last_undegraded":"2024-09-12T18:18:04.671886+0000","last_fullsized":"2024-09-12T18:18:04.671886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:04.671711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:04.671711+0000","last_clean_scrub_stamp":"2024-09-12T18:18:04.671711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:11.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011302770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":112,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.439014+0000","last_change":"2024-09-12T18:18:05.439014+0000","last_active":"2024-09-12T18:18:05.439014+0000","last_peered":"2024-09-12T18:18:05.439014+0000","last_clean":"2024-09-12T18:18:05.439014+0000","last_became_active":"2024-09-12T18:17:57.223805+0000","last_became_peered":"2024-09-12T18:17:57.223805+0000","last_unstale":"2024-09-12T18:18:05.439014+0000","last_undegraded":"2024-09-12T18:18:05.439014+0000","last_fullsized":"2024-09-12T18:18:05.439014+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:05.438827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:05.438827+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.438827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:43.465649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:21.764316+0000","last_change":"2024-09-12T18:18:21.764316+0000","last_active":"2024-09-12T18:18:21.764316+0000","last_peered":"2024-09-12T18:18:21.764316+0000","last_clean":"2024-09-12T18:18:21.764316+0000","last_became_active":"2024-09-12T18:17:36.800663+0000","last_became_peered":"2024-09-12T18:17:36.800663+0000","last_unstale":"2024-09-12T18:18:21.764316+0000","last_undegraded":"2024-09-12T18:18:21.764316+0000","last_fullsized":"2024-09-12T18:18:21.764316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:21.764138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:21.764138+0000","last_clean_scrub_stamp":"2024-09-12T18:18:21.764138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.482626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"99'3","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.969224+0000","last_change":"2024-09-12T18:18:10.969224+0000","last_active":"2024-09-12T18:18:10.969224+0000","last_peered":"2024-09-12T18:18:10.969224+0000","last_clean":"2024-09-12T18:18:10.969224+0000","last_became_active":"2024-09-12T18:13:17.345281+0000","last_became_peered":"2024-09-12T18:13:17.345281+0000","last_unstale":"2024-09-12T18:18:10.969224+0000","last_undegraded":"2024-09-12T18:18:10.969224+0000","last_fullsized":"2024-09-12T18:18:10.969224+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:10.969049+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:10.969049+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.969049+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:26.882435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0028958619999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":185,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.011049+0000","last_change":"2024-09-12T18:18:10.011049+0000","last_active":"2024-09-12T18:18:10.011049+0000","last_peered":"2024-09-12T18:18:10.011049+0000","last_clean":"2024-09-12T18:18:10.011049+0000","last_became_active":"2024-09-12T18:13:22.415111+0000","last_became_peered":"2024-09-12T18:13:22.415111+0000","last_unstale":"2024-09-12T18:18:10.011049+0000","last_undegraded":"2024-09-12T18:18:10.011049+0000","last_fullsized":"2024-09-12T18:18:10.011049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:10.010962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:10.010962+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.010962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:28.945378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:20.749319+0000","last_change":"2024-09-12T18:18:20.749319+0000","last_active":"2024-09-12T18:18:20.749319+0000","last_peered":"2024-09-12T18:18:20.749319+0000","last_clean":"2024-09-12T18:18:20.749319+0000","last_became_active":"2024-09-12T18:17:36.802982+0000","last_became_peered":"2024-09-12T18:17:36.802982+0000","last_unstale":"2024-09-12T18:18:20.749319+0000","last_undegraded":"2024-09-12T18:18:20.749319+0000","last_fullsized":"2024-09-12T18:18:20.749319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:20.749119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:20.749119+0000","last_clean_scrub_stamp":"2024-09-12T18:18:20.749119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:11.628864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":115,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.034397+0000","last_change":"2024-09-12T18:18:09.034397+0000","last_active":"2024-09-12T18:18:09.034397+0000","last_peered":"2024-09-12T18:18:09.034397+0000","last_clean":"2024-09-12T18:18:09.034397+0000","last_became_active":"2024-09-12T18:17:54.844447+0000","last_became_peered":"2024-09-12T18:17:54.844447+0000","last_unstale":"2024-09-12T18:18:09.034397+0000","last_undegraded":"2024-09-12T18:18:09.034397+0000","last_fullsized":"2024-09-12T18:18:09.034397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.034224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.034224+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.034224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:04.477551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:05.627437+0000","last_change":"2024-09-12T18:18:05.627437+0000","last_active":"2024-09-12T18:18:05.627437+0000","last_peered":"2024-09-12T18:18:05.627437+0000","last_clean":"2024-09-12T18:18:05.627437+0000","last_became_active":"2024-09-12T18:17:36.800543+0000","last_became_peered":"2024-09-12T18:17:36.800543+0000","last_unstale":"2024-09-12T18:18:05.627437+0000","last_undegraded":"2024-09-12T18:18:05.627437+0000","last_fullsized":"2024-09-12T18:18:05.627437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:05.627265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:05.627265+0000","last_clean_scrub_stamp":"2024-09-12T18:18:05.627265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.270385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015744209999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.344720+0000","last_change":"2024-09-12T18:18:16.344720+0000","last_active":"2024-09-12T18:18:16.344720+0000","last_peered":"2024-09-12T18:18:16.344720+0000","last_clean":"2024-09-12T18:18:16.344720+0000","last_became_active":"2024-09-12T18:17:57.218413+0000","last_became_peered":"2024-09-12T18:17:57.218413+0000","last_unstale":"2024-09-12T18:18:16.344720+0000","last_undegraded":"2024-09-12T18:18:16.344720+0000","last_fullsized":"2024-09-12T18:18:16.344720+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:16.344552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:16.344552+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.344552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:12.171461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:09.716740+0000","last_change":"2024-09-12T18:18:09.716740+0000","last_active":"2024-09-12T18:18:09.716740+0000","last_peered":"2024-09-12T18:18:09.716740+0000","last_clean":"2024-09-12T18:18:09.716740+0000","last_became_active":"2024-09-12T18:17:36.794438+0000","last_became_peered":"2024-09-12T18:17:36.794438+0000","last_unstale":"2024-09-12T18:18:09.716740+0000","last_undegraded":"2024-09-12T18:18:09.716740+0000","last_fullsized":"2024-09-12T18:18:09.716740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:09.716563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:09.716563+0000","last_clean_scrub_stamp":"2024-09-12T18:18:09.716563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:17.402291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:04.392697+0000","last_change":"2024-09-12T18:18:04.392697+0000","last_active":"2024-09-12T18:18:04.392697+0000","last_peered":"2024-09-12T18:18:04.392697+0000","last_clean":"2024-09-12T18:18:04.392697+0000","last_became_active":"2024-09-12T18:17:37.170328+0000","last_became_peered":"2024-09-12T18:17:37.170328+0000","last_unstale":"2024-09-12T18:18:04.392697+0000","last_undegraded":"2024-09-12T18:18:04.392697+0000","last_fullsized":"2024-09-12T18:18:04.392697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:04.392510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:04.392510+0000","last_clean_scrub_stamp":"2024-09-12T18:18:04.392510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:13.797197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.394169+0000","last_change":"2024-09-12T18:18:15.394169+0000","last_active":"2024-09-12T18:18:15.394169+0000","last_peered":"2024-09-12T18:18:15.394169+0000","last_clean":"2024-09-12T18:18:15.394169+0000","last_became_active":"2024-09-12T18:17:57.227721+0000","last_became_peered":"2024-09-12T18:17:57.227721+0000","last_unstale":"2024-09-12T18:18:15.394169+0000","last_undegraded":"2024-09-12T18:18:15.394169+0000","last_fullsized":"2024-09-12T18:18:15.394169+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:15.393997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:15.393997+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.393997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:21.072594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"99'3","reported_seq":197,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.730192+0000","last_change":"2024-09-12T18:18:11.730192+0000","last_active":"2024-09-12T18:18:11.730192+0000","last_peered":"2024-09-12T18:18:11.730192+0000","last_clean":"2024-09-12T18:18:11.730192+0000","last_became_active":"2024-09-12T18:17:36.798160+0000","last_became_peered":"2024-09-12T18:17:36.798160+0000","last_unstale":"2024-09-12T18:18:11.730192+0000","last_undegraded":"2024-09-12T18:18:11.730192+0000","last_fullsized":"2024-09-12T18:18:11.730192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:11.730001+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:11.730001+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.730001+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:01.521288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.650478+0000","last_change":"2024-09-12T18:18:06.650478+0000","last_active":"2024-09-12T18:18:06.650478+0000","last_peered":"2024-09-12T18:18:06.650478+0000","last_clean":"2024-09-12T18:18:06.650478+0000","last_became_active":"2024-09-12T18:17:36.803020+0000","last_became_peered":"2024-09-12T18:17:36.803020+0000","last_unstale":"2024-09-12T18:18:06.650478+0000","last_undegraded":"2024-09-12T18:18:06.650478+0000","last_fullsized":"2024-09-12T18:18:06.650478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.650304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.650304+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.650304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:46.048459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011482409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.725443+0000","last_change":"2024-09-12T18:18:19.725443+0000","last_active":"2024-09-12T18:18:19.725443+0000","last_peered":"2024-09-12T18:18:19.725443+0000","last_clean":"2024-09-12T18:18:19.725443+0000","last_became_active":"2024-09-12T18:17:43.837479+0000","last_became_peered":"2024-09-12T18:17:43.837479+0000","last_unstale":"2024-09-12T18:18:19.725443+0000","last_undegraded":"2024-09-12T18:18:19.725443+0000","last_fullsized":"2024-09-12T18:18:19.725443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.725242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.725242+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.725242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:02.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"99'2","reported_seq":211,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.720534+0000","last_change":"2024-09-12T18:18:10.720534+0000","last_active":"2024-09-12T18:18:10.720534+0000","last_peered":"2024-09-12T18:18:10.720534+0000","last_clean":"2024-09-12T18:18:10.720534+0000","last_became_active":"2024-09-12T18:17:43.844991+0000","last_became_peered":"2024-09-12T18:17:43.844991+0000","last_unstale":"2024-09-12T18:18:10.720534+0000","last_undegraded":"2024-09-12T18:18:10.720534+0000","last_fullsized":"2024-09-12T18:18:10.720534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'2","last_scrub_stamp":"2024-09-12T18:18:10.720311+0000","last_deep_scrub":"99'2","last_deep_scrub_stamp":"2024-09-12T18:18:10.720311+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.720311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:34.851932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":207,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:06.058872+0000","last_change":"2024-09-12T18:18:06.058872+0000","last_active":"2024-09-12T18:18:06.058872+0000","last_peered":"2024-09-12T18:18:06.058872+0000","last_clean":"2024-09-12T18:18:06.058872+0000","last_became_active":"2024-09-12T18:17:36.782921+0000","last_became_peered":"2024-09-12T18:17:36.782921+0000","last_unstale":"2024-09-12T18:18:06.058872+0000","last_undegraded":"2024-09-12T18:18:06.058872+0000","last_fullsized":"2024-09-12T18:18:06.058872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:06.058694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:06.058694+0000","last_clean_scrub_stamp":"2024-09-12T18:18:06.058694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:55.056058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093816600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":112,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.401245+0000","last_change":"2024-09-12T18:18:14.401245+0000","last_active":"2024-09-12T18:18:14.401245+0000","last_peered":"2024-09-12T18:18:14.401245+0000","last_clean":"2024-09-12T18:18:14.401245+0000","last_became_active":"2024-09-12T18:17:57.221917+0000","last_became_peered":"2024-09-12T18:17:57.221917+0000","last_unstale":"2024-09-12T18:18:14.401245+0000","last_undegraded":"2024-09-12T18:18:14.401245+0000","last_fullsized":"2024-09-12T18:18:14.401245+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:14.401080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:14.401080+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.401080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:39.481851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:25.128220+0000","last_change":"2024-09-12T18:18:25.128220+0000","last_active":"2024-09-12T18:18:25.128220+0000","last_peered":"2024-09-12T18:18:25.128220+0000","last_clean":"2024-09-12T18:18:25.128220+0000","last_became_active":"2024-09-12T18:17:43.835723+0000","last_became_peered":"2024-09-12T18:17:43.835723+0000","last_unstale":"2024-09-12T18:18:25.128220+0000","last_undegraded":"2024-09-12T18:18:25.128220+0000","last_fullsized":"2024-09-12T18:18:25.128220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:25.128045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:25.128045+0000","last_clean_scrub_stamp":"2024-09-12T18:18:25.128045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:54.261612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"99'10","reported_seq":178,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.961290+0000","last_change":"2024-09-12T18:18:17.961290+0000","last_active":"2024-09-12T18:18:17.961290+0000","last_peered":"2024-09-12T18:18:17.961290+0000","last_clean":"2024-09-12T18:18:17.961290+0000","last_became_active":"2024-09-12T18:17:54.846416+0000","last_became_peered":"2024-09-12T18:17:54.846416+0000","last_unstale":"2024-09-12T18:18:17.961290+0000","last_undegraded":"2024-09-12T18:18:17.961290+0000","last_fullsized":"2024-09-12T18:18:17.961290+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'10","last_scrub_stamp":"2024-09-12T18:18:17.961102+0000","last_deep_scrub":"99'10","last_deep_scrub_stamp":"2024-09-12T18:18:17.961102+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.961102+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:21.051053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:25.756674+0000","last_change":"2024-09-12T18:18:25.756674+0000","last_active":"2024-09-12T18:18:25.756674+0000","last_peered":"2024-09-12T18:18:25.756674+0000","last_clean":"2024-09-12T18:18:25.756674+0000","last_became_active":"2024-09-12T18:17:36.788923+0000","last_became_peered":"2024-09-12T18:17:36.788923+0000","last_unstale":"2024-09-12T18:18:25.756674+0000","last_undegraded":"2024-09-12T18:18:25.756674+0000","last_fullsized":"2024-09-12T18:18:25.756674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:25.756497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:25.756497+0000","last_clean_scrub_stamp":"2024-09-12T18:18:25.756497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:21.157908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"99'5","reported_seq":34,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:10.369275+0000","last_change":"2024-09-12T18:18:10.369275+0000","last_active":"2024-09-12T18:18:10.369275+0000","last_peered":"2024-09-12T18:18:10.369275+0000","last_clean":"2024-09-12T18:18:10.369275+0000","last_became_active":"2024-09-12T18:17:57.230445+0000","last_became_peered":"2024-09-12T18:17:57.230445+0000","last_unstale":"2024-09-12T18:18:10.369275+0000","last_undegraded":"2024-09-12T18:18:10.369275+0000","last_fullsized":"2024-09-12T18:18:10.369275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'5","last_scrub_stamp":"2024-09-12T18:18:10.369086+0000","last_deep_scrub":"99'5","last_deep_scrub_stamp":"2024-09-12T18:18:10.369086+0000","last_clean_scrub_stamp":"2024-09-12T18:18:10.369086+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:42.120931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":136,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.003134+0000","last_change":"2024-09-12T18:18:19.003134+0000","last_active":"2024-09-12T18:18:19.003134+0000","last_peered":"2024-09-12T18:18:19.003134+0000","last_clean":"2024-09-12T18:18:19.003134+0000","last_became_active":"2024-09-12T18:17:54.838226+0000","last_became_peered":"2024-09-12T18:17:54.838226+0000","last_unstale":"2024-09-12T18:18:19.003134+0000","last_undegraded":"2024-09-12T18:18:19.003134+0000","last_fullsized":"2024-09-12T18:18:19.003134+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:19.002928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:19.002928+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.002928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:00.994887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:30.716606+0000","last_change":"2024-09-12T18:18:30.716606+0000","last_active":"2024-09-12T18:18:30.716606+0000","last_peered":"2024-09-12T18:18:30.716606+0000","last_clean":"2024-09-12T18:18:30.716606+0000","last_became_active":"2024-09-12T18:13:23.412116+0000","last_became_peered":"2024-09-12T18:13:23.412116+0000","last_unstale":"2024-09-12T18:18:30.716606+0000","last_undegraded":"2024-09-12T18:18:30.716606+0000","last_fullsized":"2024-09-12T18:18:30.716606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:30.716432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:30.716432+0000","last_clean_scrub_stamp":"2024-09-12T18:18:30.716432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:58.602047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:14.709802+0000","last_change":"2024-09-12T18:18:14.709666+0000","last_active":"2024-09-12T18:18:14.709802+0000","last_peered":"2024-09-12T18:18:14.709802+0000","last_clean":"2024-09-12T18:18:14.709802+0000","last_became_active":"2024-09-12T18:17:52.819888+0000","last_became_peered":"2024-09-12T18:17:52.819888+0000","last_unstale":"2024-09-12T18:18:14.709802+0000","last_undegraded":"2024-09-12T18:18:14.709802+0000","last_fullsized":"2024-09-12T18:18:14.709802+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:14.709484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:14.709484+0000","last_clean_scrub_stamp":"2024-09-12T18:18:14.709484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:45.973585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:24.735612+0000","last_change":"2024-09-12T18:18:24.735612+0000","last_active":"2024-09-12T18:18:24.735612+0000","last_peered":"2024-09-12T18:18:24.735612+0000","last_clean":"2024-09-12T18:18:24.735612+0000","last_became_active":"2024-09-12T18:17:36.788696+0000","last_became_peered":"2024-09-12T18:17:36.788696+0000","last_unstale":"2024-09-12T18:18:24.735612+0000","last_undegraded":"2024-09-12T18:18:24.735612+0000","last_fullsized":"2024-09-12T18:18:24.735612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:24.735432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:24.735432+0000","last_clean_scrub_stamp":"2024-09-12T18:18:24.735432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:44.453037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:24.333205+0000","last_change":"2024-09-12T18:18:24.333205+0000","last_active":"2024-09-12T18:18:24.333205+0000","last_peered":"2024-09-12T18:18:24.333205+0000","last_clean":"2024-09-12T18:18:24.333205+0000","last_became_active":"2024-09-12T18:17:57.221795+0000","last_became_peered":"2024-09-12T18:17:57.221795+0000","last_unstale":"2024-09-12T18:18:24.333205+0000","last_undegraded":"2024-09-12T18:18:24.333205+0000","last_fullsized":"2024-09-12T18:18:24.333205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:24.333030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:24.333030+0000","last_clean_scrub_stamp":"2024-09-12T18:18:24.333030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:31.475746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":194,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:15.672725+0000","last_change":"2024-09-12T18:18:15.672725+0000","last_active":"2024-09-12T18:18:15.672725+0000","last_peered":"2024-09-12T18:18:15.672725+0000","last_clean":"2024-09-12T18:18:15.672725+0000","last_became_active":"2024-09-12T18:17:36.796922+0000","last_became_peered":"2024-09-12T18:17:36.796922+0000","last_unstale":"2024-09-12T18:18:15.672725+0000","last_undegraded":"2024-09-12T18:18:15.672725+0000","last_fullsized":"2024-09-12T18:18:15.672725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:15.672527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:15.672527+0000","last_clean_scrub_stamp":"2024-09-12T18:18:15.672527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:56.693830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":199,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:28.705523+0000","last_change":"2024-09-12T18:18:28.705523+0000","last_active":"2024-09-12T18:18:28.705523+0000","last_peered":"2024-09-12T18:18:28.705523+0000","last_clean":"2024-09-12T18:18:28.705523+0000","last_became_active":"2024-09-12T18:17:43.840597+0000","last_became_peered":"2024-09-12T18:17:43.840597+0000","last_unstale":"2024-09-12T18:18:28.705523+0000","last_undegraded":"2024-09-12T18:18:28.705523+0000","last_fullsized":"2024-09-12T18:18:28.705523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:28.705329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:28.705329+0000","last_clean_scrub_stamp":"2024-09-12T18:18:28.705329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:45.920437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":201,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:18.702406+0000","last_change":"2024-09-12T18:18:18.702406+0000","last_active":"2024-09-12T18:18:18.702406+0000","last_peered":"2024-09-12T18:18:18.702406+0000","last_clean":"2024-09-12T18:18:18.702406+0000","last_became_active":"2024-09-12T18:17:43.836791+0000","last_became_peered":"2024-09-12T18:17:43.836791+0000","last_unstale":"2024-09-12T18:18:18.702406+0000","last_undegraded":"2024-09-12T18:18:18.702406+0000","last_fullsized":"2024-09-12T18:18:18.702406+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:18.702211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:18.702211+0000","last_clean_scrub_stamp":"2024-09-12T18:18:18.702211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:54.433092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:22.404503+0000","last_change":"2024-09-12T18:18:22.404503+0000","last_active":"2024-09-12T18:18:22.404503+0000","last_peered":"2024-09-12T18:18:22.404503+0000","last_clean":"2024-09-12T18:18:22.404503+0000","last_became_active":"2024-09-12T18:17:44.199310+0000","last_became_peered":"2024-09-12T18:17:44.199310+0000","last_unstale":"2024-09-12T18:18:22.404503+0000","last_undegraded":"2024-09-12T18:18:22.404503+0000","last_fullsized":"2024-09-12T18:18:22.404503+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:22.404328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:22.404328+0000","last_clean_scrub_stamp":"2024-09-12T18:18:22.404328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:31.669876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:11.344080+0000","last_change":"2024-09-12T18:18:11.344080+0000","last_active":"2024-09-12T18:18:11.344080+0000","last_peered":"2024-09-12T18:18:11.344080+0000","last_clean":"2024-09-12T18:18:11.344080+0000","last_became_active":"2024-09-12T18:17:57.223785+0000","last_became_peered":"2024-09-12T18:17:57.223785+0000","last_unstale":"2024-09-12T18:18:11.344080+0000","last_undegraded":"2024-09-12T18:18:11.344080+0000","last_fullsized":"2024-09-12T18:18:11.344080+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:11.343906+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:11.343906+0000","last_clean_scrub_stamp":"2024-09-12T18:18:11.343906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:16.876756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:23.366544+0000","last_change":"2024-09-12T18:18:23.366544+0000","last_active":"2024-09-12T18:18:23.366544+0000","last_peered":"2024-09-12T18:18:23.366544+0000","last_clean":"2024-09-12T18:18:23.366544+0000","last_became_active":"2024-09-12T18:17:57.226328+0000","last_became_peered":"2024-09-12T18:17:57.226328+0000","last_unstale":"2024-09-12T18:18:23.366544+0000","last_undegraded":"2024-09-12T18:18:23.366544+0000","last_fullsized":"2024-09-12T18:18:23.366544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:23.366320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:23.366320+0000","last_clean_scrub_stamp":"2024-09-12T18:18:23.366320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:05.934196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:12.355637+0000","last_change":"2024-09-12T18:18:12.355637+0000","last_active":"2024-09-12T18:18:12.355637+0000","last_peered":"2024-09-12T18:18:12.355637+0000","last_clean":"2024-09-12T18:18:12.355637+0000","last_became_active":"2024-09-12T18:17:57.223122+0000","last_became_peered":"2024-09-12T18:17:57.223122+0000","last_unstale":"2024-09-12T18:18:12.355637+0000","last_undegraded":"2024-09-12T18:18:12.355637+0000","last_fullsized":"2024-09-12T18:18:12.355637+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:12.355434+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:12.355434+0000","last_clean_scrub_stamp":"2024-09-12T18:18:12.355434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:28.993650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:31.128942+0000","last_change":"2024-09-12T18:18:31.128942+0000","last_active":"2024-09-12T18:18:31.128942+0000","last_peered":"2024-09-12T18:18:31.128942+0000","last_clean":"2024-09-12T18:18:31.128942+0000","last_became_active":"2024-09-12T18:17:54.845005+0000","last_became_peered":"2024-09-12T18:17:54.845005+0000","last_unstale":"2024-09-12T18:18:31.128942+0000","last_undegraded":"2024-09-12T18:18:31.128942+0000","last_fullsized":"2024-09-12T18:18:31.128942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:31.128737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:31.128737+0000","last_clean_scrub_stamp":"2024-09-12T18:18:31.128737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:02.944217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"99'3","reported_seq":152,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:19.974170+0000","last_change":"2024-09-12T18:18:19.974170+0000","last_active":"2024-09-12T18:18:19.974170+0000","last_peered":"2024-09-12T18:18:19.974170+0000","last_clean":"2024-09-12T18:18:19.974170+0000","last_became_active":"2024-09-12T18:17:54.853861+0000","last_became_peered":"2024-09-12T18:17:54.853861+0000","last_unstale":"2024-09-12T18:18:19.974170+0000","last_undegraded":"2024-09-12T18:18:19.974170+0000","last_fullsized":"2024-09-12T18:18:19.974170+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:19.973973+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:19.973973+0000","last_clean_scrub_stamp":"2024-09-12T18:18:19.973973+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:14.406611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:29.078449+0000","last_change":"2024-09-12T18:18:29.078449+0000","last_active":"2024-09-12T18:18:29.078449+0000","last_peered":"2024-09-12T18:18:29.078449+0000","last_clean":"2024-09-12T18:18:29.078449+0000","last_became_active":"2024-09-12T18:17:54.843392+0000","last_became_peered":"2024-09-12T18:17:54.843392+0000","last_unstale":"2024-09-12T18:18:29.078449+0000","last_undegraded":"2024-09-12T18:18:29.078449+0000","last_fullsized":"2024-09-12T18:18:29.078449+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:29.078248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:29.078248+0000","last_clean_scrub_stamp":"2024-09-12T18:18:29.078248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:34.082047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"99'3","reported_seq":67,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:13.382529+0000","last_change":"2024-09-12T18:18:13.382529+0000","last_active":"2024-09-12T18:18:13.382529+0000","last_peered":"2024-09-12T18:18:13.382529+0000","last_clean":"2024-09-12T18:18:13.382529+0000","last_became_active":"2024-09-12T18:17:57.223412+0000","last_became_peered":"2024-09-12T18:17:57.223412+0000","last_unstale":"2024-09-12T18:18:13.382529+0000","last_undegraded":"2024-09-12T18:18:13.382529+0000","last_fullsized":"2024-09-12T18:18:13.382529+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'3","last_scrub_stamp":"2024-09-12T18:18:13.382329+0000","last_deep_scrub":"99'3","last_deep_scrub_stamp":"2024-09-12T18:18:13.382329+0000","last_clean_scrub_stamp":"2024-09-12T18:18:13.382329+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:31.263684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:21.399034+0000","last_change":"2024-09-12T18:18:21.399034+0000","last_active":"2024-09-12T18:18:21.399034+0000","last_peered":"2024-09-12T18:18:21.399034+0000","last_clean":"2024-09-12T18:18:21.399034+0000","last_became_active":"2024-09-12T18:17:57.221535+0000","last_became_peered":"2024-09-12T18:17:57.221535+0000","last_unstale":"2024-09-12T18:18:21.399034+0000","last_undegraded":"2024-09-12T18:18:21.399034+0000","last_fullsized":"2024-09-12T18:18:21.399034+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:21.398864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:21.398864+0000","last_clean_scrub_stamp":"2024-09-12T18:18:21.398864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:26.710571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":195,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:16.713828+0000","last_change":"2024-09-12T18:18:16.713828+0000","last_active":"2024-09-12T18:18:16.713828+0000","last_peered":"2024-09-12T18:18:16.713828+0000","last_clean":"2024-09-12T18:18:16.713828+0000","last_became_active":"2024-09-12T18:17:36.808548+0000","last_became_peered":"2024-09-12T18:17:36.808548+0000","last_unstale":"2024-09-12T18:18:16.713828+0000","last_undegraded":"2024-09-12T18:18:16.713828+0000","last_fullsized":"2024-09-12T18:18:16.713828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2024-09-12T18:18:16.713643+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2024-09-12T18:18:16.713643+0000","last_clean_scrub_stamp":"2024-09-12T18:18:16.713643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:37.564552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:27.069847+0000","last_change":"2024-09-12T18:18:27.069847+0000","last_active":"2024-09-12T18:18:27.069847+0000","last_peered":"2024-09-12T18:18:27.069847+0000","last_clean":"2024-09-12T18:18:27.069847+0000","last_became_active":"2024-09-12T18:13:23.416193+0000","last_became_peered":"2024-09-12T18:13:23.416193+0000","last_unstale":"2024-09-12T18:18:27.069847+0000","last_undegraded":"2024-09-12T18:18:27.069847+0000","last_fullsized":"2024-09-12T18:18:27.069847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:18:27.069645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:18:27.069645+0000","last_clean_scrub_stamp":"2024-09-12T18:18:27.069645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:59.767369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":219,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-12T18:18:17.753060+0000","last_change":"2024-09-12T18:18:17.753060+0000","last_active":"2024-09-12T18:18:17.753060+0000","last_peered":"2024-09-12T18:18:17.753060+0000","last_clean":"2024-09-12T18:18:17.753060+0000","last_became_active":"2024-09-12T18:17:43.839999+0000","last_became_peered":"2024-09-12T18:17:43.839999+0000","last_unstale":"2024-09-12T18:18:17.753060+0000","last_undegraded":"2024-09-12T18:18:17.753060+0000","last_fullsized":"2024-09-12T18:18:17.753060+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'6","last_scrub_stamp":"2024-09-12T18:18:17.752859+0000","last_deep_scrub":"99'6","last_deep_scrub_stamp":"2024-09-12T18:18:17.752859+0000","last_clean_scrub_stamp":"2024-09-12T18:18:17.752859+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:13.953585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1234,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":22046,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284988,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94086852,"statfs":{"total":96636764160,"available":96344936448,"internally_reserved":0,"allocated":1159168,"data_stored":1054579,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397372,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":396286,"kb_avail":93974468,"statfs":{"total":96636764160,"available":96229855232,"internally_reserved":0,"allocated":1093632,"data_stored":462417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":405797317},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":83,"seq":356482285587,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50432,"kb_used_data":1136,"kb_used_omap":5,"kb_used_meta":49274,"kb_avail":94321408,"statfs":{"total":96636764160,"available":96585121792,"internally_reserved":0,"allocated":1163264,"data_stored":1053944,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":6041,"internal_metadata":50456679},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6800,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7623,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4446,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:19:06.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:19:06.653 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T18:19:06.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:19:06.991 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:19:06.992 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"btime":"2024-09-12T18:13:26:704705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:13:22.766125+0000","modified":"2024-09-12T18:13:25.788129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4214,"qdb_cluster":[4214]},"id":1}]} 2024-09-12T18:19:06.992 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2024-09-12T18:19:07.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:19:07.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:19:07.336 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"btime":"2024-09-12T18:13:26:704705+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:13:22.766125+0000","modified":"2024-09-12T18:13:25.788129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.62:6803/4162831730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4162831730},{"type":"v1","addr":"172.21.15.62:6803","nonce":4162831730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4214,"qdb_cluster":[4214]},"id":1}]} 2024-09-12T18:19:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 6 2024-09-12T18:19:07.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:19:07.643 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T18:19:07.644 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":99,"fsid":"5c1106a1-8b30-400f-94eb-0bea28eb5927","created":"2024-09-12T18:13:00.942825+0000","modified":"2024-09-12T18:17:56.837752+0000","last_up_change":"2024-09-12T18:17:35.753661+0000","last_in_change":"2024-09-12T18:13:01.815814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:13:10.380891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:13:16.182185+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:13:20.398999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:13:21.732662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5348027-f4dc-457f-8b4e-a4341015d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":42,"up_from":83,"up_thru":98,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6801","nonce":2528869308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6803","nonce":2528869308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6807","nonce":2528869308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":2528869308},{"type":"v1","addr":"172.21.15.129:6805","nonce":2528869308}]},"public_addr":"172.21.15.129:6801/2528869308","cluster_addr":"172.21.15.129:6803/2528869308","heartbeat_back_addr":"172.21.15.129:6807/2528869308","heartbeat_front_addr":"172.21.15.129:6805/2528869308","state":["exists","up"]},{"osd":1,"uuid":"939481c0-5bf6-4136-b772-e0ba4c215bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6801","nonce":1445669154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6803","nonce":1445669154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6807","nonce":1445669154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1445669154},{"type":"v1","addr":"172.21.15.151:6805","nonce":1445669154}]},"public_addr":"172.21.15.151:6801/1445669154","cluster_addr":"172.21.15.151:6803/1445669154","heartbeat_back_addr":"172.21.15.151:6807/1445669154","heartbeat_front_addr":"172.21.15.151:6805/1445669154","state":["exists","up"]},{"osd":2,"uuid":"66fc0ac1-f14f-48bf-a557-110b23bff1d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6801","nonce":752868242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6803","nonce":752868242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6807","nonce":752868242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":752868242},{"type":"v1","addr":"172.21.15.176:6805","nonce":752868242}]},"public_addr":"172.21.15.176:6801/752868242","cluster_addr":"172.21.15.176:6803/752868242","heartbeat_back_addr":"172.21.15.176:6807/752868242","heartbeat_front_addr":"172.21.15.176:6805/752868242","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.730957+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.793073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:13:07.762001+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:19:07.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T18:19:07.995 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T18:19:08.002 INFO:tasks.ceph.mds.a.smithi062.stderr: -2229> 2024-09-12T18:13:25.502+0000 7fa92a684640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T18:19:08.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T18:19:08.039 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2024-09-12T18:19:09.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T18:19:10.177 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2024-09-12T18:19:10.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T18:19:11.187 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2024-09-12T18:19:11.211 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:19:11.212 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T18:19:11.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:11.222 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T18:19:11.223 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:19:11.223 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:19:11.223 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:11.281 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:19:11.281 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:19:11.282 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:11.365 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:19:11.365 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:19:11.365 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:15.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T18:19:17.466 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:19:17.466 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:19:17.467 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:19:17.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:17.500 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:19:17.500 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:19:17.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:17.573 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:19:17.573 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:19:17.574 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:19:17.574 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:17.638 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:19:17.639 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:19:17.639 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:17.705 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:19:17.705 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:19:17.705 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:19:17.773 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:19:17.773 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:19:17.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T18:19:17.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:19:17.838 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:19:18.222 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T18:19:18.222 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:19:18.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T18:19:18.429 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:19:18.710 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:19:18.711 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/data/mon.a.tgz 2024-09-12T18:19:18.712 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T18:19:18.719 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.yn5ZfAZVC0 2024-09-12T18:19:18.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yn5ZfAZVC0 2024-09-12T18:19:18.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.yn5ZfAZVC0 2024-09-12T18:19:18.934 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.yn5ZfAZVC0 is 431KB 2024-09-12T18:19:18.996 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.yn5ZfAZVC0 2024-09-12T18:19:19.001 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/data/mon.b.tgz 2024-09-12T18:19:19.002 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T18:19:19.050 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.9rgdN2rB3u 2024-09-12T18:19:19.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9rgdN2rB3u 2024-09-12T18:19:19.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.9rgdN2rB3u 2024-09-12T18:19:19.302 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.9rgdN2rB3u is 599KB 2024-09-12T18:19:19.364 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.9rgdN2rB3u 2024-09-12T18:19:19.369 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/data/mon.c.tgz 2024-09-12T18:19:19.369 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T18:19:19.418 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.kLDfXk7rsp 2024-09-12T18:19:19.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kLDfXk7rsp 2024-09-12T18:19:19.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.kLDfXk7rsp 2024-09-12T18:19:19.667 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.kLDfXk7rsp is 598KB 2024-09-12T18:19:19.728 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.kLDfXk7rsp 2024-09-12T18:19:19.734 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:19:19.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:19:19.780 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:19:19.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:19:19.785 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:19:19.897 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:19:19.915 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:19:19.923 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:19:19.929 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:19:19.930 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:19:19.931 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi062/crash 2024-09-12T18:19:19.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:19:19.951 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi129/crash 2024-09-12T18:19:19.952 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:19:20.003 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi151/crash 2024-09-12T18:19:20.004 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:19:20.018 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi176/crash 2024-09-12T18:19:20.019 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:19:20.033 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:19:20.033 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:19:20.035 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:19:20.055 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:19:20.067 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:19:20.069 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.744.log 2024-09-12T18:19:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:19:20.070 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.744.log.gz 2024-09-12T18:19:20.076 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27061.log 2024-09-12T18:19:20.077 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27276.log 2024-09-12T18:19:20.078 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25325.log 2024-09-12T18:19:20.079 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27061.log.gz 2024-09-12T18:19:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27198.log 2024-09-12T18:19:20.079 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27276.log.gz 2024-09-12T18:19:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25325.log.gz 2024-09-12T18:19:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27359.log 2024-09-12T18:19:20.079 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25191.log 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27359.log: /var/log/ceph/ceph-client.admin.27198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25741.log 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27359.log.gz 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27198.log.gz 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25191.log.gz 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26950.log 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:19:20.082 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25741.log: /var/log/ceph/ceph-client.admin.26950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26096.log 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26950.log.gz 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25741.log.gz 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23335.log 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24930.log 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26096.log.gz 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22876.log 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23335.log.gz 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24930.log.gz 2024-09-12T18:19:20.083 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27600.log 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26785.log 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22876.log.gz 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27905.log 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27600.log.gz 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26423.log 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26785.log.gz 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24848.log 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27905.log.gz 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23413.log 2024-09-12T18:19:20.089 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26423.log.gz 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27983.log 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24848.log.gz 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.23413.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27522.log 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23413.log.gz 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26452.log 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27983.log.gz 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26507.log 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27522.log.gz 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22842.log 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26452.log.gz 2024-09-12T18:19:20.090 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22341.log 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26507.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22842.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28087.log 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26646.log 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22341.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22634.log 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28087.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25825.log 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26646.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26125.log 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22634.log.gz 2024-09-12T18:19:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25246.log 2024-09-12T18:19:20.092 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25825.log.gz 2024-09-12T18:19:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:19:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25525.log 2024-09-12T18:19:20.146 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26125.log.gz 2024-09-12T18:19:20.146 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24206.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25246.log.gz 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25928.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25525.log.gz 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25132.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24206.log.gz 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23154.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25928.log.gz 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26180.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25132.log.gz 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23154.log.gz 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22790.log 2024-09-12T18:19:20.147 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26180.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24760.log 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28319.log 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22790.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24760.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21723.log 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24760.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24874.log 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28319.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.tmp-client.admin.21723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26591.log 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21723.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5/var/log/ceph/ceph-client.admin.24874.log: --verbose -- /var/log/ceph/ceph-client.admin.26039.log 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24874.log.gz 2024-09-12T18:19:20.148 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27120.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26591.log.gz 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26039.log.gz 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23703.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23032.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27120.log.gz 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23785.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23703.log.gz 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24905.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23032.log.gz 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23957.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23785.log.gz 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25986.log 2024-09-12T18:19:20.149 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24905.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23387.log 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23957.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23284.log 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25986.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23387.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25107.log 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22946.log 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23284.log: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.23284.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24460.log 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25107.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24543.log 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22946.log.gz 2024-09-12T18:19:20.150 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27411.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24460.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24543.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23869.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25356.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27411.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27957.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23869.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25356.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22712.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22517.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27957.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24569.log 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22712.log.gz 2024-09-12T18:19:20.151 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22517.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25657.log 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22261.log 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24569.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23128.log 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25657.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27518.log 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22261.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27224.log 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23128.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23486.log 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27518.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27224.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.27224.log.gz 2024-09-12T18:19:20.152 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22816.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23486.log.gz 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22873.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24371.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22816.log.gz 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27004.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22873.log.gz 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26844.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24371.log.gz 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27004.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.27004.log.gz -- 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.24118.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22389.log 2024-09-12T18:19:20.153 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26844.log.gz 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26617.log 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24118.log.gz 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22389.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22389.log.gz /var/log/ceph/ceph-client.admin.27385.log 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24346.log 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26617.log.gz 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25766.log 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27385.log.gz 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28061.log 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24346.log.gz 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27601.log 2024-09-12T18:19:20.154 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25766.log.gz 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25876.log 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28061.log.gz 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27601.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.27601.log.gz -- 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.24683.log 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24817.log 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25876.log.gz 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25301.log 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24683.log.gz 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24817.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.24817.log.gz /var/log/ceph/ceph-client.admin.27753.log 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28267.log 2024-09-12T18:19:20.155 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25301.log.gz 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22764.log 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27753.log.gz 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24320.log 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28267.log.gz 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26979.log 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22764.log.gz 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28371.log 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24320.log.gz 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26979.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.26979.log.gz /var/log/ceph/ceph-client.admin.25076.log 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.156 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23645.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28371.log.gz 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24791.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25076.log.gz 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.23645.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.23645.log.gz -- 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.23586.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.24791.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25602.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24791.log.gz 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25796.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23586.log.gz 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27827.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25602.log.gz 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27250.log 2024-09-12T18:19:20.157 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25796.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27463.log 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27827.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27437.log 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27250.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24962.log 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27463.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25491.log 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27437.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22875.log 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24962.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28217.log 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25491.log.gz 2024-09-12T18:19:20.158 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22316.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22875.log.gz 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28139.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28217.log.gz 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28165.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22316.log.gz 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25466.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28139.log.gz 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26184.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28165.log.gz 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26313.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25466.log.gz 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26317.log 2024-09-12T18:19:20.159 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26184.log.gz 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22141.log 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26313.log.gz 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27489.log 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26317.log.gz 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26924.log 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22141.log.gz 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23028.log 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27489.log.gz 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22366.log 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26924.log.gz 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24651.log 2024-09-12T18:19:20.160 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23028.log.gz 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24092.log 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22366.log.gz 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25437.log 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24651.log.gz 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26368.log 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24092.log.gz 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26397.log 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25437.log.gz 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28191.log 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26368.log.gz 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26397.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.27671.log 2024-09-12T18:19:20.161 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26397.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22118.log 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28191.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23024.log 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27671.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23811.log 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22118.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25529.log 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23024.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23102.log 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23811.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24434.log 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25529.log.gz 2024-09-12T18:19:20.162 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26670.log 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23102.log.gz 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25902.log 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24434.log.gz 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23206.log 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26670.log.gz 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27879.log 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25902.log.gz 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:19:20.163 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23206.log.gz 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23643.log 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27879.log.gz 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28113.log 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22954.log 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23643.log.gz 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28113.log.gz 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.22954.log: -- /var/log/ceph/ceph-client.admin.24149.log 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22954.log.gz 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24595.log 2024-09-12T18:19:20.164 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24149.log.gz 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25521.log 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26151.log 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24595.log.gz 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25385.log 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25521.log.gz 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25272.log 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26151.log.gz 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25385.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.25385.log.gz -- 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.24263.log 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.25272.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23837.log 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25272.log.gz 2024-09-12T18:19:20.165 INFO:teuthology.orchestra.run.smithi062.stderr: 94.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25162.log 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24263.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23484.log 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23837.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22489.log 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25162.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27749.log 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23484.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23443.log 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22489.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24513.log 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27749.log.gz 2024-09-12T18:19:20.166 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23443.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.27333.log -- replaced with /var/log/ceph/ceph-client.admin.23443.log.gz 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26261.log 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24513.log.gz 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26756.log 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27333.log.gz 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26261.log.gz 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26477.log 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28397.log 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26756.log.gz 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28442.log 0.0% 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26477.log.gz 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:19:20.167 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28397.log.gz 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28442.log.gz 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24403.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27757.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23483.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24403.log.gz 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24061.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27757.log.gz 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24035.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23483.log.gz 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24061.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.24061.log.gz -- 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.28009.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23982.log 2024-09-12T18:19:20.168 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24035.log.gz 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23926.log 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28009.log.gz 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25217.log 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23982.log.gz 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24993.log 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23926.log.gz 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27523.log 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25217.log.gz 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24294.log 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24993.log.gz 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23232.log 2024-09-12T18:19:20.169 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27523.log.gz 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24294.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.26701.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24294.log.gz 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25409.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23232.log.gz 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25631.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26701.log.gz 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25409.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25409.log.gz 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25849.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25631.log.gz 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25019.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.25849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26045.log 2024-09-12T18:19:20.170 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25849.log.gz 2024-09-12T18:19:20.173 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22911.log 2024-09-12T18:19:20.173 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:19:20.173 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.22911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22911.log.gz 2024-09-12T18:19:20.173 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22935.log 2024-09-12T18:19:20.174 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22959.log 2024-09-12T18:19:20.174 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.22935.log: /var/log/ceph/ceph-client.admin.22959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22935.log.gz 0.0% 2024-09-12T18:19:20.174 INFO:teuthology.orchestra.run.smithi176.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22959.log.gz 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23894.log 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25019.log.gz 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26045.log.gz 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21923.log 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.23894.log: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23894.log.gz 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.21923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21923.log.gz 2024-09-12T18:19:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22604.log 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-mds.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23258.log 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22604.log.gz 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23485.log 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23258.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23258.log.gz 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr: -5 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24009.log 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23485.log.gz 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23738.log 2024-09-12T18:19:20.193 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.24009.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25686.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24009.log.gz 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23738.log.gz 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27009.log 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.25686.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26895.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25686.log.gz 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27009.log.gz 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27853.log 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22461.log 0.0% 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26895.log.gz 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26536.log 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27853.log.gz 2024-09-12T18:19:20.194 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28468.log 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22461.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26536.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26536.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27087.log 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28468.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28468.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24626.log 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27087.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25712.log 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24626.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26562.log 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24237.log 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25712.log.gz 2024-09-12T18:19:20.195 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25957.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26562.log.gz 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22738.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24237.log.gz 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26730.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25957.log.gz 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27307.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22738.log.gz 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23180.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26730.log.gz 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23361.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27307.log.gz 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24464.log 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23180.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27146.log 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23361.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28293.log 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24464.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24735.log 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27146.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27593.log 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28293.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23612.log 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24735.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27593.log.gz 2024-09-12T18:19:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28035.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23612.log.gz 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26231.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28345.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28035.log.gz 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24709.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26231.log.gz 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27172.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28345.log.gz 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27931.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24709.log.gz 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26840.log 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27172.log.gz 2024-09-12T18:19:20.198 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25050.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27931.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28243.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26840.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22552.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25050.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.28243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22578.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28243.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22660.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22552.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26015.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22578.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22686.log 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22660.log.gz 2024-09-12T18:19:20.199 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26015.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23734.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22686.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24173.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.23734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26810.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23734.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22953.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24173.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22435.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26810.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26257.log 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22953.log.gz 2024-09-12T18:19:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22435.log.gz 2024-09-12T18:19:20.201 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.26257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26257.log.gz 2024-09-12T18:19:20.201 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:19:20.271 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:19:20.326 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:19:20.396 INFO:teuthology.orchestra.run.smithi062.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:19:20.398 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T18:19:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.360s 2024-09-12T18:19:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m0.853s 2024-09-12T18:19:20.398 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.090s 2024-09-12T18:19:20.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T18:19:31.697 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.0.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:19:31.699 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-09-12T18:19:31.699 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m11.641s 2024-09-12T18:19:31.699 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m10.833s 2024-09-12T18:19:31.699 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.517s 2024-09-12T18:19:48.130 INFO:teuthology.orchestra.run.smithi176.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:19:48.132 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-12T18:19:48.132 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m28.052s 2024-09-12T18:19:48.132 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m27.101s 2024-09-12T18:19:48.132 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.885s 2024-09-12T18:20:02.696 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.1.log: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:20:02.697 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-12T18:20:02.697 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m42.628s 2024-09-12T18:20:02.697 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m41.243s 2024-09-12T18:20:02.697 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m1.372s 2024-09-12T18:20:02.699 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:20:02.699 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi062/log 2024-09-12T18:20:02.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:20:02.986 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi129/log 2024-09-12T18:20:02.987 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:20:04.440 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi151/log 2024-09-12T18:20:04.441 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:20:09.849 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi176/log 2024-09-12T18:20:09.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:20:13.644 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:20:13.653 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:20:13.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:20:13.656 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:20:13.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:20:13.661 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:20:13.774 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:20:13.784 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:20:13.784 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:20:13.787 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:20:13.789 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:20:13.791 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:20:13.797 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:20:13.797 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-09-12T18:20:13.797 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi 67.205.162.81 3 u 61 64 377 0.081 -1.793 1.710 2024-09-12T18:20:13.797 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi 63.231.80.2 3 u 55 64 377 0.082 -3.565 1.799 2024-09-12T18:20:13.797 INFO:teuthology.orchestra.run.smithi062.stdout:*hv03.front.sepi 74.6.168.72 3 u 56 64 377 0.085 -0.151 1.424 2024-09-12T18:20:13.797 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:20:13.803 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:20:13.803 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-12T18:20:13.804 INFO:teuthology.orchestra.run.smithi151.stdout:+hv01.front.sepi 67.205.162.81 3 u 57 64 377 0.092 -2.841 1.097 2024-09-12T18:20:13.804 INFO:teuthology.orchestra.run.smithi151.stdout:*hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.068 -2.135 1.060 2024-09-12T18:20:13.804 INFO:teuthology.orchestra.run.smithi151.stdout:+hv03.front.sepi 74.6.168.72 3 u 57 64 377 0.090 -0.704 1.074 2024-09-12T18:20:13.804 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:20:13.805 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:20:13.805 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2024-09-12T18:20:13.805 INFO:teuthology.orchestra.run.smithi176.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 377 0.078 -2.339 0.517 2024-09-12T18:20:13.805 INFO:teuthology.orchestra.run.smithi176.stdout:*hv02.front.sepi 63.231.80.2 3 u 60 64 377 0.065 -1.407 0.306 2024-09-12T18:20:13.805 INFO:teuthology.orchestra.run.smithi176.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 377 0.087 -0.203 0.490 2024-09-12T18:20:13.805 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:20:13.893 INFO:teuthology.orchestra.run.smithi129.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:20:13.893 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================== 2024-09-12T18:20:13.893 INFO:teuthology.orchestra.run.smithi129.stdout: hv01.front.sepi 67.205.162.81 3 u 43 64 7 0.225 -361.79 1.398 2024-09-12T18:20:13.893 INFO:teuthology.orchestra.run.smithi129.stdout: hv02.front.sepi 63.231.80.2 3 u 42 64 7 0.094 -361.21 1.427 2024-09-12T18:20:13.893 INFO:teuthology.orchestra.run.smithi129.stdout: hv03.front.sepi 74.6.168.72 3 u 45 64 7 0.127 -359.63 1.395 2024-09-12T18:20:13.893 INFO:teuthology.orchestra.run.smithi129.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:20:13.894 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:20:13.903 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:20:13.904 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:20:13.912 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:20:13.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:20:13.928 INFO:teuthology.task.internal:Duration was 1049.473782 seconds 2024-09-12T18:20:13.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:20:13.938 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:20:13.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:20:13.941 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:20:13.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:20:13.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:20:13.992 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:20:13.992 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T18:20:13.993 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:20:14.031 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-09-12T18:20:14.032 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:20:14.043 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T18:20:14.043 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:20:14.053 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-12T18:20:14.054 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:20:14.064 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:20:14.064 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:20:14.079 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:20:14.087 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:20:14.103 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:20:14.180 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:20:14.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:20:14.186 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:20:14.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:20:14.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:20:14.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:20:14.302 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:20:14.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:20:14.317 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:20:14.331 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:20:14.344 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:20:14.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:20:14.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.371 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.375 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.381 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-12T18:20:14.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.397 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-12T18:20:14.404 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-09-12T18:20:14.410 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-12T18:20:14.511 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:20:14.516 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:20:14.521 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:20:14.527 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:20:14.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:20:14.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:20:14.566 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:20:14.568 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi062 2024-09-12T18:20:14.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:20:14.591 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi129 2024-09-12T18:20:14.591 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:20:14.612 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi151 2024-09-12T18:20:14.613 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:20:14.634 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901167/remote/smithi176 2024-09-12T18:20:14.634 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:20:14.657 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:20:14.658 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:20:14.660 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:20:14.662 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:20:14.675 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:20:14.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:20:14.726 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:20:14.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:20:14.736 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:20:14.737 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:20:14.739 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:20:14.742 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:20:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:20 /home/ubuntu/cephtest 2024-09-12T18:20:14.744 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:20:14.745 INFO:teuthology.orchestra.run.smithi129.stdout: 658614 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:20 /home/ubuntu/cephtest 2024-09-12T18:20:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:20 /home/ubuntu/cephtest 2024-09-12T18:20:14.753 INFO:teuthology.orchestra.run.smithi176.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:20 /home/ubuntu/cephtest 2024-09-12T18:20:14.754 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:20:14.765 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:20:14.789 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} duration: 1049.4737815856934 flavor: default owner: scheduled_bhubbard@teuthology success: true 2024-09-12T18:20:14.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:20:14.859 INFO:teuthology.run:pass